-- Logs begin at Fri 2022-08-26 06:55:08 UTC, end at Fri 2022-08-26 08:10:52 UTC. -- Aug 26 07:29:09.901023 dv-cinder-806605-7-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 26 07:29:09.911535 dv-cinder-806605-7-iscsi devstack@keystone.service[81913]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 26 07:29:09.913578 dv-cinder-806605-7-iscsi devstack@keystone.service[81913]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 26 07:29:09 2022] *** Aug 26 07:29:09.913578 dv-cinder-806605-7-iscsi devstack@keystone.service[81913]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 26 07:29:09.913578 dv-cinder-806605-7-iscsi devstack@keystone.service[81913]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 26 07:29:09.913578 dv-cinder-806605-7-iscsi devstack@keystone.service[81913]: nodename: dv-cinder-806605-7-iscsi Aug 26 07:29:09.913578 dv-cinder-806605-7-iscsi devstack@keystone.service[81913]: machine: x86_64 Aug 26 07:29:09.913578 dv-cinder-806605-7-iscsi devstack@keystone.service[81913]: clock source: unix Aug 26 07:29:09.913578 dv-cinder-806605-7-iscsi devstack@keystone.service[81913]: pcre jit disabled Aug 26 07:29:09.913578 dv-cinder-806605-7-iscsi devstack@keystone.service[81913]: detected number of CPU cores: 4 Aug 26 07:29:09.913578 dv-cinder-806605-7-iscsi devstack@keystone.service[81913]: current working directory: / Aug 26 07:29:09.913578 dv-cinder-806605-7-iscsi devstack@keystone.service[81913]: detected binary path: /usr/bin/uwsgi-core Aug 26 07:29:09.913578 dv-cinder-806605-7-iscsi devstack@keystone.service[81913]: your processes number limit is 47680 Aug 26 07:29:09.914165 dv-cinder-806605-7-iscsi devstack@keystone.service[81913]: your memory page size is 4096 bytes Aug 26 07:29:09.914165 dv-cinder-806605-7-iscsi devstack@keystone.service[81913]: detected max file descriptor number: 2048 Aug 26 07:29:09.914165 dv-cinder-806605-7-iscsi devstack@keystone.service[81913]: lock engine: pthread robust mutexes Aug 26 07:29:09.914165 dv-cinder-806605-7-iscsi devstack@keystone.service[81913]: thunder lock: enabled Aug 26 07:29:09.914165 dv-cinder-806605-7-iscsi devstack@keystone.service[81913]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 26 07:29:09.914165 dv-cinder-806605-7-iscsi devstack@keystone.service[81913]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 26 07:29:09.956110 dv-cinder-806605-7-iscsi devstack@keystone.service[81913]: Python main interpreter initialized at 0x55abd70e29c0 Aug 26 07:29:09.956110 dv-cinder-806605-7-iscsi devstack@keystone.service[81913]: python threads support enabled Aug 26 07:29:09.956110 dv-cinder-806605-7-iscsi devstack@keystone.service[81913]: your server socket listen backlog is limited to 100 connections Aug 26 07:29:09.956110 dv-cinder-806605-7-iscsi devstack@keystone.service[81913]: your mercy for graceful operations on workers is 90 seconds Aug 26 07:29:09.956512 dv-cinder-806605-7-iscsi devstack@keystone.service[81913]: mapped 403077 bytes (393 KB) for 2 cores Aug 26 07:29:09.956602 dv-cinder-806605-7-iscsi devstack@keystone.service[81913]: *** Operational MODE: preforking *** Aug 26 07:29:09.956822 dv-cinder-806605-7-iscsi devstack@keystone.service[81913]: *** uWSGI is running in multiple interpreter mode *** Aug 26 07:29:09.956822 dv-cinder-806605-7-iscsi devstack@keystone.service[81913]: spawned uWSGI master process (pid: 81913) Aug 26 07:29:09.957034 dv-cinder-806605-7-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 26 07:29:09.959628 dv-cinder-806605-7-iscsi devstack@keystone.service[81913]: spawned uWSGI worker 1 (pid: 81926, cores: 1) Aug 26 07:29:09.959628 dv-cinder-806605-7-iscsi devstack@keystone.service[81913]: spawned uWSGI worker 2 (pid: 81927, cores: 1) Aug 26 07:29:09.959628 dv-cinder-806605-7-iscsi devstack@keystone.service[81913]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 26 07:29:14.445953 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 07:29:14.445953 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: from cryptography.utils import int_from_bytes Aug 26 07:29:14.446768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 07:29:14.446768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: from cryptography.utils import int_from_bytes Aug 26 07:29:14.447328 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 07:29:14.447328 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: from cryptography.utils import int_from_bytes Aug 26 07:29:14.447824 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 07:29:14.447824 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: from cryptography.utils import int_from_bytes Aug 26 07:29:14.497599 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 07:29:14.497833 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 07:29:14.498030 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] command line args: [] {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 07:29:14.498135 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 07:29:14.498303 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 07:29:14.498390 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 07:29:14.498469 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ================================================================================ {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 07:29:14.498554 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] command line args: [] {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 07:29:14.498722 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] admin_token = **** {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.498829 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 07:29:14.498910 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ================================================================================ {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 07:29:14.499007 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] config_dir = [] {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.499165 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.499266 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] admin_token = **** {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.499347 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] config_source = [] {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.499420 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] config_dir = [] {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.499502 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] debug = True {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.499596 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.499702 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.499998 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] config_source = [] {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.499998 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] debug = True {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.500151 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.500213 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.500296 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.500367 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.500603 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.500697 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.500765 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.500828 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.500993 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] list_limit = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.501079 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.501147 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] log_config_append = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.501214 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] list_limit = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.501277 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.501341 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] log_config_append = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.501512 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] log_dir = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.501598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.501665 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] log_file = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.501729 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] log_dir = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.501837 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] log_file = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.501960 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.502077 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.502177 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.502325 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.502432 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.502569 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.502706 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.502879 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.503101 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.503257 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.503435 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.503435 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.503794 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.504359 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.504524 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.504706 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.504887 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.505066 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.505275 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.505275 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.505599 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.505599 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.505915 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.506093 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.506303 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.506303 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.506618 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.506618 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.506930 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.507147 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.507395 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.507395 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] publish_errors = False {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.507687 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.507815 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.507938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] publish_errors = False {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.508093 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.508218 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.508339 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.508462 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.508578 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.508698 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.508862 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.508989 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.509113 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] standard_threads = False {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.509228 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.509349 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.509470 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] standard_threads = False {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.509596 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.509730 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.509847 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.509967 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.510082 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] use_journal = False {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.510230 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.510348 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] use_json = False {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.510541 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] use_journal = False {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.510659 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] use_stderr = False {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.510774 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] use_json = False {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.510901 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] use_syslog = False {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.511031 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] use_stderr = False {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.511148 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.511276 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] use_syslog = False {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.511276 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 07:29:14.511507 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.511507 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.511721 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.511721 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.511950 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.511950 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.512173 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.512295 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.512417 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.512538 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.512663 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.512811 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.512966 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.513092 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.513208 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.513329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.513453 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.513575 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.513696 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.513811 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.513925 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.514039 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.514162 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.514278 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.514399 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.514520 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.514641 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.514757 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.514879 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.515053 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.515171 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.515286 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.515412 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.515535 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.515662 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.515785 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.515900 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.516021 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.516142 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.516338 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.516458 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.516573 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.516687 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.516687 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.516901 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.516901 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.517135 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.517250 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.517364 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.517486 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.517608 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.517736 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.517851 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.517966 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.518086 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.518202 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.518323 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.518449 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.518573 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.518689 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.518804 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.518930 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.519071 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.519200 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.519316 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.519435 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.519557 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.519657 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.519752 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.519752 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.519940 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.520042 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.520141 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.520141 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.520381 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.520492 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.520591 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.520688 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.520784 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.520888 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.520991 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.521101 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.521218 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.521334 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.521448 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.521563 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.521679 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.521810 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.521930 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.522055 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.522171 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.522284 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.522400 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.522515 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.522632 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.522750 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.522864 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.522978 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.523130 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.523245 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.523376 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.523501 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.523625 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.523748 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.523866 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.523982 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.524095 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.524217 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.524333 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.524457 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.524580 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.524697 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.524824 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.524937 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.525053 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.525175 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.525291 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.525413 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.525541 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.525658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.525779 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.525898 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.526013 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.526119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.526243 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.526369 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.526487 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.526612 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.526729 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.526835 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.526959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.527108 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.527227 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.527343 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.527458 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.527573 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.527770 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.527896 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.528015 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.528137 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.528255 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.528371 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.528495 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.528619 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.528736 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.528859 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.528976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.529106 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.529233 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.529355 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.529481 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.529599 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.529721 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.529844 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.529960 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.530077 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.530201 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.530319 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.530435 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.530551 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.530673 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.530797 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.530923 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.531077 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.531195 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.531311 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.531426 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.531555 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.531673 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.531789 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.531905 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.532020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.532136 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.532261 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.532378 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.532494 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.532609 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.532725 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.532840 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.532968 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.533086 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.533202 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.533325 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.533443 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.533558 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.533686 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.533804 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.533920 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.534036 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.534152 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.534268 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.534392 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.534509 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.534625 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.534747 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.534865 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.534980 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.535641 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.535772 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.536029 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.536158 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.536283 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.536402 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.536527 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.536651 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.536775 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.536905 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.537047 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.537205 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.537337 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.537456 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.537572 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.537687 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.537831 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] auth.external = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.537959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.538084 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.538202 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] auth.external = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.538202 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.538438 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.538438 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.538669 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.538788 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] auth.password = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.538910 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.539110 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] auth.token = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.539231 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] auth.password = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.539349 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.539477 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] auth.token = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.539477 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.539699 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.539824 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.539944 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.540060 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.540177 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.540294 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.540411 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.540540 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.540661 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.540779 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.540896 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.541012 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.541129 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] credential.caching = True {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.541258 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] credential.caching = True {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.541377 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.541493 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.541611 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.541728 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.541845 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.541970 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.542097 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.542221 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.542346 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.542463 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.542586 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.542788 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.542909 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.543042 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.543162 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.543296 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.543416 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.543543 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.543662 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.543779 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.543903 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.544022 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.544140 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.544266 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.544385 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.544508 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.544657 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.544780 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.544897 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.545024 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.545144 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] federation.caching = True {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.545262 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] federation.caching = True {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.545379 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.545496 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.545621 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.545748 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.545868 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.545985 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.546103 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.546219 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.546345 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.546465 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.546583 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.546701 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.546819 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.546946 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.547094 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.547215 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.547332 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.547450 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.547567 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.547675 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.547800 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.547921 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.548038 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] identity.caching = True {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.548155 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] identity.caching = True {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.548272 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.548388 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.548514 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.548633 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.548751 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.548868 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.548986 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.549104 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.549230 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.549352 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.549470 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.549587 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.549704 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.549820 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.549946 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.550065 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.550183 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.550299 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.550416 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.550533 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.550659 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.550831 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.550831 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.551581 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.552171 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.552417 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.552634 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.552822 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.553004 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.553198 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.553332 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.553451 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.553586 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.553759 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.553951 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.554139 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.554328 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.554520 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.554691 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.554813 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.554931 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.555065 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.555183 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.555303 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.555434 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.555555 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.555673 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.555790 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.555907 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.556024 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.556178 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.556304 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.556429 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.556548 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.556665 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.556783 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.556783 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.557017 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.557017 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.557017 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.557340 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.557466 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.557584 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.557708 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.557708 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.557929 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.558045 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.558171 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.558171 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.558393 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.558510 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.558633 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.558752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.558877 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.559063 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.559184 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.559301 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.559429 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.559549 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.559675 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.559799 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.559916 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.560032 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.560149 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.560265 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.560391 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.560510 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.560626 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.560742 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.560858 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.560975 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.561100 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.561240 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.561360 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.561478 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.561596 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.561719 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.561846 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.561965 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.562082 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.user = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.562198 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.562315 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.562432 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.user = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.562557 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.562677 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.562794 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.562910 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.563056 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.563177 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.563307 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.563427 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.563544 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.563668 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.563786 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.563903 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.564028 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.564148 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.564264 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.564382 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.564505 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.564623 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.564750 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.564869 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.564985 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.565102 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.565218 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.565342 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.565468 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.565587 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.565703 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.565821 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.565938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.566055 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.566181 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.566299 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.566443 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.566562 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.566678 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.566796 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.567188 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.567310 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.567434 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.567552 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.567653 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.567752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.567988 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.568121 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.568242 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.568361 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.568478 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.568595 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.568727 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.568848 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.568966 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.569084 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.569206 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.569332 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.569460 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.569580 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.569702 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.569821 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.569939 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.570064 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.570191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.570311 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.570428 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.570545 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.570662 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.570788 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.570915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.571051 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.571172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.571290 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.571407 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] resource.caching = True {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.571524 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.571654 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.571758 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] resource.caching = True {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.571873 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.571991 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.572109 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.572227 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.572352 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.572478 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.572596 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.572713 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.572830 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.572947 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.573077 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.573197 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.573314 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.573431 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.573431 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.573679 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.573799 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.573917 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] role.caching = True {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.574034 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] role.caching = True {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.574152 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] role.driver = sql {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.574270 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] role.driver = sql {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.574396 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.574515 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.574633 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.574757 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.574876 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.575026 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.575204 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.575346 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.575465 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.575583 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.575690 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.575806 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.575933 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.576053 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.576171 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.576296 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.576415 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.576532 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.576658 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.576777 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.576894 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.577012 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.577129 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.577248 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.577375 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.577494 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.577613 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.577745 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.577878 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.577996 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.578124 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.578244 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.578363 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.578482 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.578600 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.578718 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.578844 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.578964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.579111 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.579229 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.579348 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.579484 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.579605 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.579723 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.579842 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.579960 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.580084 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.580217 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.580337 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.580456 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.580574 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.580691 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.580814 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.580942 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.581062 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.581189 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.581309 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.581427 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.581545 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.581671 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.581799 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.581918 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.582570 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.582671 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.582777 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.582905 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.583191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] token.caching = True {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.583419 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] token.caching = True {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.583540 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.583658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.583776 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.583908 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.584018 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.584135 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.584252 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.584370 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.584487 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.584615 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.584734 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.584852 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.584970 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.585088 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.585206 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.585332 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.585451 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.585569 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.585688 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.585806 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.585923 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.586049 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.586169 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.586286 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.586403 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.586521 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.586639 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.586767 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.586887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.587033 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.587169 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.587298 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.587417 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.587535 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.587652 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] database.connection = **** {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.587771 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] database.connection = **** {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.587971 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.588100 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.588220 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.588338 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.588462 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.588582 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.588708 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.588829 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.588947 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.589064 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.589189 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.589308 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.589434 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.589554 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.589672 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.589789 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.589907 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.590029 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.590157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.590277 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.590395 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.590512 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.590629 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.590747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.590873 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.591012 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.591134 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.591251 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.591369 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.591486 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.591617 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.591737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.591854 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.591973 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.592091 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.592209 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 07:29:14.592335 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 07:29:14.592456 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 07:29:14.616681 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.616909 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.617136 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.618193 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.618431 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.618659 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.625669 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.627167 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.654752 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.654977 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.655953 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.656189 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.712185 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.712879 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.767024 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.767264 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.769135 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.769369 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.836468 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.836680 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.836903 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.837126 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.837351 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.837569 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.866795 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.867079 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.867405 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.867633 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.867857 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.868075 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.868294 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.880562 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.924982 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.925215 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.925424 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.925643 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.926637 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.927454 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.946925 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.947186 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.947403 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.947628 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.947848 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.948067 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.948285 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.957092 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.970103 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.970435 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.970435 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.970653 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.970869 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.971114 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.971329 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.977022 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.977258 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.982347 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.982347 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.982347 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.982347 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.982347 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 07:29:14.992997 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:14.993210 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 26 07:29:14.993420 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:14.993557 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:14.993643 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 26 07:29:14.993758 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 26 07:29:14.993980 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:14.994067 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:14.994194 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 26 07:29:14.994279 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:14.994477 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:14.994747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:14.994830 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:14.995032 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:14.995119 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:14.995293 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.004757 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.005037 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.005126 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.005323 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.005424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.005589 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.005684 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.005908 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.012629 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81927) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 07:29:15.013001 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81926) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 07:29:15.015554 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81927) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 07:29:15.015844 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.016024 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81926) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 07:29:15.016154 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.016312 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.016404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.016596 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.016693 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.016881 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.016965 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.017167 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.017250 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.017432 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.017516 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.017704 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.017814 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.017978 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.018095 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.018249 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.018369 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.018524 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.018795 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.042542 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.042765 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.044178 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81927) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 07:29:15.044271 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81926) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 07:29:15.044469 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.044552 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.049125 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81926) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 07:29:15.049276 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81927) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 07:29:15.049413 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.049677 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.049795 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.050130 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.057256 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81926) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 07:29:15.057555 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.061409 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81927) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 07:29:15.061716 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.061942 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81926) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 07:29:15.062254 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.062543 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.062898 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.063348 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.063631 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.063913 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.064193 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.066004 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81927) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 07:29:15.066805 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.066805 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.067859 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.067973 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.068208 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.068479 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.068929 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.081153 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.081449 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.085546 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81926) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 07:29:15.086597 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.086894 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.088800 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.119502 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.119637 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81927) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 07:29:15.119724 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81926) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 07:29:15.119804 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.119804 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.119977 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81926) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 07:29:15.120064 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81927) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 07:29:15.120142 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.120142 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.120142 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.120142 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.120142 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.120142 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.120533 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81927) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 07:29:15.120533 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.120533 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.120533 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.120533 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.120533 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.120936 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.121013 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81926) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 07:29:15.121013 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.121013 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.121013 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.123811 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81927) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 07:29:15.124119 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.124390 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.124666 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.126584 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.129794 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.130078 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.131823 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.132818 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81926) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 07:29:15.133111 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.133393 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.133477 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.133672 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.133757 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.133957 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.136352 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81927) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 07:29:15.136646 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.136940 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.137233 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.137515 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.145424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81926) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 07:29:15.145709 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.145992 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.146274 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.146559 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.146850 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.147152 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.149111 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81927) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 07:29:15.149398 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.149678 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.149958 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.150242 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.150519 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.150799 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.163593 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81926) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 07:29:15.166602 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81926) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 07:29:15.167034 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81927) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 07:29:15.169664 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.170948 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81927) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 07:29:15.171175 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.172674 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81926) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 07:29:15.172962 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.173095 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.173245 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.174407 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.176548 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81927) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 07:29:15.176834 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.177119 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.180680 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.182239 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81926) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 07:29:15.183736 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.185237 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.185336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81927) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 07:29:15.185491 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.185777 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.186056 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.188147 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.188438 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.188723 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.189000 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.194738 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81926) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 07:29:15.195057 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.195343 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.197397 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81927) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 07:29:15.197698 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.197983 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.202378 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81926) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 07:29:15.202773 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.203090 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.203369 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.203639 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.203911 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.204196 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.204476 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.204746 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.204906 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81927) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 07:29:15.205026 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.205202 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.205308 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.205484 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.205576 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.205781 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.205872 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.206060 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.206206 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.206379 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.206601 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.206876 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.207227 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.207522 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.207796 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.208057 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.208366 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.208584 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 07:29:15.242297 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55abd70e29c0 pid: 81926 (default app) Aug 26 07:29:15.244964 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55abd70e29c0 pid: 81927 (default app) Aug 26 07:29:15.245887 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c81fb-9b72-4048-9b2b-76d61f9d11a0 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:15.246182 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c81fb-9b72-4048-9b2b-76d61f9d11a0 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:15.246452 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c81fb-9b72-4048-9b2b-76d61f9d11a0 None None] PATH_INFO: `/v3` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:15.250598 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 791 bytes} [Fri Aug 26 07:29:15 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:23.073755 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d81af-b888-4568-808c-4a29db16d15f None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:23.074310 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d81af-b888-4568-808c-4a29db16d15f None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:23.074310 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d81af-b888-4568-808c-4a29db16d15f None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:23.078517 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1/2] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:29:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 07:29:23.085082 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d95f9c-70ad-4a80-9a6f-ad3330ec21ad None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:23.085570 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d95f9c-70ad-4a80-9a6f-ad3330ec21ad None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:23.085663 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d95f9c-70ad-4a80-9a6f-ad3330ec21ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:23.157969 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: INFO dbcounter [None req-65d95f9c-70ad-4a80-9a6f-ad3330ec21ad None None] Registered counter for database keystone Aug 26 07:29:23.181132 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG oslo_db.sqlalchemy.engines [None req-65d95f9c-70ad-4a80-9a6f-ad3330ec21ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 07:29:23.187643 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writer thread running {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 07:29:23.369889 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG passlib.handlers.bcrypt [None req-65d95f9c-70ad-4a80-9a6f-ad3330ec21ad None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81926) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 26 07:29:23.370305 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG passlib.handlers.bcrypt [None req-65d95f9c-70ad-4a80-9a6f-ad3330ec21ad None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81926) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 26 07:29:23.426106 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-65d95f9c-70ad-4a80-9a6f-ad3330ec21ad None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:29:23.427753 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-65d95f9c-70ad-4a80-9a6f-ad3330ec21ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:29:23.566386 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:29:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 482 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 26 07:29:24.028690 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d81af-b888-4568-808c-4a29db16d15f None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:24.098588 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: INFO dbcounter [None req-559d81af-b888-4568-808c-4a29db16d15f None None] Registered counter for database keystone Aug 26 07:29:24.119079 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG oslo_db.sqlalchemy.engines [None req-559d81af-b888-4568-808c-4a29db16d15f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81927) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 07:29:24.125938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writer thread running {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 07:29:24.248298 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d81af-b888-4568-808c-4a29db16d15f None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:24.252625 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd5542-bab2-461f-882e-aec19248ab39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:24.253270 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd5542-bab2-461f-882e-aec19248ab39 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:24.253551 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd5542-bab2-461f-882e-aec19248ab39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:24.253822 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd5542-bab2-461f-882e-aec19248ab39 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:24.263062 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd5542-bab2-461f-882e-aec19248ab39 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:24.314240 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: WARNING keystone.common.rbac_enforcer.enforcer [None req-86fd5542-bab2-461f-882e-aec19248ab39 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 26 07:29:24.314499 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd5542-bab2-461f-882e-aec19248ab39 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:24.325354 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1324 bytes} [Fri Aug 26 07:29:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 07:29:24.332338 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d95f9c-70ad-4a80-9a6f-ad3330ec21ad None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:24.349040 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d95f9c-70ad-4a80-9a6f-ad3330ec21ad None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:24.353747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5f6d3-0e26-4c55-b6f5-27f8a00d853e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:24.354867 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5f6d3-0e26-4c55-b6f5-27f8a00d853e admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:24.355167 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5f6d3-0e26-4c55-b6f5-27f8a00d853e admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:24.355432 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5f6d3-0e26-4c55-b6f5-27f8a00d853e admin admin] PATH_INFO: `/v3/projects/05529a2e6f734315b4cede55fbcb5c2c` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:24.357226 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d5f6d3-0e26-4c55-b6f5-27f8a00d853e admin admin] RBAC: Authorizing `identity:get_project(project_id=05529a2e6f734315b4cede55fbcb5c2c)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:24.412190 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: WARNING keystone.common.rbac_enforcer.enforcer [None req-82d5f6d3-0e26-4c55-b6f5-27f8a00d853e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 26 07:29:24.412526 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d5f6d3-0e26-4c55-b6f5-27f8a00d853e admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:24.417172 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 3/5] 10.222.0.42 () {56 vars in 1207 bytes} [Fri Aug 26 07:29:24 2022] GET /identity/v3/projects/05529a2e6f734315b4cede55fbcb5c2c => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:26.367332 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c953cd4-0e2d-47e7-b2ad-7fe077b9f60a None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:26.367889 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c953cd4-0e2d-47e7-b2ad-7fe077b9f60a None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:26.367889 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c953cd4-0e2d-47e7-b2ad-7fe077b9f60a None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:26.372008 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 3/6] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:29:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:29:26.377419 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c4a16-4293-417a-b719-24a641a89cbe None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:26.377838 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c4a16-4293-417a-b719-24a641a89cbe None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:26.377965 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c4a16-4293-417a-b719-24a641a89cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:26.400289 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-7a4c4a16-4293-417a-b719-24a641a89cbe None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:29:26.401809 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-7a4c4a16-4293-417a-b719-24a641a89cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:29:26.411131 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:29:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 26 07:29:26.679623 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c953cd4-0e2d-47e7-b2ad-7fe077b9f60a None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:26.692960 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c953cd4-0e2d-47e7-b2ad-7fe077b9f60a None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:26.697369 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720e61a-baba-489f-9bad-2e4fa5439593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:26.697985 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720e61a-baba-489f-9bad-2e4fa5439593 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:26.698266 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720e61a-baba-489f-9bad-2e4fa5439593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:26.698540 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720e61a-baba-489f-9bad-2e4fa5439593 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:26.706823 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f720e61a-baba-489f-9bad-2e4fa5439593 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:26.708662 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f720e61a-baba-489f-9bad-2e4fa5439593 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:26.717738 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1324 bytes} [Fri Aug 26 07:29:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 07:29:26.723761 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c4a16-4293-417a-b719-24a641a89cbe None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:26.733163 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c4a16-4293-417a-b719-24a641a89cbe None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:26.737671 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b43cd53-9200-4c79-a2bc-803585200b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:26.738961 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b43cd53-9200-4c79-a2bc-803585200b68 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:26.739346 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b43cd53-9200-4c79-a2bc-803585200b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:26.739582 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b43cd53-9200-4c79-a2bc-803585200b68 admin admin] PATH_INFO: `/v3/users/373a698192574b4b8cacbfbcfee3991d` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:26.740926 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b43cd53-9200-4c79-a2bc-803585200b68 admin admin] RBAC: Authorizing `identity:get_user(user_id=373a698192574b4b8cacbfbcfee3991d)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:26.742788 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b43cd53-9200-4c79-a2bc-803585200b68 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:26.744404 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 5/9] 10.222.0.42 () {56 vars in 1198 bytes} [Fri Aug 26 07:29:26 2022] GET /identity/v3/users/373a698192574b4b8cacbfbcfee3991d => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:28.771710 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff56e7f-cb60-48ca-b2b7-7715915daf68 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:28.772195 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff56e7f-cb60-48ca-b2b7-7715915daf68 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:28.772285 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff56e7f-cb60-48ca-b2b7-7715915daf68 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:28.773581 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 5/10] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 07:29:28.779156 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b3c14-d5d1-4316-9533-9db28c23450a None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:28.779571 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b3c14-d5d1-4316-9533-9db28c23450a None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:28.779825 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b3c14-d5d1-4316-9533-9db28c23450a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:28.798213 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-3b8b3c14-d5d1-4316-9533-9db28c23450a None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:29:28.799507 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-3b8b3c14-d5d1-4316-9533-9db28c23450a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:29:28.850144 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25298c7c-bc73-4282-aec3-29a45a5e5e41 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:28.850474 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25298c7c-bc73-4282-aec3-29a45a5e5e41 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:28.850680 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25298c7c-bc73-4282-aec3-29a45a5e5e41 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:28.852122 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 6/11] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 07:29:28.857469 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c57e1-f89e-4f32-afb8-3478b0871235 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:28.857753 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c57e1-f89e-4f32-afb8-3478b0871235 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:28.858118 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c57e1-f89e-4f32-afb8-3478b0871235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:28.887024 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 6/12] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:29:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 07:29:28.903381 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG passlib.handlers.bcrypt [None req-1b0c57e1-f89e-4f32-afb8-3478b0871235 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81927) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 26 07:29:28.903808 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG passlib.handlers.bcrypt [None req-1b0c57e1-f89e-4f32-afb8-3478b0871235 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81927) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 26 07:29:28.952006 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-1b0c57e1-f89e-4f32-afb8-3478b0871235 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:29:28.953636 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-1b0c57e1-f89e-4f32-afb8-3478b0871235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:29:29.063410 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 7/13] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:29:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 07:29:29.159720 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b3c14-d5d1-4316-9533-9db28c23450a None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:29.184556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:29.265360 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b3c14-d5d1-4316-9533-9db28c23450a None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:29.298769 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bedf3be-a1ca-4f6a-a843-51d9ff7c3a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:29.299439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bedf3be-a1ca-4f6a-a843-51d9ff7c3a8b None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:29.299719 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bedf3be-a1ca-4f6a-a843-51d9ff7c3a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:29.299994 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bedf3be-a1ca-4f6a-a843-51d9ff7c3a8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:29.311665 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bedf3be-a1ca-4f6a-a843-51d9ff7c3a8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:29:29.320819 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-3bedf3be-a1ca-4f6a-a843-51d9ff7c3a8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:29:29.320819 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:29:29.320819 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:29:29.320819 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:29:29.320819 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:29:29.320819 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:29:29.320819 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:29:29.320819 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:29:29.320819 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:29:29.320819 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:29:29.320819 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:29:29.320819 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:29:29.320819 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:29:29.320819 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:29:29.320819 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:29:29.320819 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:29:29.321915 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:29:29.321915 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:29:29.321915 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:29:29.321915 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:29:29.321915 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:29:29.321915 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:29:29.321915 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:29:29.321915 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:29:29.321915 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:29:29.321915 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:29:29.321915 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:29:29.321915 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:29:29.321915 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:29:29.321915 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:29:29.321915 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:29:29.321915 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:29:29.323058 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:29:29.323058 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:29:29.323058 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:29:29.323058 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:29:29.323058 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:29:29.323058 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:29:29.323058 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:29:29.323058 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:29:29.323058 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:29:29.323058 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:29:29.323058 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:29:29.323058 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:29:29.326852 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 7/14] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 26 07:29:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:29:29.327869 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c57e1-f89e-4f32-afb8-3478b0871235 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:29.339647 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bedf3be-a1ca-4f6a-a843-51d9ff7c3a8b None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:29.431501 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:29.437998 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c57e1-f89e-4f32-afb8-3478b0871235 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:29.440405 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:29.451590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bedf3be-a1ca-4f6a-a843-51d9ff7c3a8b None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:29.478285 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2efd5d-8b3d-4287-b8e3-cbd48d838f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:29.479182 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2efd5d-8b3d-4287-b8e3-cbd48d838f23 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:29.479466 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2efd5d-8b3d-4287-b8e3-cbd48d838f23 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:29.479742 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2efd5d-8b3d-4287-b8e3-cbd48d838f23 None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:29.480684 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2efd5d-8b3d-4287-b8e3-cbd48d838f23 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:29:29.480992 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2efd5d-8b3d-4287-b8e3-cbd48d838f23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:29.482448 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2efd5d-8b3d-4287-b8e3-cbd48d838f23 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:29.486327 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2aed56-3d55-4594-9d72-b7e0f143614a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:29.486953 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2aed56-3d55-4594-9d72-b7e0f143614a None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:29.487341 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2aed56-3d55-4594-9d72-b7e0f143614a None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:29.487624 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2aed56-3d55-4594-9d72-b7e0f143614a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:29.495058 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 8/15] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:29:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:29.500718 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2efd5d-8b3d-4287-b8e3-cbd48d838f23 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:29.558597 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2aed56-3d55-4594-9d72-b7e0f143614a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:29.560179 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2aed56-3d55-4594-9d72-b7e0f143614a None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:29.603782 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2efd5d-8b3d-4287-b8e3-cbd48d838f23 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:29.640538 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b9fa7-8a2d-46c9-b53b-357d5905bda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:29.641519 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b9fa7-8a2d-46c9-b53b-357d5905bda3 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:29.641804 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b9fa7-8a2d-46c9-b53b-357d5905bda3 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:29.642177 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b9fa7-8a2d-46c9-b53b-357d5905bda3 None admin] PATH_INFO: `/v3/users/373a698192574b4b8cacbfbcfee3991d` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:29.642288 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:29.643813 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b9fa7-8a2d-46c9-b53b-357d5905bda3 None admin] RBAC: Authorizing `identity:get_user(user_id=373a698192574b4b8cacbfbcfee3991d)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:29.646396 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b9fa7-8a2d-46c9-b53b-357d5905bda3 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:29.653115 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 9/16] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:29:29 2022] GET /identity/v3/users/373a698192574b4b8cacbfbcfee3991d => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:29:29.653589 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b9fa7-8a2d-46c9-b53b-357d5905bda3 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:29.669397 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 8/17] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:29:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 07:29:29.675349 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2aed56-3d55-4594-9d72-b7e0f143614a None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:29.691292 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:29.766731 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b9fa7-8a2d-46c9-b53b-357d5905bda3 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:29.780547 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2aed56-3d55-4594-9d72-b7e0f143614a None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:29.803422 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dde1d1-df47-4191-9523-11a53798990a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:29.804076 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dde1d1-df47-4191-9523-11a53798990a None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:29.804365 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dde1d1-df47-4191-9523-11a53798990a None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:29.804648 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dde1d1-df47-4191-9523-11a53798990a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:29.805792 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dde1d1-df47-4191-9523-11a53798990a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:29.807308 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dde1d1-df47-4191-9523-11a53798990a None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:29.808871 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 10/18] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:29:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:29:29.814713 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dde1d1-df47-4191-9523-11a53798990a None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:29.816146 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b133219-1078-4345-8e19-dd176864300a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:29.816932 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b133219-1078-4345-8e19-dd176864300a None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:29.817475 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b133219-1078-4345-8e19-dd176864300a None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:29.817758 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b133219-1078-4345-8e19-dd176864300a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:29.830044 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b133219-1078-4345-8e19-dd176864300a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:29.833068 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b133219-1078-4345-8e19-dd176864300a None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:29.850047 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-5b133219-1078-4345-8e19-dd176864300a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:29:29.850047 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:29:29.850047 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:29:29.850047 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:29:29.850047 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:29:29.850047 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:29:29.850047 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:29:29.850047 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:29:29.850047 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:29:29.850047 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:29:29.850047 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:29:29.850047 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:29:29.850047 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:29:29.850047 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:29:29.850047 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:29:29.850047 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:29:29.851035 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:29:29.851035 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:29:29.851035 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:29:29.851035 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:29:29.851035 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:29:29.851035 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:29:29.851035 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:29:29.851035 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:29:29.851035 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:29:29.851035 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:29:29.851035 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:29:29.851035 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:29:29.851035 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:29:29.851035 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:29:29.851035 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:29:29.851035 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:29:29.851035 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:29:29.851849 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:29:29.851849 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:29:29.851849 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:29:29.851849 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 9/19] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:29:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 07:29:29.857140 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b133219-1078-4345-8e19-dd176864300a None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:29.892549 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:29.918449 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dde1d1-df47-4191-9523-11a53798990a None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:29.920380 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:29.965652 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8257ff19-bc6b-4b96-983d-26d9e86d6474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:29.966278 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257ff19-bc6b-4b96-983d-26d9e86d6474 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:29.966562 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257ff19-bc6b-4b96-983d-26d9e86d6474 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:29.966680 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b133219-1078-4345-8e19-dd176864300a None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:29.966838 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257ff19-bc6b-4b96-983d-26d9e86d6474 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:29.967612 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8257ff19-bc6b-4b96-983d-26d9e86d6474 None admin] RBAC: Adding query filter params (role.id=07ed857b2feb472f9fa9e7fe0b08582b, scope.domain.id=default, user.id=373a698192574b4b8cacbfbcfee3991d) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:29:29.967924 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8257ff19-bc6b-4b96-983d-26d9e86d6474 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:29.969379 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8257ff19-bc6b-4b96-983d-26d9e86d6474 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:29.978506 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 11/20] 10.222.0.42 () {56 vars in 1322 bytes} [Fri Aug 26 07:29:29 2022] GET /identity/v3/role_assignments?user.id=373a698192574b4b8cacbfbcfee3991d&scope.domain.id=default&role.id=07ed857b2feb472f9fa9e7fe0b08582b => generated 233 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:29:30.003095 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d3d8c-53c0-4425-8c37-75f4a6e3c67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:30.004272 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d3d8c-53c0-4425-8c37-75f4a6e3c67d None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:30.004547 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d3d8c-53c0-4425-8c37-75f4a6e3c67d None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:30.004817 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d3d8c-53c0-4425-8c37-75f4a6e3c67d None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:30.006435 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d3d8c-53c0-4425-8c37-75f4a6e3c67d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:29:30.006739 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d3d8c-53c0-4425-8c37-75f4a6e3c67d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:30.008836 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d3d8c-53c0-4425-8c37-75f4a6e3c67d None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:30.030077 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 10/21] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:29:32.350002 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef102b69-bb19-45d4-a638-9c66081bdba4 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:32.350539 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef102b69-bb19-45d4-a638-9c66081bdba4 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:32.350539 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef102b69-bb19-45d4-a638-9c66081bdba4 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:32.352378 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 12/22] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:29:32.357779 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81b464-0fe4-414c-9fe2-6334662dcd6a None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:32.358273 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81b464-0fe4-414c-9fe2-6334662dcd6a None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:32.358354 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81b464-0fe4-414c-9fe2-6334662dcd6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:32.381036 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-2c81b464-0fe4-414c-9fe2-6334662dcd6a None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:29:32.382267 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-2c81b464-0fe4-414c-9fe2-6334662dcd6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:29:32.488054 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 11/23] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:29:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 07:29:32.611600 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1f5b8-a820-42bc-84df-0b06eeff4c5f None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:32.611887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1f5b8-a820-42bc-84df-0b06eeff4c5f None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:32.612112 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1f5b8-a820-42bc-84df-0b06eeff4c5f None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:32.614365 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 13/24] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:29:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:29:32.619655 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2f1c2-3020-4320-9a50-789b1a0a4541 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:32.619946 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2f1c2-3020-4320-9a50-789b1a0a4541 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:32.620228 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2f1c2-3020-4320-9a50-789b1a0a4541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:32.648037 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-cfd2f1c2-3020-4320-9a50-789b1a0a4541 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:29:32.649265 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-cfd2f1c2-3020-4320-9a50-789b1a0a4541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:29:32.671480 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:32.731186 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 12/25] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:29:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:29:32.918704 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9dd61-f82b-4bd8-9953-c40976885673 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:32.919055 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9dd61-f82b-4bd8-9953-c40976885673 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:32.919276 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9dd61-f82b-4bd8-9953-c40976885673 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:32.920911 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 14/26] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:29:32.926887 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d3c7e-753f-4ea8-ba9e-6693ffd86826 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:32.927201 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d3c7e-753f-4ea8-ba9e-6693ffd86826 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:32.927483 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d3c7e-753f-4ea8-ba9e-6693ffd86826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:32.955119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-714d3c7e-753f-4ea8-ba9e-6693ffd86826 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:29:32.956366 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-714d3c7e-753f-4ea8-ba9e-6693ffd86826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:29:32.984046 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9dd61-f82b-4bd8-9953-c40976885673 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:33.065513 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 13/27] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:29:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:29:33.123186 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2301ecc-8025-44f2-b57a-2f8b608f06a3 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:33.123473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2301ecc-8025-44f2-b57a-2f8b608f06a3 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:33.123745 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2301ecc-8025-44f2-b57a-2f8b608f06a3 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:33.125091 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 14/28] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 07:29:33.140821 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7ed8c-e2ef-4b5f-9e76-9d7871c7c117 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:33.141131 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7ed8c-e2ef-4b5f-9e76-9d7871c7c117 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:33.141372 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7ed8c-e2ef-4b5f-9e76-9d7871c7c117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:33.152878 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9dd61-f82b-4bd8-9953-c40976885673 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:33.181499 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-9cb7ed8c-e2ef-4b5f-9e76-9d7871c7c117 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:29:33.182665 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-9cb7ed8c-e2ef-4b5f-9e76-9d7871c7c117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:29:33.234510 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d73e87-35d3-4c6d-803a-e63b8ee4adef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:33.235193 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d73e87-35d3-4c6d-803a-e63b8ee4adef None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:33.235478 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d73e87-35d3-4c6d-803a-e63b8ee4adef None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:33.235761 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d73e87-35d3-4c6d-803a-e63b8ee4adef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:33.261291 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d73e87-35d3-4c6d-803a-e63b8ee4adef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:29:33.270086 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-28d73e87-35d3-4c6d-803a-e63b8ee4adef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:29:33.270086 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:29:33.270086 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:29:33.270086 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:29:33.270086 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:29:33.270086 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:29:33.270086 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:29:33.270086 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:29:33.270086 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:29:33.270086 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:29:33.270086 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:29:33.270086 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:29:33.270086 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:29:33.270086 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:29:33.270086 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:29:33.270086 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:29:33.272290 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:29:33.272290 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:29:33.272290 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:29:33.272290 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:29:33.272290 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:29:33.272290 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:29:33.272290 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:29:33.272290 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:29:33.272290 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:29:33.272290 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:29:33.272290 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:29:33.272290 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:29:33.272290 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:29:33.272290 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:29:33.272290 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:29:33.272290 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:29:33.274165 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:29:33.274165 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:29:33.274165 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:29:33.274165 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:29:33.274165 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:29:33.274165 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:29:33.274165 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:29:33.274165 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:29:33.274165 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:29:33.274165 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:29:33.274165 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:29:33.274165 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:29:33.279773 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 15/29] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 26 07:29:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:29:33.286156 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d73e87-35d3-4c6d-803a-e63b8ee4adef None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:33.321301 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 15/30] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:29:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 07:29:33.339892 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7ed8c-e2ef-4b5f-9e76-9d7871c7c117 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:33.351270 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:33.365126 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:33.510847 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d73e87-35d3-4c6d-803a-e63b8ee4adef None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:33.516268 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7ed8c-e2ef-4b5f-9e76-9d7871c7c117 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:33.586830 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a312ec-2ecb-4135-a820-bee4d8d14e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:33.587480 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a312ec-2ecb-4135-a820-bee4d8d14e3b None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:33.587759 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a312ec-2ecb-4135-a820-bee4d8d14e3b None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:33.588028 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a312ec-2ecb-4135-a820-bee4d8d14e3b None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:33.588714 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a312ec-2ecb-4135-a820-bee4d8d14e3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:29:33.589016 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a312ec-2ecb-4135-a820-bee4d8d14e3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:33.590423 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a312ec-2ecb-4135-a820-bee4d8d14e3b None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:33.595815 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf1ea9-df26-4a09-8bb7-c3c995086d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:33.596462 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf1ea9-df26-4a09-8bb7-c3c995086d41 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:33.596741 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf1ea9-df26-4a09-8bb7-c3c995086d41 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:33.597043 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf1ea9-df26-4a09-8bb7-c3c995086d41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:33.613092 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 16/31] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:29:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:29:33.614175 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a312ec-2ecb-4135-a820-bee4d8d14e3b None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:33.619030 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf1ea9-df26-4a09-8bb7-c3c995086d41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:33.620528 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf1ea9-df26-4a09-8bb7-c3c995086d41 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:33.649211 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-13cf1ea9-df26-4a09-8bb7-c3c995086d41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:29:33.649211 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:29:33.649211 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:29:33.649211 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:29:33.649211 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:29:33.649211 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:29:33.649211 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:29:33.649211 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:29:33.649211 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:29:33.649211 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:29:33.649211 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:29:33.649211 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:29:33.649211 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:29:33.649211 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:29:33.649211 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:29:33.649211 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:29:33.650141 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:29:33.650141 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:29:33.650141 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:29:33.650141 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:29:33.650141 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:29:33.650141 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:29:33.650141 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:29:33.650141 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:29:33.650141 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:29:33.650141 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:29:33.650141 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:29:33.650141 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:29:33.650141 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:29:33.650141 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:29:33.650141 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:29:33.650141 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:29:33.650141 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:29:33.650920 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:29:33.650920 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:29:33.650920 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:29:33.653344 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 16/32] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:29:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 07:29:33.654404 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf1ea9-df26-4a09-8bb7-c3c995086d41 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:33.764983 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:33.798903 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:33.806091 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf1ea9-df26-4a09-8bb7-c3c995086d41 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:33.814087 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a312ec-2ecb-4135-a820-bee4d8d14e3b None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:33.850913 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17728fe7-964e-42fe-a8cd-01074c28eafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:33.852144 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17728fe7-964e-42fe-a8cd-01074c28eafd None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:33.852647 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17728fe7-964e-42fe-a8cd-01074c28eafd None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:33.853583 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17728fe7-964e-42fe-a8cd-01074c28eafd None admin] PATH_INFO: `/v3/users/373a698192574b4b8cacbfbcfee3991d` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:33.855387 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17728fe7-964e-42fe-a8cd-01074c28eafd None admin] RBAC: Authorizing `identity:get_user(user_id=373a698192574b4b8cacbfbcfee3991d)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:33.857160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17728fe7-964e-42fe-a8cd-01074c28eafd None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:33.859669 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 17/33] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:29:33 2022] GET /identity/v3/users/373a698192574b4b8cacbfbcfee3991d => generated 247 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:33.860631 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17728fe7-964e-42fe-a8cd-01074c28eafd None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:33.865913 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c04992-1e08-4567-8865-51f5a8e8ee4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:33.866394 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c04992-1e08-4567-8865-51f5a8e8ee4f None admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:33.866789 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c04992-1e08-4567-8865-51f5a8e8ee4f None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:33.867267 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c04992-1e08-4567-8865-51f5a8e8ee4f None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:33.868057 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c04992-1e08-4567-8865-51f5a8e8ee4f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:33.869567 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c04992-1e08-4567-8865-51f5a8e8ee4f None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:33.983140 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17728fe7-964e-42fe-a8cd-01074c28eafd None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:34.026651 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4bc42-b977-4b7b-a42f-08e707c84076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:34.027215 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4bc42-b977-4b7b-a42f-08e707c84076 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:34.027501 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4bc42-b977-4b7b-a42f-08e707c84076 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:34.027777 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4bc42-b977-4b7b-a42f-08e707c84076 None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:34.028452 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f4bc42-b977-4b7b-a42f-08e707c84076 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:29:34.028750 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f4bc42-b977-4b7b-a42f-08e707c84076 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:34.030186 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f4bc42-b977-4b7b-a42f-08e707c84076 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:34.032131 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:34.050635 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 18/34] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:34.052043 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4bc42-b977-4b7b-a42f-08e707c84076 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:34.147107 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 17/35] 10.222.0.42 () {60 vars in 1131 bytes} [Fri Aug 26 07:29:33 2022] POST /identity/v3/roles => generated 225 bytes in 533 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:29:34.148485 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c04992-1e08-4567-8865-51f5a8e8ee4f None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:34.180125 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4bc42-b977-4b7b-a42f-08e707c84076 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:34.231665 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d918c-76c0-48de-8b66-f593304c000f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:34.232298 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d918c-76c0-48de-8b66-f593304c000f None admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:34.232582 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d918c-76c0-48de-8b66-f593304c000f None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:34.232858 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d918c-76c0-48de-8b66-f593304c000f None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:34.233549 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d918c-76c0-48de-8b66-f593304c000f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:34.234951 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d918c-76c0-48de-8b66-f593304c000f None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:34.273018 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c04992-1e08-4567-8865-51f5a8e8ee4f None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:34.312864 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a9b00-bb5d-46c1-ae7a-17d1c2daa37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:34.313443 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a9b00-bb5d-46c1-ae7a-17d1c2daa37d None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:34.313728 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a9b00-bb5d-46c1-ae7a-17d1c2daa37d None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:34.314100 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a9b00-bb5d-46c1-ae7a-17d1c2daa37d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:34.315360 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a9b00-bb5d-46c1-ae7a-17d1c2daa37d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:34.317987 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a9b00-bb5d-46c1-ae7a-17d1c2daa37d None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:34.319578 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 18/36] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:29:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:34.320331 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a9b00-bb5d-46c1-ae7a-17d1c2daa37d None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:34.339778 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:34.424001 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a9b00-bb5d-46c1-ae7a-17d1c2daa37d None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:34.432988 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 19/37] 10.222.0.42 () {60 vars in 1131 bytes} [Fri Aug 26 07:29:34 2022] POST /identity/v3/roles => generated 219 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:29:34.434847 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e328055-b4b4-4888-b58f-e779d6f628df None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:34.435175 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e328055-b4b4-4888-b58f-e779d6f628df None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:34.435462 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e328055-b4b4-4888-b58f-e779d6f628df None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:34.436746 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 20/38] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:29:34.437889 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fad166-8267-4e4e-bc2d-97d4436a9c1f None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:34.438248 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fad166-8267-4e4e-bc2d-97d4436a9c1f None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:34.438544 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fad166-8267-4e4e-bc2d-97d4436a9c1f None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:34.439954 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 21/39] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:29:34.441514 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fad166-8267-4e4e-bc2d-97d4436a9c1f None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:34.470278 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b2676-adb7-496d-805a-4d96391d0a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:34.470932 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b2676-adb7-496d-805a-4d96391d0a06 None admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:34.473014 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b2676-adb7-496d-805a-4d96391d0a06 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:34.473014 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b2676-adb7-496d-805a-4d96391d0a06 None admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:34.473014 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b2676-adb7-496d-805a-4d96391d0a06 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:34.474236 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b2676-adb7-496d-805a-4d96391d0a06 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:34.512745 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:34.564648 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fad166-8267-4e4e-bc2d-97d4436a9c1f None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:34.597530 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 19/40] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Aug 26 07:29:34 2022] POST /identity/v3/projects => generated 301 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:29:34.599254 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae06b0a-befb-419d-99d3-212b8e590b68 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:34.599761 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae06b0a-befb-419d-99d3-212b8e590b68 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:34.600310 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae06b0a-befb-419d-99d3-212b8e590b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:34.603402 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b18564-29c3-44cf-9750-7f5607d777f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:34.604488 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b18564-29c3-44cf-9750-7f5607d777f5 None admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:34.604826 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b18564-29c3-44cf-9750-7f5607d777f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:34.605123 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b18564-29c3-44cf-9750-7f5607d777f5 None admin] PATH_INFO: `/v3/domains/default/users/373a698192574b4b8cacbfbcfee3991d/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:34.607717 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b18564-29c3-44cf-9750-7f5607d777f5 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=373a698192574b4b8cacbfbcfee3991d, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:34.609370 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b18564-29c3-44cf-9750-7f5607d777f5 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:34.624203 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-8ae06b0a-befb-419d-99d3-212b8e590b68 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:29:34.625804 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-8ae06b0a-befb-419d-99d3-212b8e590b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:29:34.704864 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:34.710309 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 22/41] 10.222.0.42 () {58 vars in 1361 bytes} [Fri Aug 26 07:29:34 2022] PUT /identity/v3/domains/default/users/373a698192574b4b8cacbfbcfee3991d/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:29:34.711934 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 20/42] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:29:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:29:34.712413 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c9950-0e95-487e-a739-9a1b2667fded None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:34.712907 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c9950-0e95-487e-a739-9a1b2667fded None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:34.713426 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c9950-0e95-487e-a739-9a1b2667fded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:34.743377 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-992c9950-0e95-487e-a739-9a1b2667fded None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:29:34.745495 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-992c9950-0e95-487e-a739-9a1b2667fded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:29:34.839564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 23/43] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:29:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:29:34.996806 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae06b0a-befb-419d-99d3-212b8e590b68 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:35.110153 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae06b0a-befb-419d-99d3-212b8e590b68 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:35.113507 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c9950-0e95-487e-a739-9a1b2667fded None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:35.149903 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c62ad8-18da-488a-b732-74d935019463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:35.150553 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c62ad8-18da-488a-b732-74d935019463 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:35.150840 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c62ad8-18da-488a-b732-74d935019463 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:35.151183 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c62ad8-18da-488a-b732-74d935019463 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:35.152414 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c62ad8-18da-488a-b732-74d935019463 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:35.153955 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c62ad8-18da-488a-b732-74d935019463 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:35.157251 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 21/44] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:29:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:35.162240 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c62ad8-18da-488a-b732-74d935019463 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:35.173444 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:35.234258 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c9950-0e95-487e-a739-9a1b2667fded None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:35.236464 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:35.272465 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb633355-af0f-4e8d-8e3d-278f273dbf17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:35.273089 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb633355-af0f-4e8d-8e3d-278f273dbf17 None admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:35.273374 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb633355-af0f-4e8d-8e3d-278f273dbf17 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:35.273648 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb633355-af0f-4e8d-8e3d-278f273dbf17 None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:35.274332 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb633355-af0f-4e8d-8e3d-278f273dbf17 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:35.274847 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c62ad8-18da-488a-b732-74d935019463 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:35.275765 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb633355-af0f-4e8d-8e3d-278f273dbf17 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:35.310622 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a379c-e07b-43df-8690-7848119ea63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:35.311291 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a379c-e07b-43df-8690-7848119ea63c None admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:35.311571 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a379c-e07b-43df-8690-7848119ea63c None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:35.311845 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a379c-e07b-43df-8690-7848119ea63c None admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:35.312502 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a379c-e07b-43df-8690-7848119ea63c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:35.313955 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a379c-e07b-43df-8690-7848119ea63c None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:35.351979 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 24/45] 10.222.0.42 () {60 vars in 1131 bytes} [Fri Aug 26 07:29:35 2022] POST /identity/v3/roles => generated 223 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 07:29:35.425084 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 22/46] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Aug 26 07:29:35 2022] POST /identity/v3/projects => generated 312 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 07:29:36.723082 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75828f-6479-451a-b287-3081b62bea74 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:36.723668 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75828f-6479-451a-b287-3081b62bea74 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:36.723668 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75828f-6479-451a-b287-3081b62bea74 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:36.725014 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 25/47] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:29:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:29:36.730752 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda43de-0491-47d8-8e5d-4e87fe0983de None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:36.731191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda43de-0491-47d8-8e5d-4e87fe0983de None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:36.731365 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda43de-0491-47d8-8e5d-4e87fe0983de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:36.752507 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-1eda43de-0491-47d8-8e5d-4e87fe0983de None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:29:36.754278 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-1eda43de-0491-47d8-8e5d-4e87fe0983de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:29:36.823003 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 23/48] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:29:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:29:37.095902 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf75828f-6479-451a-b287-3081b62bea74 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:37.198796 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf75828f-6479-451a-b287-3081b62bea74 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:37.201284 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:37.233311 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91443ee2-129d-42f2-8eab-bfd744f0949e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:37.233984 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91443ee2-129d-42f2-8eab-bfd744f0949e None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:37.234268 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91443ee2-129d-42f2-8eab-bfd744f0949e None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:37.234544 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91443ee2-129d-42f2-8eab-bfd744f0949e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:37.245938 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91443ee2-129d-42f2-8eab-bfd744f0949e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:29:37.250870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-91443ee2-129d-42f2-8eab-bfd744f0949e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:29:37.250870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:29:37.250870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:29:37.250870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:29:37.250870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:29:37.250870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:29:37.250870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:29:37.250870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:29:37.250870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:29:37.250870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:29:37.250870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:29:37.250870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:29:37.250870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:29:37.250870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:29:37.250870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:29:37.250870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:29:37.253368 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:29:37.253368 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:29:37.253368 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:29:37.253368 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:29:37.253368 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:29:37.253368 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:29:37.253368 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:29:37.253368 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:29:37.253368 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:29:37.253368 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:29:37.253368 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:29:37.253368 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:29:37.253368 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:29:37.253368 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:29:37.253368 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:29:37.253368 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:29:37.254134 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:29:37.254134 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:29:37.254134 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:29:37.254134 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:29:37.254134 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:29:37.254134 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:29:37.254134 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:29:37.254134 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:29:37.254134 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:29:37.254134 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:29:37.254134 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:29:37.254134 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:29:37.254134 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 26/49] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 26 07:29:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:29:37.258617 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda43de-0491-47d8-8e5d-4e87fe0983de None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:37.309278 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:37.356974 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008dd77-e948-4681-b553-9df063f2c1f9 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:37.357180 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008dd77-e948-4681-b553-9df063f2c1f9 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:37.357450 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008dd77-e948-4681-b553-9df063f2c1f9 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:37.358775 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 27/50] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 07:29:37.360892 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda43de-0491-47d8-8e5d-4e87fe0983de None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:37.364419 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3342e-27d4-4dc0-bb05-e21612e029f0 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:37.364709 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3342e-27d4-4dc0-bb05-e21612e029f0 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:37.364988 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3342e-27d4-4dc0-bb05-e21612e029f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:37.383730 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-42a3342e-27d4-4dc0-bb05-e21612e029f0 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:29:37.384948 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-42a3342e-27d4-4dc0-bb05-e21612e029f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:29:37.396771 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48abf7-a649-4ebb-96d0-b9ca555eacb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:37.397420 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48abf7-a649-4ebb-96d0-b9ca555eacb3 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:37.397751 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48abf7-a649-4ebb-96d0-b9ca555eacb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:37.398027 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48abf7-a649-4ebb-96d0-b9ca555eacb3 None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:37.398698 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d48abf7-a649-4ebb-96d0-b9ca555eacb3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:29:37.399030 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d48abf7-a649-4ebb-96d0-b9ca555eacb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:37.400424 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d48abf7-a649-4ebb-96d0-b9ca555eacb3 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:37.408589 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 24/51] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:29:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:37.414386 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48abf7-a649-4ebb-96d0-b9ca555eacb3 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:37.463104 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 28/52] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:29:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 07:29:37.523167 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48abf7-a649-4ebb-96d0-b9ca555eacb3 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:37.535331 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:37.560454 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2fa1c7-abae-45eb-ade0-c87e2ca2e777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:37.561120 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fa1c7-abae-45eb-ade0-c87e2ca2e777 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:37.561405 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fa1c7-abae-45eb-ade0-c87e2ca2e777 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:37.561679 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fa1c7-abae-45eb-ade0-c87e2ca2e777 None admin] PATH_INFO: `/v3/users/373a698192574b4b8cacbfbcfee3991d` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:37.562842 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2fa1c7-abae-45eb-ade0-c87e2ca2e777 None admin] RBAC: Authorizing `identity:get_user(user_id=373a698192574b4b8cacbfbcfee3991d)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:37.564509 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2fa1c7-abae-45eb-ade0-c87e2ca2e777 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:37.566533 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 25/53] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:29:37 2022] GET /identity/v3/users/373a698192574b4b8cacbfbcfee3991d => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:29:37.572484 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3342e-27d4-4dc0-bb05-e21612e029f0 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:37.677400 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:37.683894 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3342e-27d4-4dc0-bb05-e21612e029f0 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:37.719217 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a8351-4ee3-48b1-8e89-37355915978e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:37.719917 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a8351-4ee3-48b1-8e89-37355915978e None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:37.720151 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a8351-4ee3-48b1-8e89-37355915978e None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:37.720397 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a8351-4ee3-48b1-8e89-37355915978e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:37.721511 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259a8351-4ee3-48b1-8e89-37355915978e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:37.723232 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259a8351-4ee3-48b1-8e89-37355915978e None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:37.724802 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 29/54] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:29:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:37.730562 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2fa1c7-abae-45eb-ade0-c87e2ca2e777 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:37.733999 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a8351-4ee3-48b1-8e89-37355915978e None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:37.843432 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2fa1c7-abae-45eb-ade0-c87e2ca2e777 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:37.881380 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee88be-7679-4044-9c36-a3b925b445ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:37.882005 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee88be-7679-4044-9c36-a3b925b445ac None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:37.882293 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee88be-7679-4044-9c36-a3b925b445ac None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:37.882571 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee88be-7679-4044-9c36-a3b925b445ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:37.883995 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee88be-7679-4044-9c36-a3b925b445ac None admin] RBAC: Adding query filter params (role.id=07ed857b2feb472f9fa9e7fe0b08582b, scope.domain.id=default, user.id=373a698192574b4b8cacbfbcfee3991d) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:29:37.884377 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee88be-7679-4044-9c36-a3b925b445ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:37.885857 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee88be-7679-4044-9c36-a3b925b445ac None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:37.892130 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 26/55] 10.222.0.42 () {56 vars in 1322 bytes} [Fri Aug 26 07:29:37 2022] GET /identity/v3/role_assignments?user.id=373a698192574b4b8cacbfbcfee3991d&scope.domain.id=default&role.id=07ed857b2feb472f9fa9e7fe0b08582b => generated 530 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:37.954074 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a8351-4ee3-48b1-8e89-37355915978e None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:37.991196 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420887d-2999-4b69-85c4-bef763b37f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:37.991850 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420887d-2999-4b69-85c4-bef763b37f00 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:37.992129 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420887d-2999-4b69-85c4-bef763b37f00 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:37.992400 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420887d-2999-4b69-85c4-bef763b37f00 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:37.993995 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420887d-2999-4b69-85c4-bef763b37f00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:37.996811 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420887d-2999-4b69-85c4-bef763b37f00 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:37.998695 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 30/56] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:29:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:29:38.005326 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee88be-7679-4044-9c36-a3b925b445ac None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:38.056643 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:38.119932 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee88be-7679-4044-9c36-a3b925b445ac None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:38.154851 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097aab46-9295-4bad-8924-fbf22a15728c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:38.155496 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097aab46-9295-4bad-8924-fbf22a15728c None admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:38.155778 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097aab46-9295-4bad-8924-fbf22a15728c None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:38.156053 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097aab46-9295-4bad-8924-fbf22a15728c None admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:38.156698 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097aab46-9295-4bad-8924-fbf22a15728c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:38.158133 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097aab46-9295-4bad-8924-fbf22a15728c None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:38.247934 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 27/57] 10.222.0.42 () {60 vars in 1140 bytes} [Fri Aug 26 07:29:38 2022] POST /identity/v3/projects => generated 298 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:29:40.188419 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f95066-612c-41d3-8cfb-96689507be51 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:40.188934 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f95066-612c-41d3-8cfb-96689507be51 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:40.189018 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f95066-612c-41d3-8cfb-96689507be51 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:40.190293 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 31/58] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:29:40.196511 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b63f75-02e5-4672-997f-a092c589c696 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:40.196904 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b63f75-02e5-4672-997f-a092c589c696 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:40.197071 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b63f75-02e5-4672-997f-a092c589c696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:40.215600 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-29b63f75-02e5-4672-997f-a092c589c696 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:29:40.216810 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-29b63f75-02e5-4672-997f-a092c589c696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:29:40.395474 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 28/59] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:29:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:29:40.669925 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f95066-612c-41d3-8cfb-96689507be51 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:40.701449 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:40.779327 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f95066-612c-41d3-8cfb-96689507be51 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:40.813521 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3356d93-ae71-4847-98ae-f365ab376533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:40.814152 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3356d93-ae71-4847-98ae-f365ab376533 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:40.814428 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3356d93-ae71-4847-98ae-f365ab376533 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:40.814700 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3356d93-ae71-4847-98ae-f365ab376533 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:40.815920 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3356d93-ae71-4847-98ae-f365ab376533 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:40.817603 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3356d93-ae71-4847-98ae-f365ab376533 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:40.819166 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 32/60] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:29:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:40.824960 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b63f75-02e5-4672-997f-a092c589c696 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:40.849467 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:40.921459 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b63f75-02e5-4672-997f-a092c589c696 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:40.955410 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f019b1-1351-40b8-8eb8-de8af9d5e335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:40.956602 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f019b1-1351-40b8-8eb8-de8af9d5e335 None admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:40.956887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f019b1-1351-40b8-8eb8-de8af9d5e335 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:40.957159 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f019b1-1351-40b8-8eb8-de8af9d5e335 None admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:40.957997 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f019b1-1351-40b8-8eb8-de8af9d5e335 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:40.959509 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f019b1-1351-40b8-8eb8-de8af9d5e335 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:41.108177 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 29/61] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 26 07:29:40 2022] POST /identity/v3/users => generated 275 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:29:44.290308 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563b334-048b-442a-995d-8b776df0c8a0 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:44.291290 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563b334-048b-442a-995d-8b776df0c8a0 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:44.291737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563b334-048b-442a-995d-8b776df0c8a0 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:44.293221 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 33/62] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:29:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:29:44.298900 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11a3be-0d48-4801-9c8f-6c3036506e7e None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:44.299805 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11a3be-0d48-4801-9c8f-6c3036506e7e None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:44.300249 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11a3be-0d48-4801-9c8f-6c3036506e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:44.323989 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-bb11a3be-0d48-4801-9c8f-6c3036506e7e None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:29:44.325631 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-bb11a3be-0d48-4801-9c8f-6c3036506e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:29:44.419579 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 30/63] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:29:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:29:44.434974 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244bf16a-5024-4b55-acd1-e6523f587a69 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:44.435542 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244bf16a-5024-4b55-acd1-e6523f587a69 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:44.436038 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244bf16a-5024-4b55-acd1-e6523f587a69 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:44.437526 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 34/64] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:29:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:29:44.445928 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52626395-e4ae-4cad-b7da-7ed1664d60dc None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:44.446447 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52626395-e4ae-4cad-b7da-7ed1664d60dc None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:44.446882 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52626395-e4ae-4cad-b7da-7ed1664d60dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:44.470362 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-52626395-e4ae-4cad-b7da-7ed1664d60dc None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:29:44.476035 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-52626395-e4ae-4cad-b7da-7ed1664d60dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:29:44.479737 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:44.505819 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfcdaa-fe8b-45ad-acdf-e0f7a839eac8 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:44.506180 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfcdaa-fe8b-45ad-acdf-e0f7a839eac8 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:44.506382 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfcdaa-fe8b-45ad-acdf-e0f7a839eac8 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:44.507999 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 35/65] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:29:44.516331 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b8931-4583-41ef-a943-61e965453fc4 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:44.516613 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b8931-4583-41ef-a943-61e965453fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:44.516890 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b8931-4583-41ef-a943-61e965453fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:44.551371 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-604b8931-4583-41ef-a943-61e965453fc4 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:29:44.552918 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-604b8931-4583-41ef-a943-61e965453fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:29:44.574112 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 31/66] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:29:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:29:44.658597 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 36/67] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:29:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:29:44.731650 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc61745-4601-456c-92ce-6e47d0ccc3d4 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:44.732360 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc61745-4601-456c-92ce-6e47d0ccc3d4 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:44.732857 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc61745-4601-456c-92ce-6e47d0ccc3d4 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:44.734661 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 32/68] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:29:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 07:29:44.740602 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83af9d-6e70-49fa-8533-803a47c893b8 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:44.741131 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83af9d-6e70-49fa-8533-803a47c893b8 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:44.741612 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83af9d-6e70-49fa-8533-803a47c893b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:44.768671 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-ab83af9d-6e70-49fa-8533-803a47c893b8 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:29:44.769982 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-ab83af9d-6e70-49fa-8533-803a47c893b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:29:44.805950 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:44.809081 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc61745-4601-456c-92ce-6e47d0ccc3d4 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:44.880708 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 37/69] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:29:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:29:44.929855 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc61745-4601-456c-92ce-6e47d0ccc3d4 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:44.941733 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83af9d-6e70-49fa-8533-803a47c893b8 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:44.985715 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158132a2-2bda-4673-b9f6-5ee7fd82f28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:44.986358 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158132a2-2bda-4673-b9f6-5ee7fd82f28a None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:44.986641 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158132a2-2bda-4673-b9f6-5ee7fd82f28a None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:44.986906 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158132a2-2bda-4673-b9f6-5ee7fd82f28a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:44.997800 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:45.002401 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158132a2-2bda-4673-b9f6-5ee7fd82f28a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:29:45.012459 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-158132a2-2bda-4673-b9f6-5ee7fd82f28a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:29:45.012459 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:29:45.012459 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:29:45.012459 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:29:45.012459 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:29:45.012459 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:29:45.012459 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:29:45.012459 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:29:45.012459 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:29:45.012459 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:29:45.012459 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:29:45.012459 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:29:45.012459 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:29:45.012459 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:29:45.012459 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:29:45.012459 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:29:45.013484 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:29:45.013484 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:29:45.013484 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:29:45.013484 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:29:45.013484 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:29:45.013484 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:29:45.013484 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:29:45.013484 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:29:45.013484 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:29:45.013484 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:29:45.013484 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:29:45.013484 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:29:45.013484 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:29:45.013484 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:29:45.013484 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:29:45.013484 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:29:45.014269 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:29:45.014269 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:29:45.014269 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:29:45.014269 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:29:45.014269 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:29:45.014269 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:29:45.014269 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:29:45.014269 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:29:45.014269 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:29:45.014269 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:29:45.014269 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:29:45.014269 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:29:45.014269 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 33/70] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 26 07:29:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 07:29:45.020630 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c92e04-2684-4070-a66c-76f22ffd8d89 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:45.020630 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c92e04-2684-4070-a66c-76f22ffd8d89 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:45.020630 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c92e04-2684-4070-a66c-76f22ffd8d89 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:45.020630 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 34/71] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:29:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:29:45.023544 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831d58a-5e6d-41e9-9600-89911e238319 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:45.024290 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831d58a-5e6d-41e9-9600-89911e238319 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:45.024769 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831d58a-5e6d-41e9-9600-89911e238319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:45.043802 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-6831d58a-5e6d-41e9-9600-89911e238319 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:29:45.045260 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-6831d58a-5e6d-41e9-9600-89911e238319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:29:45.069844 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83af9d-6e70-49fa-8533-803a47c893b8 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:45.108080 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d4c417-1816-464d-92c0-1bea4156d903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:45.109012 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4c417-1816-464d-92c0-1bea4156d903 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:45.109597 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4c417-1816-464d-92c0-1bea4156d903 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:45.110038 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4c417-1816-464d-92c0-1bea4156d903 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:45.122260 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d4c417-1816-464d-92c0-1bea4156d903 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:29:45.123055 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 35/72] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:29:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:29:45.124174 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831d58a-5e6d-41e9-9600-89911e238319 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:45.127307 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-d1d4c417-1816-464d-92c0-1bea4156d903 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 07:29:45.127307 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:29:45.127307 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:29:45.127307 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:29:45.127307 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:29:45.127307 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:29:45.127307 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:29:45.127307 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:29:45.127307 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:29:45.127307 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:29:45.127307 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:29:45.127307 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:29:45.127307 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:29:45.127307 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:29:45.127307 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:29:45.127307 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:29:45.128675 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:29:45.128675 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:29:45.128675 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:29:45.128675 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:29:45.128675 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:29:45.128675 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:29:45.128675 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:29:45.128675 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:29:45.128675 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:29:45.128675 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:29:45.128675 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:29:45.128675 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:29:45.128675 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:29:45.128675 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:29:45.128675 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:29:45.128675 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:29:45.134847 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:29:45.134847 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:29:45.134847 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:29:45.134847 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:29:45.134847 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:29:45.134847 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:29:45.134847 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:29:45.134847 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:29:45.134847 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:29:45.134847 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:29:45.134847 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 07:29:45.134847 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:29:45.134847 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 38/73] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:29:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:29:45.134847 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d4c417-1816-464d-92c0-1bea4156d903 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:45.173252 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:45.244697 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d4c417-1816-464d-92c0-1bea4156d903 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:45.256543 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831d58a-5e6d-41e9-9600-89911e238319 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:45.281600 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252d716-8ffd-4c82-8f03-3fe6e635316c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:45.282240 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252d716-8ffd-4c82-8f03-3fe6e635316c None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:45.282599 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252d716-8ffd-4c82-8f03-3fe6e635316c None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:45.282882 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252d716-8ffd-4c82-8f03-3fe6e635316c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:45.287272 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:45.293722 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db49ea9-9f8a-4742-b549-9a871081b4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:45.294341 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db49ea9-9f8a-4742-b549-9a871081b4aa None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:45.294628 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db49ea9-9f8a-4742-b549-9a871081b4aa None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:45.294905 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db49ea9-9f8a-4742-b549-9a871081b4aa None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:45.295121 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f252d716-8ffd-4c82-8f03-3fe6e635316c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:29:45.295609 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db49ea9-9f8a-4742-b549-9a871081b4aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:29:45.295920 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db49ea9-9f8a-4742-b549-9a871081b4aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:45.297316 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db49ea9-9f8a-4742-b549-9a871081b4aa None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:45.300545 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-f252d716-8ffd-4c82-8f03-3fe6e635316c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 07:29:45.300545 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:29:45.300545 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:29:45.300545 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:29:45.300545 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:29:45.300545 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:29:45.300545 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:29:45.300545 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:29:45.300545 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:29:45.300545 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:29:45.300545 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:29:45.300545 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:29:45.300545 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:29:45.300545 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:29:45.300545 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:29:45.300545 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:29:45.308119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:29:45.308119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:29:45.308119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:29:45.308119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:29:45.308119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:29:45.308119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:29:45.308119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:29:45.308119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:29:45.308119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:29:45.308119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:29:45.308119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:29:45.308119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:29:45.308119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:29:45.308119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:29:45.308119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:29:45.308119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:29:45.308879 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:29:45.308879 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:29:45.308879 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:29:45.308879 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:29:45.308879 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:29:45.308879 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:29:45.308879 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:29:45.308879 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:29:45.308879 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:29:45.308879 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:29:45.308879 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 07:29:45.308879 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:29:45.308879 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 39/74] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 26 07:29:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:29:45.308879 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252d716-8ffd-4c82-8f03-3fe6e635316c None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:45.317796 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 36/75] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:29:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:45.317796 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db49ea9-9f8a-4742-b549-9a871081b4aa None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:45.393962 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:45.415144 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252d716-8ffd-4c82-8f03-3fe6e635316c None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:45.422592 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db49ea9-9f8a-4742-b549-9a871081b4aa None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:45.450067 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4aa153-2547-4f5b-bd74-5e70b9282109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:45.450686 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4aa153-2547-4f5b-bd74-5e70b9282109 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:45.450969 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4aa153-2547-4f5b-bd74-5e70b9282109 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:45.451279 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4aa153-2547-4f5b-bd74-5e70b9282109 None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:45.451950 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4aa153-2547-4f5b-bd74-5e70b9282109 None admin] RBAC: Adding query filter params (name=member) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:29:45.452259 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4aa153-2547-4f5b-bd74-5e70b9282109 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:45.453670 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4aa153-2547-4f5b-bd74-5e70b9282109 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:45.457139 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903b05e-d491-4778-9f84-c77754cd5008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:45.457783 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903b05e-d491-4778-9f84-c77754cd5008 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:45.458070 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903b05e-d491-4778-9f84-c77754cd5008 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:45.458349 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903b05e-d491-4778-9f84-c77754cd5008 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:45.466136 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 40/76] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 26 07:29:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:45.466966 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4aa153-2547-4f5b-bd74-5e70b9282109 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:45.468793 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5903b05e-d491-4778-9f84-c77754cd5008 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:29:45.474400 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-5903b05e-d491-4778-9f84-c77754cd5008 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 07:29:45.474400 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:29:45.474400 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:29:45.474400 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:29:45.474400 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:29:45.474400 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:29:45.474400 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:29:45.474400 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:29:45.474400 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:29:45.474400 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:29:45.474400 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:29:45.474400 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:29:45.474400 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:29:45.474400 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:29:45.474400 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:29:45.474400 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:29:45.475497 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:29:45.475497 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:29:45.475497 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:29:45.475497 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:29:45.475497 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:29:45.475497 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:29:45.475497 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:29:45.475497 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:29:45.475497 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:29:45.475497 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:29:45.475497 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:29:45.475497 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:29:45.475497 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:29:45.475497 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:29:45.475497 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:29:45.475497 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:29:45.479938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:29:45.479938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:29:45.479938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:29:45.479938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:29:45.479938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:29:45.479938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:29:45.479938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:29:45.479938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:29:45.479938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:29:45.479938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:29:45.479938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 07:29:45.479938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:29:45.479938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 37/77] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:29:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:29:45.479938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903b05e-d491-4778-9f84-c77754cd5008 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:45.544544 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:45.576692 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4aa153-2547-4f5b-bd74-5e70b9282109 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:45.592974 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903b05e-d491-4778-9f84-c77754cd5008 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:45.611928 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef28437-b4f3-4b2e-a6d2-19b084768832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:45.612860 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef28437-b4f3-4b2e-a6d2-19b084768832 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:45.613154 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef28437-b4f3-4b2e-a6d2-19b084768832 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:45.613430 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef28437-b4f3-4b2e-a6d2-19b084768832 None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:45.614108 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef28437-b4f3-4b2e-a6d2-19b084768832 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:29:45.614420 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef28437-b4f3-4b2e-a6d2-19b084768832 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:45.615830 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef28437-b4f3-4b2e-a6d2-19b084768832 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:45.623713 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 41/78] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:29:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:45.624525 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef28437-b4f3-4b2e-a6d2-19b084768832 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:45.627046 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:45.630704 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33de70-a724-49c1-ae12-3b9817e6b490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:45.631380 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33de70-a724-49c1-ae12-3b9817e6b490 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:45.631661 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33de70-a724-49c1-ae12-3b9817e6b490 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:45.631934 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33de70-a724-49c1-ae12-3b9817e6b490 None admin] PATH_INFO: `/v3/users/373a698192574b4b8cacbfbcfee3991d` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:45.633078 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac33de70-a724-49c1-ae12-3b9817e6b490 None admin] RBAC: Authorizing `identity:get_user(user_id=373a698192574b4b8cacbfbcfee3991d)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:45.634608 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac33de70-a724-49c1-ae12-3b9817e6b490 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:45.636235 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 38/79] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:29:45 2022] GET /identity/v3/users/373a698192574b4b8cacbfbcfee3991d => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:45.640927 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33de70-a724-49c1-ae12-3b9817e6b490 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:45.745587 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef28437-b4f3-4b2e-a6d2-19b084768832 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:45.745794 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33de70-a724-49c1-ae12-3b9817e6b490 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:45.769845 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:45.784263 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22694689-743f-4eeb-8c38-f6cc8bc2d26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:45.784581 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e465b-84a4-4a7c-93c9-638a2319d4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:45.784993 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22694689-743f-4eeb-8c38-f6cc8bc2d26b None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:45.785223 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e465b-84a4-4a7c-93c9-638a2319d4d0 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:45.785319 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22694689-743f-4eeb-8c38-f6cc8bc2d26b None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:45.785507 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e465b-84a4-4a7c-93c9-638a2319d4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:45.785611 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22694689-743f-4eeb-8c38-f6cc8bc2d26b None admin] PATH_INFO: `/v3/users/34b57a5a2a6d428493fc9e9f0cc5a6ac` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:45.785782 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e465b-84a4-4a7c-93c9-638a2319d4d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:45.786918 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e465b-84a4-4a7c-93c9-638a2319d4d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:45.788410 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e465b-84a4-4a7c-93c9-638a2319d4d0 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:45.790006 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 42/80] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:29:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:45.791904 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e465b-84a4-4a7c-93c9-638a2319d4d0 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:45.804190 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22694689-743f-4eeb-8c38-f6cc8bc2d26b None admin] RBAC: Authorizing `identity:get_user(user_id=34b57a5a2a6d428493fc9e9f0cc5a6ac)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:45.807465 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22694689-743f-4eeb-8c38-f6cc8bc2d26b None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:45.807465 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 39/81] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:29:45 2022] GET /identity/v3/users/34b57a5a2a6d428493fc9e9f0cc5a6ac => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:45.808168 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22694689-743f-4eeb-8c38-f6cc8bc2d26b None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:45.872605 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:45.906718 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e465b-84a4-4a7c-93c9-638a2319d4d0 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:45.918340 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22694689-743f-4eeb-8c38-f6cc8bc2d26b None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:45.940821 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15680886-7e67-4876-b56e-1278b45f3acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:45.941573 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15680886-7e67-4876-b56e-1278b45f3acd None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:45.941868 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15680886-7e67-4876-b56e-1278b45f3acd None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:45.942143 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15680886-7e67-4876-b56e-1278b45f3acd None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:45.943100 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15680886-7e67-4876-b56e-1278b45f3acd None admin] RBAC: Adding query filter params (name=member) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:29:45.943416 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15680886-7e67-4876-b56e-1278b45f3acd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:45.944809 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15680886-7e67-4876-b56e-1278b45f3acd None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:45.952795 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 43/82] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 26 07:29:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:45.953595 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15680886-7e67-4876-b56e-1278b45f3acd None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:45.957774 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e631c74-25fb-4011-8ddf-b2b35ab117b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:45.958420 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e631c74-25fb-4011-8ddf-b2b35ab117b1 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:45.958702 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e631c74-25fb-4011-8ddf-b2b35ab117b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:45.958978 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e631c74-25fb-4011-8ddf-b2b35ab117b1 None admin] PATH_INFO: `/v3/users/34b57a5a2a6d428493fc9e9f0cc5a6ac` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:45.960179 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e631c74-25fb-4011-8ddf-b2b35ab117b1 None admin] RBAC: Authorizing `identity:get_user(user_id=34b57a5a2a6d428493fc9e9f0cc5a6ac)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:45.961696 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e631c74-25fb-4011-8ddf-b2b35ab117b1 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:45.963294 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 40/83] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:29:45 2022] GET /identity/v3/users/34b57a5a2a6d428493fc9e9f0cc5a6ac => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:45.964029 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e631c74-25fb-4011-8ddf-b2b35ab117b1 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:46.010759 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:46.063834 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e631c74-25fb-4011-8ddf-b2b35ab117b1 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:46.067446 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15680886-7e67-4876-b56e-1278b45f3acd None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:46.099904 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:46.102553 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ee8eb-571e-42be-b5a8-53ebe02bcd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:46.103204 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ee8eb-571e-42be-b5a8-53ebe02bcd62 None admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:46.103487 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ee8eb-571e-42be-b5a8-53ebe02bcd62 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:46.103762 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ee8eb-571e-42be-b5a8-53ebe02bcd62 None admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:46.104424 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ee8eb-571e-42be-b5a8-53ebe02bcd62 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:46.104840 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d89bd-a289-4527-b5ef-fdaea90eadf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:46.105473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d89bd-a289-4527-b5ef-fdaea90eadf3 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:46.105750 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d89bd-a289-4527-b5ef-fdaea90eadf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:46.105907 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ee8eb-571e-42be-b5a8-53ebe02bcd62 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:46.106057 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d89bd-a289-4527-b5ef-fdaea90eadf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:46.176584 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d89bd-a289-4527-b5ef-fdaea90eadf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:46.178075 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d89bd-a289-4527-b5ef-fdaea90eadf3 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:46.188416 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 41/84] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 26 07:29:45 2022] POST /identity/v3/users => generated 289 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:29:46.190365 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ee8eb-571e-42be-b5a8-53ebe02bcd62 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:46.301706 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 44/85] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:29:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 07:29:46.301706 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d89bd-a289-4527-b5ef-fdaea90eadf3 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:46.336423 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:46.343959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ee8eb-571e-42be-b5a8-53ebe02bcd62 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:46.351120 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:46.384489 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d1776-ac3e-4dfb-a2e1-f88611f6360e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:46.385327 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d1776-ac3e-4dfb-a2e1-f88611f6360e None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:46.385607 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d1776-ac3e-4dfb-a2e1-f88611f6360e None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:46.385708 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d1776-ac3e-4dfb-a2e1-f88611f6360e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:46.420257 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d89bd-a289-4527-b5ef-fdaea90eadf3 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:46.472763 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cc418-2265-4761-8588-94485b3ba1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:46.473423 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cc418-2265-4761-8588-94485b3ba1b0 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:46.473824 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cc418-2265-4761-8588-94485b3ba1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:46.474104 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cc418-2265-4761-8588-94485b3ba1b0 None admin] PATH_INFO: `/v3/users/34b57a5a2a6d428493fc9e9f0cc5a6ac` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:46.478424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cc418-2265-4761-8588-94485b3ba1b0 None admin] RBAC: Authorizing `identity:get_user(user_id=34b57a5a2a6d428493fc9e9f0cc5a6ac)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:46.479918 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cc418-2265-4761-8588-94485b3ba1b0 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:46.481560 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 45/86] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:29:46 2022] GET /identity/v3/users/34b57a5a2a6d428493fc9e9f0cc5a6ac => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:46.482334 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cc418-2265-4761-8588-94485b3ba1b0 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:46.486481 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d1776-ac3e-4dfb-a2e1-f88611f6360e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:46.488513 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d1776-ac3e-4dfb-a2e1-f88611f6360e None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:46.623298 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:46.625958 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 42/87] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:29:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 07:29:46.626276 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cc418-2265-4761-8588-94485b3ba1b0 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:46.627301 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d1776-ac3e-4dfb-a2e1-f88611f6360e None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:46.632001 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:46.663548 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546f6f3-ac71-41c8-83e3-d3fcd69c454f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:46.664168 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546f6f3-ac71-41c8-83e3-d3fcd69c454f None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:46.664448 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546f6f3-ac71-41c8-83e3-d3fcd69c454f None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:46.664724 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546f6f3-ac71-41c8-83e3-d3fcd69c454f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:46.755951 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9546f6f3-ac71-41c8-83e3-d3fcd69c454f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:46.757451 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9546f6f3-ac71-41c8-83e3-d3fcd69c454f None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:46.757585 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d1776-ac3e-4dfb-a2e1-f88611f6360e None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:46.801761 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30cd8f6-d008-40ab-b715-6d2a80467368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:46.802408 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30cd8f6-d008-40ab-b715-6d2a80467368 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:46.802684 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30cd8f6-d008-40ab-b715-6d2a80467368 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:46.802957 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30cd8f6-d008-40ab-b715-6d2a80467368 None admin] PATH_INFO: `/v3/projects/3729de3353c34b84aa5d098e5bee6d98` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:46.804163 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30cd8f6-d008-40ab-b715-6d2a80467368 None admin] RBAC: Authorizing `identity:get_project(project_id=3729de3353c34b84aa5d098e5bee6d98)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:46.805631 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30cd8f6-d008-40ab-b715-6d2a80467368 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:46.807608 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 43/88] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:29:46 2022] GET /identity/v3/projects/3729de3353c34b84aa5d098e5bee6d98 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:46.808400 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30cd8f6-d008-40ab-b715-6d2a80467368 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:46.889435 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:46.900489 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:46.909010 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 46/89] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:29:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 07:29:46.910571 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546f6f3-ac71-41c8-83e3-d3fcd69c454f None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:46.933253 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30cd8f6-d008-40ab-b715-6d2a80467368 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:46.982831 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ec54c-866a-43be-9243-3cfc6599a7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:46.983770 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ec54c-866a-43be-9243-3cfc6599a7f6 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:46.984205 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ec54c-866a-43be-9243-3cfc6599a7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:46.984642 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ec54c-866a-43be-9243-3cfc6599a7f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:47.043442 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546f6f3-ac71-41c8-83e3-d3fcd69c454f None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:47.083495 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21811389-9f06-4d33-9fb0-8be1a43f83e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:47.084190 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21811389-9f06-4d33-9fb0-8be1a43f83e5 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:47.084476 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21811389-9f06-4d33-9fb0-8be1a43f83e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:47.084751 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21811389-9f06-4d33-9fb0-8be1a43f83e5 None admin] PATH_INFO: `/v3/projects/3729de3353c34b84aa5d098e5bee6d98` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:47.086008 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21811389-9f06-4d33-9fb0-8be1a43f83e5 None admin] RBAC: Authorizing `identity:get_project(project_id=3729de3353c34b84aa5d098e5bee6d98)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:47.087803 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21811389-9f06-4d33-9fb0-8be1a43f83e5 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:47.089496 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 47/90] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:29:46 2022] GET /identity/v3/projects/3729de3353c34b84aa5d098e5bee6d98 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:47.090115 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21811389-9f06-4d33-9fb0-8be1a43f83e5 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:47.090446 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61ec54c-866a-43be-9243-3cfc6599a7f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:47.092113 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61ec54c-866a-43be-9243-3cfc6599a7f6 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:47.171155 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:47.186340 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:47.211333 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 44/91] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:29:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 07:29:47.212424 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ec54c-866a-43be-9243-3cfc6599a7f6 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:47.234200 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21811389-9f06-4d33-9fb0-8be1a43f83e5 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:47.277193 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946a681-aae7-4bfa-9e65-0deb7a8409a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:47.278094 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946a681-aae7-4bfa-9e65-0deb7a8409a2 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:47.278480 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946a681-aae7-4bfa-9e65-0deb7a8409a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:47.278854 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946a681-aae7-4bfa-9e65-0deb7a8409a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:47.279823 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c946a681-aae7-4bfa-9e65-0deb7a8409a2 None admin] RBAC: Adding query filter params (role.id=07ed857b2feb472f9fa9e7fe0b08582b, scope.project.id=3729de3353c34b84aa5d098e5bee6d98, user.id=373a698192574b4b8cacbfbcfee3991d) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:29:47.280243 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c946a681-aae7-4bfa-9e65-0deb7a8409a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:47.281883 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c946a681-aae7-4bfa-9e65-0deb7a8409a2 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:47.291091 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 48/92] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:29:47 2022] GET /identity/v3/role_assignments?user.id=373a698192574b4b8cacbfbcfee3991d&scope.project.id=3729de3353c34b84aa5d098e5bee6d98&role.id=07ed857b2feb472f9fa9e7fe0b08582b => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:47.300638 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946a681-aae7-4bfa-9e65-0deb7a8409a2 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:47.354380 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ec54c-866a-43be-9243-3cfc6599a7f6 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:47.443150 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43db172-f4dc-4d4d-ba1c-13968cf78ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:47.443921 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43db172-f4dc-4d4d-ba1c-13968cf78ded None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:47.444305 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43db172-f4dc-4d4d-ba1c-13968cf78ded None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:47.444682 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43db172-f4dc-4d4d-ba1c-13968cf78ded None admin] PATH_INFO: `/v3/projects/3729de3353c34b84aa5d098e5bee6d98` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:47.447800 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43db172-f4dc-4d4d-ba1c-13968cf78ded None admin] RBAC: Authorizing `identity:get_project(project_id=3729de3353c34b84aa5d098e5bee6d98)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:47.449315 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43db172-f4dc-4d4d-ba1c-13968cf78ded None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:47.451076 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 45/93] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:29:47 2022] GET /identity/v3/projects/3729de3353c34b84aa5d098e5bee6d98 => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:47.451870 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43db172-f4dc-4d4d-ba1c-13968cf78ded None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:47.460357 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946a681-aae7-4bfa-9e65-0deb7a8409a2 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:47.541207 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:47.552778 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f4a7f-9c72-4a11-98b7-483cf9cbd518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:47.553867 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f4a7f-9c72-4a11-98b7-483cf9cbd518 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:47.554326 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f4a7f-9c72-4a11-98b7-483cf9cbd518 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:47.554771 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f4a7f-9c72-4a11-98b7-483cf9cbd518 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:47.556248 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:47.557406 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f4a7f-9c72-4a11-98b7-483cf9cbd518 None admin] RBAC: Adding query filter params (role.id=854d2a8e89d94d8685ff7d5dc70494b5, scope.project.id=3729de3353c34b84aa5d098e5bee6d98, user.id=34b57a5a2a6d428493fc9e9f0cc5a6ac) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:29:47.557947 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f4a7f-9c72-4a11-98b7-483cf9cbd518 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:47.560803 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f4a7f-9c72-4a11-98b7-483cf9cbd518 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:47.568134 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 49/94] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:29:47 2022] GET /identity/v3/role_assignments?user.id=34b57a5a2a6d428493fc9e9f0cc5a6ac&scope.project.id=3729de3353c34b84aa5d098e5bee6d98&role.id=854d2a8e89d94d8685ff7d5dc70494b5 => generated 259 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:47.569335 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f4a7f-9c72-4a11-98b7-483cf9cbd518 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:47.655468 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43db172-f4dc-4d4d-ba1c-13968cf78ded None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:47.696987 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f4a7f-9c72-4a11-98b7-483cf9cbd518 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:47.725927 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40bd6a0-a136-40f1-a6fa-ee59ab75541d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:47.726693 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40bd6a0-a136-40f1-a6fa-ee59ab75541d None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:47.726995 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40bd6a0-a136-40f1-a6fa-ee59ab75541d None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:47.727281 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40bd6a0-a136-40f1-a6fa-ee59ab75541d None admin] PATH_INFO: `/v3/projects/4f6db56f6d93496b8f7219b7bebf21aa` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:47.730647 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40bd6a0-a136-40f1-a6fa-ee59ab75541d None admin] RBAC: Authorizing `identity:get_project(project_id=4f6db56f6d93496b8f7219b7bebf21aa)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:47.732314 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40bd6a0-a136-40f1-a6fa-ee59ab75541d None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:47.734567 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 46/95] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:29:47 2022] GET /identity/v3/projects/4f6db56f6d93496b8f7219b7bebf21aa => generated 312 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:47.741644 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40bd6a0-a136-40f1-a6fa-ee59ab75541d None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:47.743407 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c75ed8-ebd6-406a-afad-dcc635835935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:47.744603 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c75ed8-ebd6-406a-afad-dcc635835935 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:47.745223 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c75ed8-ebd6-406a-afad-dcc635835935 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:47.745844 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c75ed8-ebd6-406a-afad-dcc635835935 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:47.747096 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c75ed8-ebd6-406a-afad-dcc635835935 None admin] RBAC: Adding query filter params (role.id=865b733dc94e43589d2385826a23e137, scope.project.id=3729de3353c34b84aa5d098e5bee6d98, user.id=34b57a5a2a6d428493fc9e9f0cc5a6ac) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:29:47.747666 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c75ed8-ebd6-406a-afad-dcc635835935 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:47.749409 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c75ed8-ebd6-406a-afad-dcc635835935 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:47.757034 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 50/96] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:29:47 2022] GET /identity/v3/role_assignments?user.id=34b57a5a2a6d428493fc9e9f0cc5a6ac&scope.project.id=3729de3353c34b84aa5d098e5bee6d98&role.id=865b733dc94e43589d2385826a23e137 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:47.933514 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40bd6a0-a136-40f1-a6fa-ee59ab75541d None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:47.944954 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:47.987774 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19469d76-b312-4f1d-9853-14c73ded0ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:47.989014 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19469d76-b312-4f1d-9853-14c73ded0ace None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:47.989305 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19469d76-b312-4f1d-9853-14c73ded0ace None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:47.989587 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19469d76-b312-4f1d-9853-14c73ded0ace None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:47.990346 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19469d76-b312-4f1d-9853-14c73ded0ace None admin] RBAC: Adding query filter params (role.id=854d2a8e89d94d8685ff7d5dc70494b5, scope.project.id=4f6db56f6d93496b8f7219b7bebf21aa, user.id=34b57a5a2a6d428493fc9e9f0cc5a6ac) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:29:47.990663 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19469d76-b312-4f1d-9853-14c73ded0ace None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:47.992184 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19469d76-b312-4f1d-9853-14c73ded0ace None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:47.998681 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 47/97] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:29:47 2022] GET /identity/v3/role_assignments?user.id=34b57a5a2a6d428493fc9e9f0cc5a6ac&scope.project.id=4f6db56f6d93496b8f7219b7bebf21aa&role.id=854d2a8e89d94d8685ff7d5dc70494b5 => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:29:48.684829 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f7a2c-ef3f-4590-9104-a2eb2553300e None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:48.685926 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f7a2c-ef3f-4590-9104-a2eb2553300e None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:48.686529 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f7a2c-ef3f-4590-9104-a2eb2553300e None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:48.688725 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 51/98] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:29:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:29:48.696445 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2d4b3-1cef-40dc-8d44-83e114757556 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:48.697336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2d4b3-1cef-40dc-8d44-83e114757556 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:48.697821 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2d4b3-1cef-40dc-8d44-83e114757556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:48.736195 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-aeb2d4b3-1cef-40dc-8d44-83e114757556 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:29:48.738593 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-aeb2d4b3-1cef-40dc-8d44-83e114757556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:29:48.844435 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 48/99] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:29:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 07:29:49.104624 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44220ceb-8e04-42d9-bbb9-0c8be77b991c None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:49.104955 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44220ceb-8e04-42d9-bbb9-0c8be77b991c None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:49.105145 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44220ceb-8e04-42d9-bbb9-0c8be77b991c None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:49.106648 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 52/100] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 07:29:49.112916 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbb086-05a5-4625-8985-e1492436ae18 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:49.113270 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbb086-05a5-4625-8985-e1492436ae18 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:49.113547 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbb086-05a5-4625-8985-e1492436ae18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:49.139019 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-c2dbb086-05a5-4625-8985-e1492436ae18 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:29:49.140323 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-c2dbb086-05a5-4625-8985-e1492436ae18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:29:49.355178 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 49/101] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:29:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:29:49.444535 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44220ceb-8e04-42d9-bbb9-0c8be77b991c None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:49.532570 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:49.592707 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44220ceb-8e04-42d9-bbb9-0c8be77b991c None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:49.642868 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58677a81-9622-4f03-8581-f67d55515c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:49.645118 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58677a81-9622-4f03-8581-f67d55515c6c None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:49.645561 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58677a81-9622-4f03-8581-f67d55515c6c None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:49.645985 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58677a81-9622-4f03-8581-f67d55515c6c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:49.667980 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58677a81-9622-4f03-8581-f67d55515c6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:29:49.671652 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbb086-05a5-4625-8985-e1492436ae18 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:49.673808 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-58677a81-9622-4f03-8581-f67d55515c6c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 07:29:49.673808 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:29:49.673808 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:29:49.673808 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:29:49.673808 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:29:49.673808 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:29:49.673808 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:29:49.673808 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:29:49.673808 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:29:49.673808 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:29:49.673808 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:29:49.673808 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:29:49.673808 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:29:49.673808 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:29:49.673808 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:29:49.673808 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:29:49.675687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:29:49.675687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:29:49.675687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:29:49.675687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:29:49.675687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:29:49.675687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:29:49.675687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:29:49.675687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:29:49.675687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:29:49.675687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:29:49.675687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:29:49.675687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:29:49.675687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:29:49.675687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:29:49.675687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:29:49.675687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:29:49.676674 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:29:49.676674 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:29:49.676674 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:29:49.676674 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:29:49.676674 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:29:49.676674 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:29:49.676674 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:29:49.676674 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:29:49.676674 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:29:49.676674 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:29:49.676674 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 07:29:49.676674 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:29:49.679592 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 53/102] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:29:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:29:49.685161 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58677a81-9622-4f03-8581-f67d55515c6c None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:49.752330 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:49.922790 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbb086-05a5-4625-8985-e1492436ae18 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:49.968224 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58677a81-9622-4f03-8581-f67d55515c6c None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:50.001425 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e7131-3d8a-4a99-a306-d05dc2088894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:50.002072 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e7131-3d8a-4a99-a306-d05dc2088894 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:50.002354 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e7131-3d8a-4a99-a306-d05dc2088894 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:50.003275 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e7131-3d8a-4a99-a306-d05dc2088894 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:50.004689 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:50.006425 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e7131-3d8a-4a99-a306-d05dc2088894 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:50.008119 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e7131-3d8a-4a99-a306-d05dc2088894 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:50.010306 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 50/103] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:29:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:50.018812 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e7131-3d8a-4a99-a306-d05dc2088894 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:50.045121 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e02cd7-5dda-46cf-9261-e4efc153461f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:50.045751 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e02cd7-5dda-46cf-9261-e4efc153461f None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:50.046027 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e02cd7-5dda-46cf-9261-e4efc153461f None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:50.046298 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e02cd7-5dda-46cf-9261-e4efc153461f None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:50.046976 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e02cd7-5dda-46cf-9261-e4efc153461f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:29:50.047322 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e02cd7-5dda-46cf-9261-e4efc153461f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:50.048949 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e02cd7-5dda-46cf-9261-e4efc153461f None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:50.066477 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 54/104] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 26 07:29:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:50.075689 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e02cd7-5dda-46cf-9261-e4efc153461f None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:50.220245 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:50.224460 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e7131-3d8a-4a99-a306-d05dc2088894 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:50.293348 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf66d4-2198-4317-bb3f-6857f615055b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:50.293977 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf66d4-2198-4317-bb3f-6857f615055b None admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:50.294261 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf66d4-2198-4317-bb3f-6857f615055b None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:50.294538 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf66d4-2198-4317-bb3f-6857f615055b None admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:50.295424 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf66d4-2198-4317-bb3f-6857f615055b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:50.296894 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf66d4-2198-4317-bb3f-6857f615055b None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:50.301710 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e02cd7-5dda-46cf-9261-e4efc153461f None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:50.348632 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d731cf-1586-4c9f-9f2e-ff848a405171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:50.349615 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d731cf-1586-4c9f-9f2e-ff848a405171 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:50.350091 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d731cf-1586-4c9f-9f2e-ff848a405171 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:50.350574 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d731cf-1586-4c9f-9f2e-ff848a405171 None admin] PATH_INFO: `/v3/users/76262d4699b9419eb503317db57b7f4c` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:50.365858 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d731cf-1586-4c9f-9f2e-ff848a405171 None admin] RBAC: Authorizing `identity:get_user(user_id=76262d4699b9419eb503317db57b7f4c)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:50.367703 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d731cf-1586-4c9f-9f2e-ff848a405171 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:50.369564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 55/105] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:29:50 2022] GET /identity/v3/users/76262d4699b9419eb503317db57b7f4c => generated 289 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:29:50.370938 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc05c1-5f94-4f6e-8747-b3ee39901c05 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:50.371520 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc05c1-5f94-4f6e-8747-b3ee39901c05 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:50.372006 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc05c1-5f94-4f6e-8747-b3ee39901c05 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:50.373394 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 56/106] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:29:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:29:50.388160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba8cf6-5440-4b09-a422-4f6967bc6308 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:50.388719 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 51/107] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Aug 26 07:29:50 2022] POST /identity/v3/projects => generated 302 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:29:50.389267 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba8cf6-5440-4b09-a422-4f6967bc6308 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:50.389749 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba8cf6-5440-4b09-a422-4f6967bc6308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:50.392557 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf66d4-2198-4317-bb3f-6857f615055b None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:50.411061 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-b5ba8cf6-5440-4b09-a422-4f6967bc6308 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:29:50.412811 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-b5ba8cf6-5440-4b09-a422-4f6967bc6308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:29:50.455259 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:50.500837 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 57/108] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:29:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 07:29:50.569495 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf66d4-2198-4317-bb3f-6857f615055b None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:50.625557 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20369b8-a8f3-4e34-a105-d028dc744f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:50.626556 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20369b8-a8f3-4e34-a105-d028dc744f65 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:50.627192 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20369b8-a8f3-4e34-a105-d028dc744f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:50.628269 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20369b8-a8f3-4e34-a105-d028dc744f65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:50.649687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06c9db-2ae5-474e-b6b7-2a0783c7851a None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:50.649991 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06c9db-2ae5-474e-b6b7-2a0783c7851a None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:50.650245 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06c9db-2ae5-474e-b6b7-2a0783c7851a None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:50.651858 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 58/109] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:29:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 07:29:50.660507 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:50.663888 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73fdd0-1e76-45dc-a020-969185de0fac None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:50.664194 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73fdd0-1e76-45dc-a020-969185de0fac None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:50.664469 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73fdd0-1e76-45dc-a020-969185de0fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:50.687283 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-df73fdd0-1e76-45dc-a020-969185de0fac None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:29:50.690382 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-df73fdd0-1e76-45dc-a020-969185de0fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:29:50.755893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20369b8-a8f3-4e34-a105-d028dc744f65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:50.757611 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20369b8-a8f3-4e34-a105-d028dc744f65 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:50.775731 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 59/110] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:29:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 07:29:50.882402 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 52/111] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:29:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 07:29:50.888392 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73fdd0-1e76-45dc-a020-969185de0fac None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:50.905690 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20369b8-a8f3-4e34-a105-d028dc744f65 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:50.975184 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:51.053710 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73fdd0-1e76-45dc-a020-969185de0fac None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:51.057871 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:51.109075 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8b276-1de2-48f8-93c6-880c383ef43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:51.110030 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8b276-1de2-48f8-93c6-880c383ef43a None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:51.110469 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8b276-1de2-48f8-93c6-880c383ef43a None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:51.110898 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8b276-1de2-48f8-93c6-880c383ef43a None admin] PATH_INFO: `/v3/projects/3729de3353c34b84aa5d098e5bee6d98` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:51.113342 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b8b276-1de2-48f8-93c6-880c383ef43a None admin] RBAC: Authorizing `identity:get_project(project_id=3729de3353c34b84aa5d098e5bee6d98)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:51.115898 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b8b276-1de2-48f8-93c6-880c383ef43a None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:51.122843 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 60/112] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:29:50 2022] GET /identity/v3/projects/3729de3353c34b84aa5d098e5bee6d98 => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:51.125881 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bfceb-d964-4332-bd51-aef90c7f381f None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:51.126317 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bfceb-d964-4332-bd51-aef90c7f381f None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:51.126737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bfceb-d964-4332-bd51-aef90c7f381f None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:51.129342 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 61/113] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:29:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 07:29:51.131038 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20369b8-a8f3-4e34-a105-d028dc744f65 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:51.134644 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8bfceb-d964-4332-bd51-aef90c7f381f None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:51.185667 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e89a3-1690-42cc-bce7-76f84c37acfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:51.186434 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e89a3-1690-42cc-bce7-76f84c37acfc None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:51.186749 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e89a3-1690-42cc-bce7-76f84c37acfc None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:51.187049 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e89a3-1690-42cc-bce7-76f84c37acfc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:51.202551 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e89a3-1690-42cc-bce7-76f84c37acfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:29:51.210295 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-b15e89a3-1690-42cc-bce7-76f84c37acfc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:29:51.210295 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:29:51.210295 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:29:51.210295 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:29:51.210295 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:29:51.210295 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:29:51.210295 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:29:51.210295 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:29:51.210295 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:29:51.210295 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:29:51.210295 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:29:51.210295 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:29:51.210295 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:29:51.210295 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:29:51.210295 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:29:51.210295 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:29:51.219522 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:29:51.219522 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:29:51.219522 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:29:51.219522 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:29:51.219522 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:29:51.219522 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:29:51.219522 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:29:51.219522 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:29:51.219522 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:29:51.219522 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:29:51.219522 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:29:51.219522 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:29:51.219522 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:29:51.219522 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:29:51.219522 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:29:51.219522 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:29:51.220373 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:29:51.220373 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:29:51.220373 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:29:51.220373 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:29:51.220373 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:29:51.220373 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:29:51.220373 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:29:51.220373 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:29:51.220373 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:29:51.220373 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:29:51.220373 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:29:51.220373 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:29:51.220373 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 53/114] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 26 07:29:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 07:29:51.220373 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f154150-087e-44e8-9edc-73b6ba262ac0 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:51.221073 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f154150-087e-44e8-9edc-73b6ba262ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:51.221073 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f154150-087e-44e8-9edc-73b6ba262ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:51.246770 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-0f154150-087e-44e8-9edc-73b6ba262ac0 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:29:51.249703 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-0f154150-087e-44e8-9edc-73b6ba262ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:29:51.275671 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8bfceb-d964-4332-bd51-aef90c7f381f None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:51.316527 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aca904-6d09-466b-b157-9fb77ad99c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:51.316902 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aca904-6d09-466b-b157-9fb77ad99c47 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:51.317187 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aca904-6d09-466b-b157-9fb77ad99c47 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:51.317784 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aca904-6d09-466b-b157-9fb77ad99c47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:51.318549 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aca904-6d09-466b-b157-9fb77ad99c47 None admin] RBAC: Adding query filter params (role.id=33d4ab731cf74a3ca8d583700668949d, scope.project.id=3729de3353c34b84aa5d098e5bee6d98, user.id=76262d4699b9419eb503317db57b7f4c) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:29:51.318866 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aca904-6d09-466b-b157-9fb77ad99c47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:51.320419 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aca904-6d09-466b-b157-9fb77ad99c47 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:51.331934 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 62/115] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:29:51 2022] GET /identity/v3/role_assignments?user.id=76262d4699b9419eb503317db57b7f4c&scope.project.id=3729de3353c34b84aa5d098e5bee6d98&role.id=33d4ab731cf74a3ca8d583700668949d => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:29:51.331934 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aca904-6d09-466b-b157-9fb77ad99c47 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:51.365645 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 54/116] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:29:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:29:51.367565 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f154150-087e-44e8-9edc-73b6ba262ac0 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:51.400688 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:51.448333 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:51.547335 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aca904-6d09-466b-b157-9fb77ad99c47 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:51.548617 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f154150-087e-44e8-9edc-73b6ba262ac0 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:51.588258 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc42126-aadb-4c5a-a089-2530f56f1132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:51.589333 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc42126-aadb-4c5a-a089-2530f56f1132 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:51.589815 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc42126-aadb-4c5a-a089-2530f56f1132 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:51.590288 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc42126-aadb-4c5a-a089-2530f56f1132 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:51.591915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c15ac0-861b-493d-971f-98300dee0bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:51.592656 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c15ac0-861b-493d-971f-98300dee0bad None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:51.592950 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c15ac0-861b-493d-971f-98300dee0bad None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:51.593231 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c15ac0-861b-493d-971f-98300dee0bad None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:51.594044 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c15ac0-861b-493d-971f-98300dee0bad None admin] RBAC: Adding query filter params (name=admin) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:29:51.594361 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c15ac0-861b-493d-971f-98300dee0bad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:51.595815 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c15ac0-861b-493d-971f-98300dee0bad None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:51.604640 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc42126-aadb-4c5a-a089-2530f56f1132 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:29:51.605276 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 55/117] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:29:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:51.606707 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb571c4-9498-4c8e-8abd-0853676c7c08 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:51.607032 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb571c4-9498-4c8e-8abd-0853676c7c08 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:51.607320 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb571c4-9498-4c8e-8abd-0853676c7c08 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:51.608543 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 56/118] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:29:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:29:51.611100 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-0cc42126-aadb-4c5a-a089-2530f56f1132 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 07:29:51.611100 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:29:51.611100 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:29:51.611100 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:29:51.611100 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:29:51.611100 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:29:51.611100 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:29:51.611100 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:29:51.611100 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:29:51.611100 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:29:51.611100 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:29:51.611100 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:29:51.611100 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:29:51.611100 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:29:51.611100 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:29:51.611100 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:29:51.612495 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:29:51.612495 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:29:51.612495 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:29:51.612495 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:29:51.612495 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:29:51.612495 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:29:51.612495 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:29:51.612495 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:29:51.612495 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:29:51.612495 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:29:51.612495 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:29:51.612495 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:29:51.612495 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:29:51.612495 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:29:51.612495 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:29:51.612495 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:29:51.613365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:29:51.613365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:29:51.613365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:29:51.613365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:29:51.613365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:29:51.613365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:29:51.613365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:29:51.613365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:29:51.613365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:29:51.613365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:29:51.613365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 07:29:51.613365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:29:51.614789 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb571c4-9498-4c8e-8abd-0853676c7c08 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:51.616099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 63/119] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:29:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:29:51.617559 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4ebc4-645c-4bc3-bfab-8cba6170d25b None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:51.618456 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4ebc4-645c-4bc3-bfab-8cba6170d25b None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:51.620089 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4ebc4-645c-4bc3-bfab-8cba6170d25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:51.644930 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-38d4ebc4-645c-4bc3-bfab-8cba6170d25b None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:29:51.646166 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-38d4ebc4-645c-4bc3-bfab-8cba6170d25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:29:51.781820 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 64/120] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:29:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:29:51.782707 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4ebc4-645c-4bc3-bfab-8cba6170d25b None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:51.808395 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb571c4-9498-4c8e-8abd-0853676c7c08 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:51.810964 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:51.839221 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:51.876725 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d552cc-73b0-40ce-949d-eefb982962a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:51.878075 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d552cc-73b0-40ce-949d-eefb982962a7 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:51.878598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d552cc-73b0-40ce-949d-eefb982962a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:51.879096 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d552cc-73b0-40ce-949d-eefb982962a7 None admin] PATH_INFO: `/v3/users/373a698192574b4b8cacbfbcfee3991d` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:51.880545 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d552cc-73b0-40ce-949d-eefb982962a7 None admin] RBAC: Authorizing `identity:get_user(user_id=373a698192574b4b8cacbfbcfee3991d)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:51.882281 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d552cc-73b0-40ce-949d-eefb982962a7 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:51.884234 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 57/121] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:29:51 2022] GET /identity/v3/users/373a698192574b4b8cacbfbcfee3991d => generated 247 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:29:51.890426 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d552cc-73b0-40ce-949d-eefb982962a7 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:51.990393 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4ebc4-645c-4bc3-bfab-8cba6170d25b None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:52.061693 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be7891-dca6-4462-b518-cfba5f805692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:52.062549 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be7891-dca6-4462-b518-cfba5f805692 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:52.062838 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be7891-dca6-4462-b518-cfba5f805692 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:52.063186 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be7891-dca6-4462-b518-cfba5f805692 None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:52.063879 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be7891-dca6-4462-b518-cfba5f805692 None admin] RBAC: Adding query filter params (name=member) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:29:52.064188 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be7891-dca6-4462-b518-cfba5f805692 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:52.070719 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be7891-dca6-4462-b518-cfba5f805692 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:52.076132 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 65/122] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 26 07:29:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:52.076986 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be7891-dca6-4462-b518-cfba5f805692 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:52.089038 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d552cc-73b0-40ce-949d-eefb982962a7 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:52.168902 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176b494-d385-4cc9-8f47-141a1c12c09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:52.169971 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176b494-d385-4cc9-8f47-141a1c12c09c None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:52.170471 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176b494-d385-4cc9-8f47-141a1c12c09c None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:52.170942 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176b494-d385-4cc9-8f47-141a1c12c09c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:52.179598 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:52.183961 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176b494-d385-4cc9-8f47-141a1c12c09c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:29:52.189577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-9176b494-d385-4cc9-8f47-141a1c12c09c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 07:29:52.189577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:29:52.189577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:29:52.189577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:29:52.189577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:29:52.189577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:29:52.189577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:29:52.189577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:29:52.189577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:29:52.189577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:29:52.189577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:29:52.189577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:29:52.189577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:29:52.189577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:29:52.189577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:29:52.189577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:29:52.194386 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:29:52.194386 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:29:52.194386 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:29:52.194386 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:29:52.194386 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:29:52.194386 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:29:52.194386 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:29:52.194386 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:29:52.194386 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:29:52.194386 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:29:52.194386 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:29:52.194386 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:29:52.194386 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:29:52.194386 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:29:52.194386 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:29:52.194386 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:29:52.195364 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:29:52.195364 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:29:52.195364 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:29:52.195364 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:29:52.195364 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:29:52.195364 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:29:52.195364 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:29:52.195364 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:29:52.195364 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:29:52.195364 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:29:52.195364 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 07:29:52.195364 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:29:52.195364 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 58/123] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 26 07:29:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:29:52.196409 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176b494-d385-4cc9-8f47-141a1c12c09c None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:52.199162 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be7891-dca6-4462-b518-cfba5f805692 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:52.237959 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58a723-ca16-4fd7-b73a-67cd87dd7263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:52.238939 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58a723-ca16-4fd7-b73a-67cd87dd7263 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:52.239424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58a723-ca16-4fd7-b73a-67cd87dd7263 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:52.239870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58a723-ca16-4fd7-b73a-67cd87dd7263 None admin] PATH_INFO: `/v3/projects/3729de3353c34b84aa5d098e5bee6d98` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:52.241217 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58a723-ca16-4fd7-b73a-67cd87dd7263 None admin] RBAC: Authorizing `identity:get_project(project_id=3729de3353c34b84aa5d098e5bee6d98)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:52.242865 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58a723-ca16-4fd7-b73a-67cd87dd7263 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:52.244716 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 66/124] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:29:52 2022] GET /identity/v3/projects/3729de3353c34b84aa5d098e5bee6d98 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:52.245813 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58a723-ca16-4fd7-b73a-67cd87dd7263 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:52.251367 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:52.321514 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176b494-d385-4cc9-8f47-141a1c12c09c None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:52.367387 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236651a-34f0-452d-96c4-4c2f5d2904fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:52.368561 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236651a-34f0-452d-96c4-4c2f5d2904fe None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:52.369389 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236651a-34f0-452d-96c4-4c2f5d2904fe None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:52.369821 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236651a-34f0-452d-96c4-4c2f5d2904fe None admin] PATH_INFO: `/v3/users/34b57a5a2a6d428493fc9e9f0cc5a6ac` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:52.371802 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c236651a-34f0-452d-96c4-4c2f5d2904fe None admin] RBAC: Authorizing `identity:get_user(user_id=34b57a5a2a6d428493fc9e9f0cc5a6ac)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:52.375418 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c236651a-34f0-452d-96c4-4c2f5d2904fe None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:52.375861 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58a723-ca16-4fd7-b73a-67cd87dd7263 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:52.377813 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 59/125] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:29:52 2022] GET /identity/v3/users/34b57a5a2a6d428493fc9e9f0cc5a6ac => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:52.378785 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236651a-34f0-452d-96c4-4c2f5d2904fe None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:52.421304 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30231a-3f26-4377-bcb3-ed57e2b8f7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:52.422004 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30231a-3f26-4377-bcb3-ed57e2b8f7a4 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:52.422384 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30231a-3f26-4377-bcb3-ed57e2b8f7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:52.422766 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30231a-3f26-4377-bcb3-ed57e2b8f7a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:52.435607 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f30231a-3f26-4377-bcb3-ed57e2b8f7a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:29:52.441548 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-8f30231a-3f26-4377-bcb3-ed57e2b8f7a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 07:29:52.441548 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:29:52.441548 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:29:52.441548 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:29:52.441548 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:29:52.441548 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:29:52.441548 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:29:52.441548 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:29:52.441548 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:29:52.441548 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:29:52.441548 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:29:52.441548 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:29:52.441548 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:29:52.441548 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:29:52.441548 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:29:52.441548 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:29:52.443922 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:29:52.443922 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:29:52.443922 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:29:52.443922 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:29:52.443922 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:29:52.443922 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:29:52.443922 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:29:52.443922 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:29:52.443922 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:29:52.443922 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:29:52.443922 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:29:52.443922 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:29:52.443922 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:29:52.443922 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:29:52.443922 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:29:52.443922 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:29:52.445810 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:29:52.445810 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:29:52.445810 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:29:52.445810 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:29:52.445810 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:29:52.445810 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:29:52.445810 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:29:52.445810 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:29:52.445810 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:29:52.445810 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:29:52.445810 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 07:29:52.445810 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:29:52.445810 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 67/126] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:29:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:29:52.447460 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30231a-3f26-4377-bcb3-ed57e2b8f7a4 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:52.473601 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:52.557167 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:52.565756 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236651a-34f0-452d-96c4-4c2f5d2904fe None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:52.584002 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30231a-3f26-4377-bcb3-ed57e2b8f7a4 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:52.634228 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5d87f-203c-4ad8-aa77-c42040bb9db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:52.635148 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5d87f-203c-4ad8-aa77-c42040bb9db1 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:52.635573 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5d87f-203c-4ad8-aa77-c42040bb9db1 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:52.635990 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5d87f-203c-4ad8-aa77-c42040bb9db1 None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:52.636222 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921bcbd-eacd-4245-ad56-beae0adafafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:52.636985 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921bcbd-eacd-4245-ad56-beae0adafafb None admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:52.637110 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5d87f-203c-4ad8-aa77-c42040bb9db1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:29:52.637448 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921bcbd-eacd-4245-ad56-beae0adafafb None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:52.637687 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5d87f-203c-4ad8-aa77-c42040bb9db1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:52.637892 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921bcbd-eacd-4245-ad56-beae0adafafb None admin] PATH_INFO: `/v3/projects/3729de3353c34b84aa5d098e5bee6d98/users/373a698192574b4b8cacbfbcfee3991d/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:52.639379 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5d87f-203c-4ad8-aa77-c42040bb9db1 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:52.640071 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8921bcbd-eacd-4245-ad56-beae0adafafb None admin] RBAC: Authorizing `identity:create_grant(project_id=3729de3353c34b84aa5d098e5bee6d98, user_id=373a698192574b4b8cacbfbcfee3991d, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:52.641709 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8921bcbd-eacd-4245-ad56-beae0adafafb None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:52.650911 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 60/127] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:29:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:52.652251 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5d87f-203c-4ad8-aa77-c42040bb9db1 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:52.719101 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 68/128] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 26 07:29:52 2022] PUT /identity/v3/projects/3729de3353c34b84aa5d098e5bee6d98/users/373a698192574b4b8cacbfbcfee3991d/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:29:52.719101 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921bcbd-eacd-4245-ad56-beae0adafafb None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:52.839042 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5d87f-203c-4ad8-aa77-c42040bb9db1 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:52.866396 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:52.912158 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed22597c-6844-4097-9b03-7c9568198c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:52.913103 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22597c-6844-4097-9b03-7c9568198c93 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:52.913586 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22597c-6844-4097-9b03-7c9568198c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:52.914032 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22597c-6844-4097-9b03-7c9568198c93 None admin] PATH_INFO: `/v3/projects/3729de3353c34b84aa5d098e5bee6d98` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:52.915650 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed22597c-6844-4097-9b03-7c9568198c93 None admin] RBAC: Authorizing `identity:get_project(project_id=3729de3353c34b84aa5d098e5bee6d98)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:52.917308 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed22597c-6844-4097-9b03-7c9568198c93 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:52.921383 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 61/129] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:29:52 2022] GET /identity/v3/projects/3729de3353c34b84aa5d098e5bee6d98 => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:52.922263 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed22597c-6844-4097-9b03-7c9568198c93 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:52.927026 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921bcbd-eacd-4245-ad56-beae0adafafb None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:52.965912 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:52.978007 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5870a-651c-4630-a74b-831a7673919a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:52.979310 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5870a-651c-4630-a74b-831a7673919a None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:52.979823 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5870a-651c-4630-a74b-831a7673919a None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:52.980281 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5870a-651c-4630-a74b-831a7673919a None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:52.981107 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5870a-651c-4630-a74b-831a7673919a None admin] RBAC: Adding query filter params (name=member) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:29:52.981587 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5870a-651c-4630-a74b-831a7673919a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:52.983544 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5870a-651c-4630-a74b-831a7673919a None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:52.995050 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 69/130] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 26 07:29:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:52.996158 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5870a-651c-4630-a74b-831a7673919a None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:53.061747 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed22597c-6844-4097-9b03-7c9568198c93 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:53.109837 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5870a-651c-4630-a74b-831a7673919a None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:53.110093 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab70e534-f0e0-4ef9-a9d5-840e10ca5c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:53.110758 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70e534-f0e0-4ef9-a9d5-840e10ca5c20 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:53.111069 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70e534-f0e0-4ef9-a9d5-840e10ca5c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:53.111361 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70e534-f0e0-4ef9-a9d5-840e10ca5c20 None admin] PATH_INFO: `/v3/users/34b57a5a2a6d428493fc9e9f0cc5a6ac` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:53.113429 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab70e534-f0e0-4ef9-a9d5-840e10ca5c20 None admin] RBAC: Authorizing `identity:get_user(user_id=34b57a5a2a6d428493fc9e9f0cc5a6ac)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:53.115933 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab70e534-f0e0-4ef9-a9d5-840e10ca5c20 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:53.117989 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 62/131] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:29:52 2022] GET /identity/v3/users/34b57a5a2a6d428493fc9e9f0cc5a6ac => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:53.118842 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab70e534-f0e0-4ef9-a9d5-840e10ca5c20 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:53.164136 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89694ea-0b86-4bca-9daa-10e5d53a08f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:53.164869 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89694ea-0b86-4bca-9daa-10e5d53a08f6 None admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:53.165196 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89694ea-0b86-4bca-9daa-10e5d53a08f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:53.165476 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89694ea-0b86-4bca-9daa-10e5d53a08f6 None admin] PATH_INFO: `/v3/projects/3729de3353c34b84aa5d098e5bee6d98/users/34b57a5a2a6d428493fc9e9f0cc5a6ac/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:53.168144 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89694ea-0b86-4bca-9daa-10e5d53a08f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=3729de3353c34b84aa5d098e5bee6d98, user_id=34b57a5a2a6d428493fc9e9f0cc5a6ac, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:53.170192 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89694ea-0b86-4bca-9daa-10e5d53a08f6 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:53.173536 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:53.267141 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:53.278023 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab70e534-f0e0-4ef9-a9d5-840e10ca5c20 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:53.284186 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 70/132] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 26 07:29:52 2022] PUT /identity/v3/projects/3729de3353c34b84aa5d098e5bee6d98/users/34b57a5a2a6d428493fc9e9f0cc5a6ac/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:29:53.291826 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417db402-ec65-4622-83ca-7a62697624c8 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:53.292529 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417db402-ec65-4622-83ca-7a62697624c8 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:53.293006 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417db402-ec65-4622-83ca-7a62697624c8 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:53.297968 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 71/133] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:29:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:29:53.299467 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417db402-ec65-4622-83ca-7a62697624c8 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:53.400459 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8d89c-479a-4995-987e-1b6d19e1286e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:53.401128 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8d89c-479a-4995-987e-1b6d19e1286e None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:53.401412 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8d89c-479a-4995-987e-1b6d19e1286e None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:53.401689 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8d89c-479a-4995-987e-1b6d19e1286e None admin] PATH_INFO: `/v3/users/34b57a5a2a6d428493fc9e9f0cc5a6ac` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:53.402861 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd8d89c-479a-4995-987e-1b6d19e1286e None admin] RBAC: Authorizing `identity:get_user(user_id=34b57a5a2a6d428493fc9e9f0cc5a6ac)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:53.404415 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd8d89c-479a-4995-987e-1b6d19e1286e None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:53.406265 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 63/134] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:29:53 2022] GET /identity/v3/users/34b57a5a2a6d428493fc9e9f0cc5a6ac => generated 275 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:53.415434 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf76b7-fa78-4740-b02d-1538420113f4 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:53.415746 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf76b7-fa78-4740-b02d-1538420113f4 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:53.416021 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf76b7-fa78-4740-b02d-1538420113f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:53.448798 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-21cf76b7-fa78-4740-b02d-1538420113f4 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:29:53.450049 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-21cf76b7-fa78-4740-b02d-1538420113f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:29:53.452412 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417db402-ec65-4622-83ca-7a62697624c8 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:53.534998 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e66f6-779f-4e00-b8ab-6f0062e2dc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:53.535719 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e66f6-779f-4e00-b8ab-6f0062e2dc77 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:53.536004 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e66f6-779f-4e00-b8ab-6f0062e2dc77 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:53.536625 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e66f6-779f-4e00-b8ab-6f0062e2dc77 None admin] PATH_INFO: `/v3/projects/3729de3353c34b84aa5d098e5bee6d98` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:53.537843 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e66f6-779f-4e00-b8ab-6f0062e2dc77 None admin] RBAC: Authorizing `identity:get_project(project_id=3729de3353c34b84aa5d098e5bee6d98)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:53.539423 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e66f6-779f-4e00-b8ab-6f0062e2dc77 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:53.541687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 72/135] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:29:53 2022] GET /identity/v3/projects/3729de3353c34b84aa5d098e5bee6d98 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:53.542485 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e66f6-779f-4e00-b8ab-6f0062e2dc77 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:53.547676 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 64/136] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:29:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:29:53.548601 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf76b7-fa78-4740-b02d-1538420113f4 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:53.666940 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:53.720648 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:53.728539 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf76b7-fa78-4740-b02d-1538420113f4 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:53.770578 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0613ee5-a718-4412-85e7-80614cff3b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:53.771475 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0613ee5-a718-4412-85e7-80614cff3b71 None admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:53.771908 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0613ee5-a718-4412-85e7-80614cff3b71 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:53.772201 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0613ee5-a718-4412-85e7-80614cff3b71 None admin] PATH_INFO: `/v3/projects/3729de3353c34b84aa5d098e5bee6d98/users/34b57a5a2a6d428493fc9e9f0cc5a6ac/roles/865b733dc94e43589d2385826a23e137` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:53.774747 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0613ee5-a718-4412-85e7-80614cff3b71 None admin] RBAC: Authorizing `identity:create_grant(project_id=3729de3353c34b84aa5d098e5bee6d98, user_id=34b57a5a2a6d428493fc9e9f0cc5a6ac, role_id=865b733dc94e43589d2385826a23e137)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:53.776781 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0613ee5-a718-4412-85e7-80614cff3b71 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:53.781831 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e66f6-779f-4e00-b8ab-6f0062e2dc77 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:53.820308 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9993b2-4e3a-4618-9dad-1c55ff2eef00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:53.820936 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9993b2-4e3a-4618-9dad-1c55ff2eef00 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:53.821223 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9993b2-4e3a-4618-9dad-1c55ff2eef00 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:53.821503 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9993b2-4e3a-4618-9dad-1c55ff2eef00 None admin] PATH_INFO: `/v3/projects/4f6db56f6d93496b8f7219b7bebf21aa` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:53.822751 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9993b2-4e3a-4618-9dad-1c55ff2eef00 None admin] RBAC: Authorizing `identity:get_project(project_id=4f6db56f6d93496b8f7219b7bebf21aa)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:53.824276 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9993b2-4e3a-4618-9dad-1c55ff2eef00 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:53.826030 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 73/137] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:29:53 2022] GET /identity/v3/projects/4f6db56f6d93496b8f7219b7bebf21aa => generated 312 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:53.827359 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f955a04-19e9-4e35-a96c-166516df5647 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:53.827645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f955a04-19e9-4e35-a96c-166516df5647 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:53.827921 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f955a04-19e9-4e35-a96c-166516df5647 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:53.829147 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 74/138] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:29:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:29:53.833911 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f955a04-19e9-4e35-a96c-166516df5647 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:53.852028 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 65/139] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 26 07:29:53 2022] PUT /identity/v3/projects/3729de3353c34b84aa5d098e5bee6d98/users/34b57a5a2a6d428493fc9e9f0cc5a6ac/roles/865b733dc94e43589d2385826a23e137 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:29:53.853425 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31707d35-5fb7-4393-a238-fb4d2370961f None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:53.853721 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31707d35-5fb7-4393-a238-fb4d2370961f None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:53.854002 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31707d35-5fb7-4393-a238-fb4d2370961f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:53.892104 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-31707d35-5fb7-4393-a238-fb4d2370961f None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:29:53.894080 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-31707d35-5fb7-4393-a238-fb4d2370961f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:29:53.962721 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f955a04-19e9-4e35-a96c-166516df5647 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:53.993361 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:53.999631 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11843c85-0159-4d35-aa1f-77f2997387f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:54.000318 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11843c85-0159-4d35-aa1f-77f2997387f1 None admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:54.000611 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11843c85-0159-4d35-aa1f-77f2997387f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:54.000880 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11843c85-0159-4d35-aa1f-77f2997387f1 None admin] PATH_INFO: `/v3/projects/4f6db56f6d93496b8f7219b7bebf21aa/users/34b57a5a2a6d428493fc9e9f0cc5a6ac/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:54.006262 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11843c85-0159-4d35-aa1f-77f2997387f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=4f6db56f6d93496b8f7219b7bebf21aa, user_id=34b57a5a2a6d428493fc9e9f0cc5a6ac, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:54.008042 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11843c85-0159-4d35-aa1f-77f2997387f1 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:54.037289 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 66/140] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:29:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:29:54.038235 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31707d35-5fb7-4393-a238-fb4d2370961f None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:54.083659 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 75/141] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 26 07:29:53 2022] PUT /identity/v3/projects/4f6db56f6d93496b8f7219b7bebf21aa/users/34b57a5a2a6d428493fc9e9f0cc5a6ac/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:29:54.149469 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:54.166692 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31707d35-5fb7-4393-a238-fb4d2370961f None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:54.221200 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7739f-d756-4318-b1e7-5287f9a6d293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:54.221870 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7739f-d756-4318-b1e7-5287f9a6d293 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:54.222202 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7739f-d756-4318-b1e7-5287f9a6d293 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:54.222480 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7739f-d756-4318-b1e7-5287f9a6d293 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:54.223683 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca7739f-d756-4318-b1e7-5287f9a6d293 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:54.225168 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca7739f-d756-4318-b1e7-5287f9a6d293 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:54.226998 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 67/142] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:29:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:54.232911 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11843c85-0159-4d35-aa1f-77f2997387f1 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:54.390939 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11843c85-0159-4d35-aa1f-77f2997387f1 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:54.394033 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7739f-d756-4318-b1e7-5287f9a6d293 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:54.450189 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533911b-aa97-4347-9e4e-6a130c94ce56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:54.450809 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533911b-aa97-4347-9e4e-6a130c94ce56 None admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:54.451116 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533911b-aa97-4347-9e4e-6a130c94ce56 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:54.451393 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533911b-aa97-4347-9e4e-6a130c94ce56 None admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:54.452099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533911b-aa97-4347-9e4e-6a130c94ce56 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:54.453839 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533911b-aa97-4347-9e4e-6a130c94ce56 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:54.562633 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7739f-d756-4318-b1e7-5287f9a6d293 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:54.576981 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 76/143] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 26 07:29:54 2022] POST /identity/v3/users => generated 283 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:29:54.618837 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f0afa-4459-4f32-a953-45ac9dda581f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:54.619523 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f0afa-4459-4f32-a953-45ac9dda581f None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:54.619806 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f0afa-4459-4f32-a953-45ac9dda581f None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:54.620079 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f0afa-4459-4f32-a953-45ac9dda581f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:54.636601 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f0afa-4459-4f32-a953-45ac9dda581f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:29:54.641498 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-cb8f0afa-4459-4f32-a953-45ac9dda581f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 07:29:54.641498 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:29:54.641498 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:29:54.641498 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:29:54.641498 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:29:54.641498 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:29:54.641498 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:29:54.641498 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:29:54.641498 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:29:54.641498 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:29:54.641498 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:29:54.641498 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:29:54.641498 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:29:54.641498 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:29:54.641498 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:29:54.641498 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:29:54.642933 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:29:54.642933 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:29:54.642933 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:29:54.642933 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:29:54.642933 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:29:54.642933 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:29:54.642933 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:29:54.642933 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:29:54.642933 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:29:54.642933 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:29:54.642933 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:29:54.642933 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:29:54.642933 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:29:54.642933 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:29:54.642933 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:29:54.642933 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:29:54.644248 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:29:54.644248 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:29:54.644248 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:29:54.644248 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:29:54.644248 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:29:54.644248 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:29:54.644248 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:29:54.644248 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:29:54.644248 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:29:54.644248 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:29:54.644248 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 07:29:54.644248 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:29:54.644248 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 68/144] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:29:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 07:29:54.651234 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533911b-aa97-4347-9e4e-6a130c94ce56 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:54.720295 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:54.797219 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533911b-aa97-4347-9e4e-6a130c94ce56 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:54.841041 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743700b-a0f6-4751-9426-bcad6f0188e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:54.841682 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743700b-a0f6-4751-9426-bcad6f0188e6 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:54.841960 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743700b-a0f6-4751-9426-bcad6f0188e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:54.842231 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743700b-a0f6-4751-9426-bcad6f0188e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:54.842919 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7743700b-a0f6-4751-9426-bcad6f0188e6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:29:54.843253 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7743700b-a0f6-4751-9426-bcad6f0188e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:54.844676 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7743700b-a0f6-4751-9426-bcad6f0188e6 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:54.854541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 77/145] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 26 07:29:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:54.860160 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f0afa-4459-4f32-a953-45ac9dda581f None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:54.883432 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:54.992222 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f0afa-4459-4f32-a953-45ac9dda581f None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:55.038285 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e2044d-39a1-459e-bd8c-ffb3c39ea74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:55.038935 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2044d-39a1-459e-bd8c-ffb3c39ea74a None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:55.039332 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2044d-39a1-459e-bd8c-ffb3c39ea74a None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:55.039685 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2044d-39a1-459e-bd8c-ffb3c39ea74a None admin] PATH_INFO: `/v3/users/76262d4699b9419eb503317db57b7f4c` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:55.040835 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e2044d-39a1-459e-bd8c-ffb3c39ea74a None admin] RBAC: Authorizing `identity:get_user(user_id=76262d4699b9419eb503317db57b7f4c)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:55.042431 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e2044d-39a1-459e-bd8c-ffb3c39ea74a None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:55.044345 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 69/146] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:29:54 2022] GET /identity/v3/users/76262d4699b9419eb503317db57b7f4c => generated 289 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:55.050411 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743700b-a0f6-4751-9426-bcad6f0188e6 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:55.184294 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743700b-a0f6-4751-9426-bcad6f0188e6 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:55.203946 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:55.223489 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772e738-5007-46d0-82c5-1f85409be635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:55.224150 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772e738-5007-46d0-82c5-1f85409be635 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:55.224429 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772e738-5007-46d0-82c5-1f85409be635 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:55.224703 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772e738-5007-46d0-82c5-1f85409be635 None admin] PATH_INFO: `/v3/projects/3729de3353c34b84aa5d098e5bee6d98` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:55.225941 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4772e738-5007-46d0-82c5-1f85409be635 None admin] RBAC: Authorizing `identity:get_project(project_id=3729de3353c34b84aa5d098e5bee6d98)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:55.227653 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4772e738-5007-46d0-82c5-1f85409be635 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:55.229678 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 78/147] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:29:55 2022] GET /identity/v3/projects/3729de3353c34b84aa5d098e5bee6d98 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:55.235646 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e2044d-39a1-459e-bd8c-ffb3c39ea74a None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:55.363397 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:55.384980 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e2044d-39a1-459e-bd8c-ffb3c39ea74a None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:55.423871 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42fbfa-faf7-4d25-9449-831b4025ddb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:55.425132 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42fbfa-faf7-4d25-9449-831b4025ddb0 None admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:55.425603 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42fbfa-faf7-4d25-9449-831b4025ddb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:55.425876 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42fbfa-faf7-4d25-9449-831b4025ddb0 None admin] PATH_INFO: `/v3/projects/3729de3353c34b84aa5d098e5bee6d98/users/76262d4699b9419eb503317db57b7f4c/roles/33d4ab731cf74a3ca8d583700668949d` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:55.427852 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b42fbfa-faf7-4d25-9449-831b4025ddb0 None admin] RBAC: Authorizing `identity:create_grant(project_id=3729de3353c34b84aa5d098e5bee6d98, user_id=76262d4699b9419eb503317db57b7f4c, role_id=33d4ab731cf74a3ca8d583700668949d)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:55.429309 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b42fbfa-faf7-4d25-9449-831b4025ddb0 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:55.464429 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df085a4-6ca2-45c4-8507-e967b435e5c8 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:55.464931 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df085a4-6ca2-45c4-8507-e967b435e5c8 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:55.465313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df085a4-6ca2-45c4-8507-e967b435e5c8 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:55.466766 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 79/148] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:29:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 07:29:55.472593 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20617e7-88f5-4427-aff3-50128815b101 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:55.472896 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20617e7-88f5-4427-aff3-50128815b101 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:55.473173 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20617e7-88f5-4427-aff3-50128815b101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:55.495956 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-e20617e7-88f5-4427-aff3-50128815b101 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:29:55.497423 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-e20617e7-88f5-4427-aff3-50128815b101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:29:55.520140 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 70/149] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 26 07:29:55 2022] PUT /identity/v3/projects/3729de3353c34b84aa5d098e5bee6d98/users/76262d4699b9419eb503317db57b7f4c/roles/33d4ab731cf74a3ca8d583700668949d => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:29:55.612974 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 80/150] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:29:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 07:29:56.216273 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42fbfa-faf7-4d25-9449-831b4025ddb0 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:56.337052 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42fbfa-faf7-4d25-9449-831b4025ddb0 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:56.386494 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ac9eb-1db2-4486-9a8e-b4a86ee69a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:56.387199 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ac9eb-1db2-4486-9a8e-b4a86ee69a7e None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:56.387477 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ac9eb-1db2-4486-9a8e-b4a86ee69a7e None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:56.387744 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ac9eb-1db2-4486-9a8e-b4a86ee69a7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:56.396623 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:56.403678 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4ac9eb-1db2-4486-9a8e-b4a86ee69a7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:29:56.409474 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-7b4ac9eb-1db2-4486-9a8e-b4a86ee69a7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:29:56.409474 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:29:56.409474 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:29:56.409474 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:29:56.409474 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:29:56.409474 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:29:56.409474 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:29:56.409474 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:29:56.409474 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:29:56.409474 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:29:56.409474 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:29:56.409474 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:29:56.409474 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:29:56.409474 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:29:56.409474 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:29:56.409474 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:29:56.411297 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:29:56.411297 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:29:56.411297 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:29:56.411297 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:29:56.411297 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:29:56.411297 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:29:56.411297 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:29:56.411297 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:29:56.411297 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:29:56.411297 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:29:56.411297 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:29:56.411297 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:29:56.411297 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:29:56.411297 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:29:56.411297 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:29:56.411297 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:29:56.412057 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:29:56.412057 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:29:56.412057 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:29:56.412057 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:29:56.412057 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:29:56.412057 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:29:56.412057 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:29:56.412057 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:29:56.412057 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:29:56.412057 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:29:56.412057 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:29:56.412057 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:29:56.412057 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 71/151] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 26 07:29:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:29:56.418769 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20617e7-88f5-4427-aff3-50128815b101 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:56.558275 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20617e7-88f5-4427-aff3-50128815b101 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:56.569536 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996df2ac-60d7-4605-9145-b13ad85c1d69 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:56.570133 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996df2ac-60d7-4605-9145-b13ad85c1d69 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:56.570636 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996df2ac-60d7-4605-9145-b13ad85c1d69 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:56.571875 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:56.573444 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 72/152] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:29:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:29:56.579612 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7216a-a3ca-4fa2-899f-113862d511cf None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:56.580049 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7216a-a3ca-4fa2-899f-113862d511cf None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:56.580329 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7216a-a3ca-4fa2-899f-113862d511cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:56.614579 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-b3b7216a-a3ca-4fa2-899f-113862d511cf None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:29:56.616265 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-b3b7216a-a3ca-4fa2-899f-113862d511cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:29:56.621359 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214aca25-453b-408f-8ab2-c71d7b54350c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:56.621991 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214aca25-453b-408f-8ab2-c71d7b54350c None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:56.622268 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214aca25-453b-408f-8ab2-c71d7b54350c None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:56.622537 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214aca25-453b-408f-8ab2-c71d7b54350c None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:56.623235 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214aca25-453b-408f-8ab2-c71d7b54350c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:29:56.623538 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214aca25-453b-408f-8ab2-c71d7b54350c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:56.624935 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214aca25-453b-408f-8ab2-c71d7b54350c None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:56.652274 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 81/153] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:29:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:56.659079 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214aca25-453b-408f-8ab2-c71d7b54350c None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:56.742650 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 73/154] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:29:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 07:29:56.834750 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214aca25-453b-408f-8ab2-c71d7b54350c None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:56.873827 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b223d-3751-42dc-b50f-aab41019dc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:56.874467 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b223d-3751-42dc-b50f-aab41019dc66 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:56.874750 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b223d-3751-42dc-b50f-aab41019dc66 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:56.875014 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b223d-3751-42dc-b50f-aab41019dc66 None admin] PATH_INFO: `/v3/users/373a698192574b4b8cacbfbcfee3991d` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:56.879698 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b223d-3751-42dc-b50f-aab41019dc66 None admin] RBAC: Authorizing `identity:get_user(user_id=373a698192574b4b8cacbfbcfee3991d)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:56.881286 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b223d-3751-42dc-b50f-aab41019dc66 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:56.882883 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 82/155] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:29:56 2022] GET /identity/v3/users/373a698192574b4b8cacbfbcfee3991d => generated 247 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:29:56.888921 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7216a-a3ca-4fa2-899f-113862d511cf None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:57.035250 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7216a-a3ca-4fa2-899f-113862d511cf None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:57.069757 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:57.077518 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48525f56-574e-4750-8c36-6ee6a1d28e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:57.078204 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48525f56-574e-4750-8c36-6ee6a1d28e2d None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:57.078485 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48525f56-574e-4750-8c36-6ee6a1d28e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:57.078759 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48525f56-574e-4750-8c36-6ee6a1d28e2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:57.167497 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48525f56-574e-4750-8c36-6ee6a1d28e2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:57.168991 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48525f56-574e-4750-8c36-6ee6a1d28e2d None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:57.290422 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 74/156] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:29:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 07:29:57.301586 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b223d-3751-42dc-b50f-aab41019dc66 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:57.389744 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:57.407031 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1591bc7-b1d8-426a-a5c9-c9294c5b1b82 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:57.407325 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1591bc7-b1d8-426a-a5c9-c9294c5b1b82 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:57.407776 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1591bc7-b1d8-426a-a5c9-c9294c5b1b82 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:57.409869 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 75/157] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:29:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:29:57.429208 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded5ab7-29c4-4422-8820-9de7f217a356 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:57.429445 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded5ab7-29c4-4422-8820-9de7f217a356 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:57.429832 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded5ab7-29c4-4422-8820-9de7f217a356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:57.463270 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-fded5ab7-29c4-4422-8820-9de7f217a356 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:29:57.464714 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-fded5ab7-29c4-4422-8820-9de7f217a356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:29:57.511483 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:57.582219 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b223d-3751-42dc-b50f-aab41019dc66 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:57.637789 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 76/158] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:29:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:29:57.638460 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded5ab7-29c4-4422-8820-9de7f217a356 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:57.700646 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b1ed5-43c1-41d6-b8e0-4a5bcbffa7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:57.702010 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b1ed5-43c1-41d6-b8e0-4a5bcbffa7a9 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:57.702701 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b1ed5-43c1-41d6-b8e0-4a5bcbffa7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:57.703232 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b1ed5-43c1-41d6-b8e0-4a5bcbffa7a9 None admin] PATH_INFO: `/v3/projects/3729de3353c34b84aa5d098e5bee6d98` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:57.705222 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b1ed5-43c1-41d6-b8e0-4a5bcbffa7a9 None admin] RBAC: Authorizing `identity:get_project(project_id=3729de3353c34b84aa5d098e5bee6d98)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:57.709393 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b1ed5-43c1-41d6-b8e0-4a5bcbffa7a9 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:57.712572 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 83/159] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:29:57 2022] GET /identity/v3/projects/3729de3353c34b84aa5d098e5bee6d98 => generated 298 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:57.716153 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c287e-b7e1-4381-90ff-5e3b24addd51 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:57.716654 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c287e-b7e1-4381-90ff-5e3b24addd51 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:57.717140 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c287e-b7e1-4381-90ff-5e3b24addd51 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:57.722032 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 84/160] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:29:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:29:57.729643 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8df85e-ddfb-4eeb-8ad0-4ca51e9fa37d None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:57.730217 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8df85e-ddfb-4eeb-8ad0-4ca51e9fa37d None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:57.730714 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8df85e-ddfb-4eeb-8ad0-4ca51e9fa37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:57.781051 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-dd8df85e-ddfb-4eeb-8ad0-4ca51e9fa37d None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:29:57.784101 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-dd8df85e-ddfb-4eeb-8ad0-4ca51e9fa37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:29:57.856445 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded5ab7-29c4-4422-8820-9de7f217a356 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:57.927431 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86f6cf-a7f6-4972-9186-d5fd9aec9fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:57.928173 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86f6cf-a7f6-4972-9186-d5fd9aec9fd8 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:57.928453 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86f6cf-a7f6-4972-9186-d5fd9aec9fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:57.928726 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86f6cf-a7f6-4972-9186-d5fd9aec9fd8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:57.943342 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 85/161] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:29:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:29:57.945562 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8df85e-ddfb-4eeb-8ad0-4ca51e9fa37d None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:57.950478 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86f6cf-a7f6-4972-9186-d5fd9aec9fd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:29:57.959806 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-1e86f6cf-a7f6-4972-9186-d5fd9aec9fd8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 07:29:57.959806 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:29:57.959806 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:29:57.959806 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:29:57.959806 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:29:57.959806 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:29:57.959806 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:29:57.959806 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:29:57.959806 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:29:57.959806 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:29:57.959806 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:29:57.959806 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:29:57.959806 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:29:57.959806 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:29:57.959806 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:29:57.959806 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:29:57.960769 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:29:57.960769 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:29:57.960769 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:29:57.960769 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:29:57.960769 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:29:57.960769 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:29:57.960769 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:29:57.960769 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:29:57.960769 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:29:57.960769 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:29:57.960769 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:29:57.960769 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:29:57.960769 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:29:57.960769 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:29:57.960769 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:29:57.960769 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:29:57.961539 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:29:57.961539 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:29:57.961539 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:29:57.961539 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:29:57.961539 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:29:57.961539 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:29:57.961539 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:29:57.961539 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:29:57.961539 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:29:57.961539 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:29:57.961539 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 07:29:57.961539 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:29:57.961539 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 77/162] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:29:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:29:57.968139 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86f6cf-a7f6-4972-9186-d5fd9aec9fd8 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:58.005254 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:58.022546 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:58.149484 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8df85e-ddfb-4eeb-8ad0-4ca51e9fa37d None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:58.187749 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86f6cf-a7f6-4972-9186-d5fd9aec9fd8 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:58.193989 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d3dc6-1f4e-4653-b90f-13f9220f97c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:58.194701 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d3dc6-1f4e-4653-b90f-13f9220f97c3 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:58.195076 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d3dc6-1f4e-4653-b90f-13f9220f97c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:58.195436 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d3dc6-1f4e-4653-b90f-13f9220f97c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:58.196743 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d3dc6-1f4e-4653-b90f-13f9220f97c3 None admin] RBAC: Adding query filter params (role.id=07ed857b2feb472f9fa9e7fe0b08582b, scope.project.id=3729de3353c34b84aa5d098e5bee6d98, user.id=373a698192574b4b8cacbfbcfee3991d) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:29:58.197330 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d3dc6-1f4e-4653-b90f-13f9220f97c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:58.200796 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d3dc6-1f4e-4653-b90f-13f9220f97c3 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:58.210626 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 86/163] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:29:57 2022] GET /identity/v3/role_assignments?user.id=373a698192574b4b8cacbfbcfee3991d&scope.project.id=3729de3353c34b84aa5d098e5bee6d98&role.id=07ed857b2feb472f9fa9e7fe0b08582b => generated 608 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:58.243079 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48286b2-b8cf-4831-a209-46d097587966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:58.243816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48286b2-b8cf-4831-a209-46d097587966 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:58.244164 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48286b2-b8cf-4831-a209-46d097587966 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:58.244510 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48286b2-b8cf-4831-a209-46d097587966 None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:58.245280 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48286b2-b8cf-4831-a209-46d097587966 None admin] RBAC: Adding query filter params (name=member) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:29:58.245652 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48286b2-b8cf-4831-a209-46d097587966 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:58.247211 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48286b2-b8cf-4831-a209-46d097587966 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:58.261568 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d3dc6-1f4e-4653-b90f-13f9220f97c3 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:58.262617 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 78/164] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 26 07:29:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:29:58.267956 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48286b2-b8cf-4831-a209-46d097587966 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:58.418353 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:58.423526 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d3dc6-1f4e-4653-b90f-13f9220f97c3 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:58.452521 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:58.484377 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261fb077-8589-4add-b44e-ffbec4b1f89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:58.485083 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261fb077-8589-4add-b44e-ffbec4b1f89a None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:58.485363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261fb077-8589-4add-b44e-ffbec4b1f89a None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:58.485635 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261fb077-8589-4add-b44e-ffbec4b1f89a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:58.501759 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48286b2-b8cf-4831-a209-46d097587966 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:58.505221 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261fb077-8589-4add-b44e-ffbec4b1f89a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:29:58.512110 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-261fb077-8589-4add-b44e-ffbec4b1f89a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 07:29:58.512110 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:29:58.512110 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:29:58.512110 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:29:58.512110 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:29:58.512110 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:29:58.512110 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:29:58.512110 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:29:58.512110 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:29:58.512110 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:29:58.512110 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:29:58.512110 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:29:58.512110 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:29:58.512110 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:29:58.512110 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:29:58.512110 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:29:58.514372 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:29:58.514372 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:29:58.514372 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:29:58.514372 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:29:58.514372 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:29:58.514372 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:29:58.514372 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:29:58.514372 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:29:58.514372 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:29:58.514372 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:29:58.514372 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:29:58.514372 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:29:58.514372 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:29:58.514372 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:29:58.514372 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:29:58.514372 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:29:58.516352 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:29:58.516352 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:29:58.516352 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:29:58.516352 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:29:58.516352 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:29:58.516352 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:29:58.516352 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:29:58.516352 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:29:58.516352 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:29:58.516352 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:29:58.516352 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 07:29:58.516352 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:29:58.516352 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 87/165] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 26 07:29:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 07:29:58.536823 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261fb077-8589-4add-b44e-ffbec4b1f89a None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:58.571895 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163f2b2-e05e-4335-a68a-7286f5924cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:58.572565 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163f2b2-e05e-4335-a68a-7286f5924cec None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:58.572845 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163f2b2-e05e-4335-a68a-7286f5924cec None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:58.573121 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163f2b2-e05e-4335-a68a-7286f5924cec None admin] PATH_INFO: `/v3/users/34b57a5a2a6d428493fc9e9f0cc5a6ac` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:58.579807 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163f2b2-e05e-4335-a68a-7286f5924cec None admin] RBAC: Authorizing `identity:get_user(user_id=34b57a5a2a6d428493fc9e9f0cc5a6ac)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:58.581610 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163f2b2-e05e-4335-a68a-7286f5924cec None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:58.583276 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 79/166] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:29:58 2022] GET /identity/v3/users/34b57a5a2a6d428493fc9e9f0cc5a6ac => generated 275 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:29:58.589619 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163f2b2-e05e-4335-a68a-7286f5924cec None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:58.705958 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261fb077-8589-4add-b44e-ffbec4b1f89a None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:58.736530 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163f2b2-e05e-4335-a68a-7286f5924cec None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:58.779752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac6909-8018-404e-bcc0-d2eeccac222e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:58.780627 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac6909-8018-404e-bcc0-d2eeccac222e None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:58.781075 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac6909-8018-404e-bcc0-d2eeccac222e None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:58.781488 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac6909-8018-404e-bcc0-d2eeccac222e None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:58.782316 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac6909-8018-404e-bcc0-d2eeccac222e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:29:58.782761 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac6909-8018-404e-bcc0-d2eeccac222e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:58.784965 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac6909-8018-404e-bcc0-d2eeccac222e None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:58.790270 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09eb53-cc2d-4473-86f3-89a2b8fd844a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:58.790947 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09eb53-cc2d-4473-86f3-89a2b8fd844a None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:58.791253 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09eb53-cc2d-4473-86f3-89a2b8fd844a None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:58.791526 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09eb53-cc2d-4473-86f3-89a2b8fd844a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:58.795444 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 88/167] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:29:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:58.801504 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac6909-8018-404e-bcc0-d2eeccac222e None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:58.827391 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:58.842513 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:58.897065 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09eb53-cc2d-4473-86f3-89a2b8fd844a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:58.898568 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09eb53-cc2d-4473-86f3-89a2b8fd844a None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:59.033263 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac6909-8018-404e-bcc0-d2eeccac222e None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:59.073429 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 80/168] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:29:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 07:29:59.074300 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09eb53-cc2d-4473-86f3-89a2b8fd844a None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:59.079111 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aebf33-20ce-4af6-a2da-540a2abc9b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:59.079770 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aebf33-20ce-4af6-a2da-540a2abc9b48 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:59.080050 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aebf33-20ce-4af6-a2da-540a2abc9b48 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:59.081227 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aebf33-20ce-4af6-a2da-540a2abc9b48 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:59.098902 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aebf33-20ce-4af6-a2da-540a2abc9b48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:29:59.107874 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-90aebf33-20ce-4af6-a2da-540a2abc9b48 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 07:29:59.107874 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:29:59.107874 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:29:59.107874 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:29:59.107874 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:29:59.107874 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:29:59.107874 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:29:59.107874 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:29:59.107874 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:29:59.107874 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:29:59.107874 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:29:59.107874 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:29:59.107874 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:29:59.107874 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:29:59.107874 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:29:59.107874 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:29:59.108750 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:29:59.108750 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:29:59.108750 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:29:59.108750 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:29:59.108750 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:29:59.108750 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:29:59.108750 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:29:59.108750 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:29:59.108750 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:29:59.108750 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:29:59.108750 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:29:59.108750 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:29:59.108750 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:29:59.108750 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:29:59.108750 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:29:59.108750 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:29:59.109505 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:29:59.109505 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:29:59.109505 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:29:59.109505 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:29:59.109505 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:29:59.109505 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:29:59.109505 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:29:59.109505 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:29:59.109505 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:29:59.109505 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:29:59.109505 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 07:29:59.109505 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:29:59.109505 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 89/169] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:29:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:29:59.110851 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153a80c-3819-4a09-9aed-30cd83ba6a04 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:59.110851 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153a80c-3819-4a09-9aed-30cd83ba6a04 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:59.111212 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153a80c-3819-4a09-9aed-30cd83ba6a04 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:59.113023 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 90/170] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:29:59.116093 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153a80c-3819-4a09-9aed-30cd83ba6a04 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:59.137273 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:59.192161 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09eb53-cc2d-4473-86f3-89a2b8fd844a None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:59.231488 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1b670-8e19-430f-9c51-02ee3321192d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:59.232131 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1b670-8e19-430f-9c51-02ee3321192d None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:59.232411 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1b670-8e19-430f-9c51-02ee3321192d None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:59.232681 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1b670-8e19-430f-9c51-02ee3321192d None admin] PATH_INFO: `/v3/users/34b57a5a2a6d428493fc9e9f0cc5a6ac` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:59.233860 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1b670-8e19-430f-9c51-02ee3321192d None admin] RBAC: Authorizing `identity:get_user(user_id=34b57a5a2a6d428493fc9e9f0cc5a6ac)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:59.235335 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1b670-8e19-430f-9c51-02ee3321192d None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:59.237729 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 81/171] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:29:59 2022] GET /identity/v3/users/34b57a5a2a6d428493fc9e9f0cc5a6ac => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:59.243628 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1b670-8e19-430f-9c51-02ee3321192d None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:59.249458 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:59.278526 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153a80c-3819-4a09-9aed-30cd83ba6a04 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:59.355811 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf4814-02d8-4e20-a37f-d49bccba371e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:59.356391 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf4814-02d8-4e20-a37f-d49bccba371e None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:59.356675 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf4814-02d8-4e20-a37f-d49bccba371e None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:59.356944 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf4814-02d8-4e20-a37f-d49bccba371e None admin] PATH_INFO: `/v3/projects/3729de3353c34b84aa5d098e5bee6d98` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:59.358151 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdf4814-02d8-4e20-a37f-d49bccba371e None admin] RBAC: Authorizing `identity:get_project(project_id=3729de3353c34b84aa5d098e5bee6d98)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:59.359634 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdf4814-02d8-4e20-a37f-d49bccba371e None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:59.361451 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 91/172] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:29:59 2022] GET /identity/v3/projects/3729de3353c34b84aa5d098e5bee6d98 => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:59.365320 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a6c86-d5da-4813-9994-2e5967beb43e None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:59.365608 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a6c86-d5da-4813-9994-2e5967beb43e None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:59.365888 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a6c86-d5da-4813-9994-2e5967beb43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:59.373743 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1b670-8e19-430f-9c51-02ee3321192d None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:59.394049 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:59.405035 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-083a6c86-d5da-4813-9994-2e5967beb43e None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:29:59.406258 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-083a6c86-d5da-4813-9994-2e5967beb43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:29:59.426236 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de853c65-d2df-444e-ba7d-d0c0535bdd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:59.426874 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de853c65-d2df-444e-ba7d-d0c0535bdd44 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:59.427185 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de853c65-d2df-444e-ba7d-d0c0535bdd44 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:59.427459 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de853c65-d2df-444e-ba7d-d0c0535bdd44 None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:59.428146 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de853c65-d2df-444e-ba7d-d0c0535bdd44 None admin] RBAC: Adding query filter params (name=member) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:29:59.428450 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de853c65-d2df-444e-ba7d-d0c0535bdd44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:59.429861 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de853c65-d2df-444e-ba7d-d0c0535bdd44 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:59.457117 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 82/173] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 26 07:29:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:59.458051 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de853c65-d2df-444e-ba7d-d0c0535bdd44 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:59.515788 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 92/174] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:29:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:29:59.516782 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a6c86-d5da-4813-9994-2e5967beb43e None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:59.615418 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:59.634892 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a6c86-d5da-4813-9994-2e5967beb43e None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:59.672829 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de853c65-d2df-444e-ba7d-d0c0535bdd44 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:59.680755 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33788f84-1e04-46e7-8f0a-ec1762e8561a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:59.681434 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33788f84-1e04-46e7-8f0a-ec1762e8561a None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:59.681719 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33788f84-1e04-46e7-8f0a-ec1762e8561a None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:59.681992 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33788f84-1e04-46e7-8f0a-ec1762e8561a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:59.682722 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33788f84-1e04-46e7-8f0a-ec1762e8561a None admin] RBAC: Adding query filter params (role.id=854d2a8e89d94d8685ff7d5dc70494b5, scope.project.id=3729de3353c34b84aa5d098e5bee6d98, user.id=34b57a5a2a6d428493fc9e9f0cc5a6ac) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:29:59.683245 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33788f84-1e04-46e7-8f0a-ec1762e8561a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:59.684874 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33788f84-1e04-46e7-8f0a-ec1762e8561a None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:59.699093 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 93/175] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:29:59 2022] GET /identity/v3/role_assignments?user.id=34b57a5a2a6d428493fc9e9f0cc5a6ac&scope.project.id=3729de3353c34b84aa5d098e5bee6d98&role.id=854d2a8e89d94d8685ff7d5dc70494b5 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:59.700210 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33788f84-1e04-46e7-8f0a-ec1762e8561a None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:29:59.751802 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71640532-a87f-4d32-9ba8-b5a6d0d2cc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:59.752755 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71640532-a87f-4d32-9ba8-b5a6d0d2cc23 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:59.753193 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71640532-a87f-4d32-9ba8-b5a6d0d2cc23 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:59.753664 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71640532-a87f-4d32-9ba8-b5a6d0d2cc23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:59.859832 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:29:59.885641 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33788f84-1e04-46e7-8f0a-ec1762e8561a None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:29:59.907823 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71640532-a87f-4d32-9ba8-b5a6d0d2cc23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:59.910437 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71640532-a87f-4d32-9ba8-b5a6d0d2cc23 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:59.976413 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7b9fb-6fa8-45ab-b035-1982d8247563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:29:59.977063 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7b9fb-6fa8-45ab-b035-1982d8247563 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:59.977343 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7b9fb-6fa8-45ab-b035-1982d8247563 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:59.977614 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7b9fb-6fa8-45ab-b035-1982d8247563 None admin] PATH_INFO: `/v3/users/34b57a5a2a6d428493fc9e9f0cc5a6ac` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:59.978879 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e7b9fb-6fa8-45ab-b035-1982d8247563 None admin] RBAC: Authorizing `identity:get_user(user_id=34b57a5a2a6d428493fc9e9f0cc5a6ac)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:29:59.980620 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e7b9fb-6fa8-45ab-b035-1982d8247563 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:29:59.982472 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 94/176] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:29:59 2022] GET /identity/v3/users/34b57a5a2a6d428493fc9e9f0cc5a6ac => generated 275 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:29:59.983841 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd495ba-87e4-4ed2-8d48-083da7e01572 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:59.984353 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd495ba-87e4-4ed2-8d48-083da7e01572 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:59.984913 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd495ba-87e4-4ed2-8d48-083da7e01572 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:59.986393 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 95/177] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:29:59.989097 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720cc56-5e00-49cd-b4aa-78548dc518ef None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:29:59.989538 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720cc56-5e00-49cd-b4aa-78548dc518ef None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:29:59.989986 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720cc56-5e00-49cd-b4aa-78548dc518ef None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:29:59.991781 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 96/178] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:29:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:29:59.992758 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720cc56-5e00-49cd-b4aa-78548dc518ef None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:00.007965 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:00.051973 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 83/179] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:29:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 07:30:00.052583 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167b461-1ac8-400c-be58-f92ae1f6b567 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:00.052865 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167b461-1ac8-400c-be58-f92ae1f6b567 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:00.053134 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167b461-1ac8-400c-be58-f92ae1f6b567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:00.081418 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-8167b461-1ac8-400c-be58-f92ae1f6b567 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:00.081418 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-8167b461-1ac8-400c-be58-f92ae1f6b567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:00.123238 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720cc56-5e00-49cd-b4aa-78548dc518ef None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:00.169129 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 84/180] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:30:00.170528 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6788720-845d-4c32-bfeb-97e59edb58da None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:00.170828 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6788720-845d-4c32-bfeb-97e59edb58da None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:00.171115 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6788720-845d-4c32-bfeb-97e59edb58da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:00.172412 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a0ab7-7b2f-4524-b966-31c44d1f8592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:00.173253 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a0ab7-7b2f-4524-b966-31c44d1f8592 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:00.173748 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a0ab7-7b2f-4524-b966-31c44d1f8592 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:00.174296 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a0ab7-7b2f-4524-b966-31c44d1f8592 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:00.191258 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-c6788720-845d-4c32-bfeb-97e59edb58da None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:00.193070 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-c6788720-845d-4c32-bfeb-97e59edb58da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:00.197426 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:00.257975 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a0ab7-7b2f-4524-b966-31c44d1f8592 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:00.260005 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a0ab7-7b2f-4524-b966-31c44d1f8592 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:00.273873 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:00.282203 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 85/181] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:30:00.282979 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6788720-845d-4c32-bfeb-97e59edb58da None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:00.386593 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 97/182] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:29:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 07:30:00.388159 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a0ab7-7b2f-4524-b966-31c44d1f8592 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:00.407922 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6788720-845d-4c32-bfeb-97e59edb58da None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:00.452580 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a628f44-3e44-4541-a35a-3951ed95b7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:00.453600 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a628f44-3e44-4541-a35a-3951ed95b7d3 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:00.453984 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a628f44-3e44-4541-a35a-3951ed95b7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:00.454188 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a628f44-3e44-4541-a35a-3951ed95b7d3 None admin] PATH_INFO: `/v3/projects/3729de3353c34b84aa5d098e5bee6d98` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:00.456689 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a628f44-3e44-4541-a35a-3951ed95b7d3 None admin] RBAC: Authorizing `identity:get_project(project_id=3729de3353c34b84aa5d098e5bee6d98)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:00.458802 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a628f44-3e44-4541-a35a-3951ed95b7d3 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:00.465412 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 86/183] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:30:00 2022] GET /identity/v3/projects/3729de3353c34b84aa5d098e5bee6d98 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:00.465412 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918743f-3666-4ccc-a51c-8a7c7c644cde None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:00.465412 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918743f-3666-4ccc-a51c-8a7c7c644cde None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:00.465412 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918743f-3666-4ccc-a51c-8a7c7c644cde None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:00.465412 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 87/184] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:30:00.465412 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918743f-3666-4ccc-a51c-8a7c7c644cde None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:00.478896 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:00.522420 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a0ab7-7b2f-4524-b966-31c44d1f8592 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:00.534694 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:00.560904 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65dbfa-dcee-473c-aeb1-81015d708960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:00.561547 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65dbfa-dcee-473c-aeb1-81015d708960 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:00.561822 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65dbfa-dcee-473c-aeb1-81015d708960 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:00.562096 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65dbfa-dcee-473c-aeb1-81015d708960 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:00.574269 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a65dbfa-dcee-473c-aeb1-81015d708960 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:30:00.579111 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918743f-3666-4ccc-a51c-8a7c7c644cde None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:00.580670 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-3a65dbfa-dcee-473c-aeb1-81015d708960 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:30:00.580670 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:00.580670 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:00.580670 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:00.580670 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:00.580670 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:00.580670 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:00.580670 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:00.580670 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:00.580670 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:00.580670 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:00.580670 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:00.580670 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:30:00.580670 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:30:00.580670 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:30:00.580670 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:30:00.581541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:30:00.581541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:30:00.581541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:30:00.581541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:30:00.581541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:00.581541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:00.581541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:00.581541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:00.581541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:00.581541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:00.581541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:00.581541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:00.581541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:00.581541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:00.581541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:00.581541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:00.582302 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:00.582302 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:00.582302 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:00.582302 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:00.582302 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:30:00.582302 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:30:00.582302 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:30:00.582302 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:30:00.582302 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:30:00.582302 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:30:00.582302 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:30:00.582302 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:30:00.582302 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 98/185] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 26 07:30:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:00.583023 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65dbfa-dcee-473c-aeb1-81015d708960 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:00.620233 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d6310-f746-4f62-81da-577a8feb4eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:00.620919 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d6310-f746-4f62-81da-577a8feb4eb9 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:00.621217 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d6310-f746-4f62-81da-577a8feb4eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:00.621485 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d6310-f746-4f62-81da-577a8feb4eb9 None admin] PATH_INFO: `/v3/projects/4f6db56f6d93496b8f7219b7bebf21aa` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:00.622630 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d6310-f746-4f62-81da-577a8feb4eb9 None admin] RBAC: Authorizing `identity:get_project(project_id=4f6db56f6d93496b8f7219b7bebf21aa)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:00.624105 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d6310-f746-4f62-81da-577a8feb4eb9 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:00.625723 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 88/186] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:30:00 2022] GET /identity/v3/projects/4f6db56f6d93496b8f7219b7bebf21aa => generated 312 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:00.626827 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc35854-cac3-4a2e-ab34-73d0db7f8806 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:00.627233 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc35854-cac3-4a2e-ab34-73d0db7f8806 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:00.628079 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc35854-cac3-4a2e-ab34-73d0db7f8806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:00.646908 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-afc35854-cac3-4a2e-ab34-73d0db7f8806 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:00.648148 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-afc35854-cac3-4a2e-ab34-73d0db7f8806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:00.701425 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65dbfa-dcee-473c-aeb1-81015d708960 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:00.715890 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 89/187] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:30:00.719909 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc35854-cac3-4a2e-ab34-73d0db7f8806 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:00.730729 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:00.746218 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb2bfb-f971-4359-800e-0d4e8a255340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:00.746826 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb2bfb-f971-4359-800e-0d4e8a255340 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:00.747355 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb2bfb-f971-4359-800e-0d4e8a255340 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:00.747694 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb2bfb-f971-4359-800e-0d4e8a255340 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:00.748575 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb2bfb-f971-4359-800e-0d4e8a255340 None admin] RBAC: Adding query filter params (role.id=865b733dc94e43589d2385826a23e137, scope.project.id=3729de3353c34b84aa5d098e5bee6d98, user.id=34b57a5a2a6d428493fc9e9f0cc5a6ac) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:00.748882 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb2bfb-f971-4359-800e-0d4e8a255340 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:00.750341 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb2bfb-f971-4359-800e-0d4e8a255340 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:00.766852 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 99/188] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:30:00 2022] GET /identity/v3/role_assignments?user.id=34b57a5a2a6d428493fc9e9f0cc5a6ac&scope.project.id=3729de3353c34b84aa5d098e5bee6d98&role.id=865b733dc94e43589d2385826a23e137 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:00.766852 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb2bfb-f971-4359-800e-0d4e8a255340 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:00.831427 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:00.866538 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc35854-cac3-4a2e-ab34-73d0db7f8806 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:00.909210 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bed30b-a1c4-4647-8ee9-25ef30834b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:00.910400 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bed30b-a1c4-4647-8ee9-25ef30834b60 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:00.910829 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bed30b-a1c4-4647-8ee9-25ef30834b60 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:00.911271 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bed30b-a1c4-4647-8ee9-25ef30834b60 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:00.913122 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb2bfb-f971-4359-800e-0d4e8a255340 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:00.925367 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bed30b-a1c4-4647-8ee9-25ef30834b60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:30:00.930618 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-c0bed30b-a1c4-4647-8ee9-25ef30834b60 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 07:30:00.930618 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:00.930618 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:00.930618 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:00.930618 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:00.930618 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:00.930618 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:00.930618 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:00.930618 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:00.930618 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:00.930618 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:00.930618 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:00.930618 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:30:00.930618 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:30:00.930618 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:30:00.930618 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:30:00.931659 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:30:00.931659 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:30:00.931659 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:30:00.931659 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:30:00.931659 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:00.931659 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:00.931659 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:00.931659 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:00.931659 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:00.931659 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:00.931659 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:00.931659 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:00.931659 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:00.931659 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:00.931659 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:00.931659 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:00.932707 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:00.932707 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:00.932707 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:00.932707 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:00.932707 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:30:00.932707 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:30:00.932707 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:30:00.932707 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:30:00.932707 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:30:00.932707 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:30:00.932707 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 07:30:00.932707 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:30:00.934698 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 90/189] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:30:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:00.935914 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bed30b-a1c4-4647-8ee9-25ef30834b60 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:00.959665 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4764b08-439c-4389-9968-ffdf10aee958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:00.960313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4764b08-439c-4389-9968-ffdf10aee958 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:00.960587 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4764b08-439c-4389-9968-ffdf10aee958 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:00.960856 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4764b08-439c-4389-9968-ffdf10aee958 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:00.974769 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4764b08-439c-4389-9968-ffdf10aee958 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:30:00.980351 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-b4764b08-439c-4389-9968-ffdf10aee958 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 07:30:00.980351 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:00.980351 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:00.980351 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:00.980351 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:00.980351 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:00.980351 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:00.980351 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:00.980351 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:00.980351 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:00.980351 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:00.980351 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:00.980351 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:30:00.980351 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:30:00.980351 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:30:00.980351 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:30:00.981209 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:30:00.981209 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:30:00.981209 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:30:00.981209 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:30:00.981209 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:00.981209 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:00.981209 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:00.981209 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:00.981209 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:00.981209 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:00.981209 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:00.981209 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:00.981209 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:00.981209 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:00.981209 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:00.981209 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:00.981980 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:00.981980 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:00.981980 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:00.981980 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:00.981980 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:30:00.981980 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:30:00.981980 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:30:00.981980 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:30:00.981980 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:30:00.981980 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:30:00.981980 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 07:30:00.981980 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:30:00.981980 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 100/190] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 26 07:30:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:00.981980 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4764b08-439c-4389-9968-ffdf10aee958 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:01.027929 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:01.064232 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bed30b-a1c4-4647-8ee9-25ef30834b60 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:01.088946 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:01.095183 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4764b08-439c-4389-9968-ffdf10aee958 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:01.098324 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f652b5-f890-4c36-a4b4-29567383409d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:01.098927 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f652b5-f890-4c36-a4b4-29567383409d None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:01.099232 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f652b5-f890-4c36-a4b4-29567383409d None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:01.099500 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f652b5-f890-4c36-a4b4-29567383409d None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:01.100765 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f652b5-f890-4c36-a4b4-29567383409d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:01.100765 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f652b5-f890-4c36-a4b4-29567383409d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:01.102051 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f652b5-f890-4c36-a4b4-29567383409d None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:01.110310 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 91/191] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:30:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:01.111212 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f652b5-f890-4c36-a4b4-29567383409d None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:01.131604 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3133028-6745-42c7-8c2f-3fcd2f8cbb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:01.132212 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3133028-6745-42c7-8c2f-3fcd2f8cbb1b None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:01.132496 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3133028-6745-42c7-8c2f-3fcd2f8cbb1b None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:01.132763 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3133028-6745-42c7-8c2f-3fcd2f8cbb1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:01.133491 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3133028-6745-42c7-8c2f-3fcd2f8cbb1b None admin] RBAC: Adding query filter params (role.id=854d2a8e89d94d8685ff7d5dc70494b5, scope.project.id=4f6db56f6d93496b8f7219b7bebf21aa, user.id=34b57a5a2a6d428493fc9e9f0cc5a6ac) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:01.134300 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3133028-6745-42c7-8c2f-3fcd2f8cbb1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:01.135269 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3133028-6745-42c7-8c2f-3fcd2f8cbb1b None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:01.140924 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 101/192] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:30:00 2022] GET /identity/v3/role_assignments?user.id=34b57a5a2a6d428493fc9e9f0cc5a6ac&scope.project.id=4f6db56f6d93496b8f7219b7bebf21aa&role.id=854d2a8e89d94d8685ff7d5dc70494b5 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:01.141699 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3133028-6745-42c7-8c2f-3fcd2f8cbb1b None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:01.235315 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f652b5-f890-4c36-a4b4-29567383409d None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:01.256279 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3133028-6745-42c7-8c2f-3fcd2f8cbb1b None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:01.264451 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:01.275219 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72076a5-9398-4a9a-8a67-0585dd06e37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:01.275861 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72076a5-9398-4a9a-8a67-0585dd06e37d None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:01.276147 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72076a5-9398-4a9a-8a67-0585dd06e37d None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:01.276420 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72076a5-9398-4a9a-8a67-0585dd06e37d None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:01.277109 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72076a5-9398-4a9a-8a67-0585dd06e37d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:01.277424 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72076a5-9398-4a9a-8a67-0585dd06e37d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:01.278883 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72076a5-9398-4a9a-8a67-0585dd06e37d None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:01.293720 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 92/193] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 26 07:30:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:01.293720 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72076a5-9398-4a9a-8a67-0585dd06e37d None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:01.321773 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b5789-cfc6-4de7-a398-9d40b5e08816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:01.322963 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b5789-cfc6-4de7-a398-9d40b5e08816 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:01.323505 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b5789-cfc6-4de7-a398-9d40b5e08816 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:01.324002 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b5789-cfc6-4de7-a398-9d40b5e08816 None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:01.325244 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b5789-cfc6-4de7-a398-9d40b5e08816 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:01.325801 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b5789-cfc6-4de7-a398-9d40b5e08816 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:01.328523 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b5789-cfc6-4de7-a398-9d40b5e08816 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:01.346922 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 102/194] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:30:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:01.347879 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b5789-cfc6-4de7-a398-9d40b5e08816 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:01.378840 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:01.439515 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72076a5-9398-4a9a-8a67-0585dd06e37d None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:01.457827 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b5789-cfc6-4de7-a398-9d40b5e08816 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:01.492473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ec6f0-88f6-4199-8f51-7e98fc6799dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:01.493022 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ec6f0-88f6-4199-8f51-7e98fc6799dd None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:01.493297 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ec6f0-88f6-4199-8f51-7e98fc6799dd None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:01.493565 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ec6f0-88f6-4199-8f51-7e98fc6799dd None admin] PATH_INFO: `/v3/users/863db75ec4434daea0b315b557b9a91e` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:01.497895 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4db6ef-2cf0-4dd9-b4bc-3c99476694dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:01.498972 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4db6ef-2cf0-4dd9-b4bc-3c99476694dc None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:01.499510 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4db6ef-2cf0-4dd9-b4bc-3c99476694dc None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:01.500011 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4db6ef-2cf0-4dd9-b4bc-3c99476694dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:01.501944 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4db6ef-2cf0-4dd9-b4bc-3c99476694dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:01.505307 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4db6ef-2cf0-4dd9-b4bc-3c99476694dc None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:01.507275 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ec6f0-88f6-4199-8f51-7e98fc6799dd None admin] RBAC: Authorizing `identity:get_user(user_id=863db75ec4434daea0b315b557b9a91e)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:01.508507 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 93/195] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:30:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:01.508736 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ec6f0-88f6-4199-8f51-7e98fc6799dd None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:01.509766 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4db6ef-2cf0-4dd9-b4bc-3c99476694dc None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:01.510335 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 103/196] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:30:01 2022] GET /identity/v3/users/863db75ec4434daea0b315b557b9a91e => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:01.516173 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ec6f0-88f6-4199-8f51-7e98fc6799dd None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:01.577768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:01.595270 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:01.619182 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ec6f0-88f6-4199-8f51-7e98fc6799dd None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:01.624513 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4db6ef-2cf0-4dd9-b4bc-3c99476694dc None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:01.653379 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e73b3f6-90d9-4416-a57d-5d526488a149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:01.654015 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73b3f6-90d9-4416-a57d-5d526488a149 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:01.654286 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73b3f6-90d9-4416-a57d-5d526488a149 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:01.654553 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73b3f6-90d9-4416-a57d-5d526488a149 None admin] PATH_INFO: `/v3/users/863db75ec4434daea0b315b557b9a91e` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:01.655691 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e73b3f6-90d9-4416-a57d-5d526488a149 None admin] RBAC: Authorizing `identity:get_user(user_id=863db75ec4434daea0b315b557b9a91e)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:01.657181 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e73b3f6-90d9-4416-a57d-5d526488a149 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:01.658754 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 104/197] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:30:01 2022] GET /identity/v3/users/863db75ec4434daea0b315b557b9a91e => generated 283 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:01.659553 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e73b3f6-90d9-4416-a57d-5d526488a149 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:01.660366 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c712a-ef72-4add-9d58-a53c966bf4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:01.661016 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c712a-ef72-4add-9d58-a53c966bf4e1 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:01.661299 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c712a-ef72-4add-9d58-a53c966bf4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:01.661576 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c712a-ef72-4add-9d58-a53c966bf4e1 None admin] PATH_INFO: `/v3/users/76262d4699b9419eb503317db57b7f4c` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:01.662760 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c712a-ef72-4add-9d58-a53c966bf4e1 None admin] RBAC: Authorizing `identity:get_user(user_id=76262d4699b9419eb503317db57b7f4c)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:01.664289 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c712a-ef72-4add-9d58-a53c966bf4e1 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:01.670295 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 94/198] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:30:01 2022] GET /identity/v3/users/76262d4699b9419eb503317db57b7f4c => generated 289 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:01.670295 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c712a-ef72-4add-9d58-a53c966bf4e1 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:01.769439 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c712a-ef72-4add-9d58-a53c966bf4e1 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:01.770351 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e73b3f6-90d9-4416-a57d-5d526488a149 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:01.795282 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:01.803960 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b16079-15d9-47df-88ed-86cca88a79f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:01.804119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499319d7-a096-4196-bba3-53bae783710a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:01.804577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b16079-15d9-47df-88ed-86cca88a79f9 None admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:01.810525 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499319d7-a096-4196-bba3-53bae783710a None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:01.810633 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b16079-15d9-47df-88ed-86cca88a79f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:01.810718 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499319d7-a096-4196-bba3-53bae783710a None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:01.810799 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b16079-15d9-47df-88ed-86cca88a79f9 None admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:01.810878 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499319d7-a096-4196-bba3-53bae783710a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:01.810971 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b16079-15d9-47df-88ed-86cca88a79f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:01.810971 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b16079-15d9-47df-88ed-86cca88a79f9 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:01.821726 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:01.892437 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499319d7-a096-4196-bba3-53bae783710a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:01.894745 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499319d7-a096-4196-bba3-53bae783710a None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:01.933971 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 95/199] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 26 07:30:01 2022] POST /identity/v3/users => generated 297 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:30:01.933971 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b16079-15d9-47df-88ed-86cca88a79f9 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:02.016259 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 105/200] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:30:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 07:30:02.017033 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499319d7-a096-4196-bba3-53bae783710a None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:02.073604 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:02.074255 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b16079-15d9-47df-88ed-86cca88a79f9 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:02.116651 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a51fd0-a52d-4cc0-ab2d-965bd685ef4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:02.117728 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a51fd0-a52d-4cc0-ab2d-965bd685ef4a None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:02.118108 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a51fd0-a52d-4cc0-ab2d-965bd685ef4a None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:02.118392 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a51fd0-a52d-4cc0-ab2d-965bd685ef4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:02.139052 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499319d7-a096-4196-bba3-53bae783710a None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:02.183446 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:02.190973 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acefb462-11a3-4bf9-bab3-44396cb642ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:02.191669 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acefb462-11a3-4bf9-bab3-44396cb642ad None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:02.192006 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acefb462-11a3-4bf9-bab3-44396cb642ad None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:02.192289 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acefb462-11a3-4bf9-bab3-44396cb642ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:02.200092 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a51fd0-a52d-4cc0-ab2d-965bd685ef4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:02.201843 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a51fd0-a52d-4cc0-ab2d-965bd685ef4a None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:02.298867 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acefb462-11a3-4bf9-bab3-44396cb642ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:02.301253 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acefb462-11a3-4bf9-bab3-44396cb642ad None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:02.356857 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 96/201] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:30:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 07:30:02.357713 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a51fd0-a52d-4cc0-ab2d-965bd685ef4a None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:02.368576 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:02.454675 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 106/202] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:30:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 07:30:02.455635 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acefb462-11a3-4bf9-bab3-44396cb642ad None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:02.494297 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:02.524046 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a51fd0-a52d-4cc0-ab2d-965bd685ef4a None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:02.579997 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d3c99-4838-47d9-b7b5-ee296466a2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:02.580910 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d3c99-4838-47d9-b7b5-ee296466a2c7 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:02.581380 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d3c99-4838-47d9-b7b5-ee296466a2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:02.581765 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d3c99-4838-47d9-b7b5-ee296466a2c7 None admin] PATH_INFO: `/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:02.583292 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d3c99-4838-47d9-b7b5-ee296466a2c7 None admin] RBAC: Authorizing `identity:get_project(project_id=b59ea18f7e2d4d2dbe387a2dbc161c67)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:02.584769 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d3c99-4838-47d9-b7b5-ee296466a2c7 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:02.586965 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 97/203] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:30:02 2022] GET /identity/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67 => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:02.588069 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d3c99-4838-47d9-b7b5-ee296466a2c7 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:02.619765 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acefb462-11a3-4bf9-bab3-44396cb642ad None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:02.674885 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b2821-d973-4b02-87e3-2345c28b569f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:02.676214 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b2821-d973-4b02-87e3-2345c28b569f None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:02.676636 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b2821-d973-4b02-87e3-2345c28b569f None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:02.677324 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b2821-d973-4b02-87e3-2345c28b569f None admin] PATH_INFO: `/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:02.678883 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855b2821-d973-4b02-87e3-2345c28b569f None admin] RBAC: Authorizing `identity:get_project(project_id=b59ea18f7e2d4d2dbe387a2dbc161c67)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:02.681180 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855b2821-d973-4b02-87e3-2345c28b569f None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:02.683401 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 107/204] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:30:02 2022] GET /identity/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:02.684380 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b2821-d973-4b02-87e3-2345c28b569f None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:02.712873 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:02.736092 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d3c99-4838-47d9-b7b5-ee296466a2c7 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:02.788197 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee95b1-cc64-46fa-bdc1-4ab8bd7772c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:02.789225 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee95b1-cc64-46fa-bdc1-4ab8bd7772c7 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:02.789649 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee95b1-cc64-46fa-bdc1-4ab8bd7772c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:02.790066 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee95b1-cc64-46fa-bdc1-4ab8bd7772c7 None admin] PATH_INFO: `/v3/projects/3729de3353c34b84aa5d098e5bee6d98` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:02.791409 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aee95b1-cc64-46fa-bdc1-4ab8bd7772c7 None admin] RBAC: Authorizing `identity:get_project(project_id=3729de3353c34b84aa5d098e5bee6d98)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:02.793283 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aee95b1-cc64-46fa-bdc1-4ab8bd7772c7 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:02.795152 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 98/205] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:30:02 2022] GET /identity/v3/projects/3729de3353c34b84aa5d098e5bee6d98 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:02.802976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee95b1-cc64-46fa-bdc1-4ab8bd7772c7 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:02.828558 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:02.833893 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b2821-d973-4b02-87e3-2345c28b569f None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:02.885545 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a229dc0-e07c-406f-830d-5afedb3f2722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:02.886276 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a229dc0-e07c-406f-830d-5afedb3f2722 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:02.886558 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a229dc0-e07c-406f-830d-5afedb3f2722 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:02.886835 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a229dc0-e07c-406f-830d-5afedb3f2722 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:02.887694 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a229dc0-e07c-406f-830d-5afedb3f2722 None admin] RBAC: Adding query filter params (role.id=07ed857b2feb472f9fa9e7fe0b08582b, scope.project.id=b59ea18f7e2d4d2dbe387a2dbc161c67, user.id=863db75ec4434daea0b315b557b9a91e) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:02.887960 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a229dc0-e07c-406f-830d-5afedb3f2722 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:02.889496 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a229dc0-e07c-406f-830d-5afedb3f2722 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:02.903031 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 108/206] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:30:02 2022] GET /identity/v3/role_assignments?user.id=863db75ec4434daea0b315b557b9a91e&scope.project.id=b59ea18f7e2d4d2dbe387a2dbc161c67&role.id=07ed857b2feb472f9fa9e7fe0b08582b => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:02.903031 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a229dc0-e07c-406f-830d-5afedb3f2722 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:02.999244 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee95b1-cc64-46fa-bdc1-4ab8bd7772c7 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:03.077344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846620e-6e9a-4a16-909d-6623ebc4b489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:03.078372 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846620e-6e9a-4a16-909d-6623ebc4b489 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:03.078848 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846620e-6e9a-4a16-909d-6623ebc4b489 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:03.079339 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846620e-6e9a-4a16-909d-6623ebc4b489 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:03.080454 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846620e-6e9a-4a16-909d-6623ebc4b489 None admin] RBAC: Adding query filter params (role.id=865b733dc94e43589d2385826a23e137, scope.project.id=b59ea18f7e2d4d2dbe387a2dbc161c67, user.id=863db75ec4434daea0b315b557b9a91e) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:03.081135 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846620e-6e9a-4a16-909d-6623ebc4b489 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:03.082947 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846620e-6e9a-4a16-909d-6623ebc4b489 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:03.090007 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 99/207] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:30:02 2022] GET /identity/v3/role_assignments?user.id=863db75ec4434daea0b315b557b9a91e&scope.project.id=b59ea18f7e2d4d2dbe387a2dbc161c67&role.id=865b733dc94e43589d2385826a23e137 => generated 259 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:03.106343 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:03.135901 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a229dc0-e07c-406f-830d-5afedb3f2722 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:03.186841 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62ceb7-2c1c-4ee4-8390-9b251ed2b089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:03.187939 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62ceb7-2c1c-4ee4-8390-9b251ed2b089 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:03.188448 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62ceb7-2c1c-4ee4-8390-9b251ed2b089 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:03.188954 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62ceb7-2c1c-4ee4-8390-9b251ed2b089 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:03.190835 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e62ceb7-2c1c-4ee4-8390-9b251ed2b089 None admin] RBAC: Adding query filter params (role.id=33d4ab731cf74a3ca8d583700668949d, scope.project.id=3729de3353c34b84aa5d098e5bee6d98, user.id=76262d4699b9419eb503317db57b7f4c) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:03.191353 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e62ceb7-2c1c-4ee4-8390-9b251ed2b089 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:03.193128 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e62ceb7-2c1c-4ee4-8390-9b251ed2b089 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:03.200240 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 109/208] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:30:02 2022] GET /identity/v3/role_assignments?user.id=76262d4699b9419eb503317db57b7f4c&scope.project.id=3729de3353c34b84aa5d098e5bee6d98&role.id=33d4ab731cf74a3ca8d583700668949d => generated 608 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:04.282301 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99b33f-1e09-4826-a2fc-f61c9994a812 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:04.283454 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99b33f-1e09-4826-a2fc-f61c9994a812 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:04.284093 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99b33f-1e09-4826-a2fc-f61c9994a812 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:04.285676 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 100/209] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:30:04.291793 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2d32e-3283-4cf8-9d35-dc30a518a384 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:04.292260 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2d32e-3283-4cf8-9d35-dc30a518a384 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:04.292469 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2d32e-3283-4cf8-9d35-dc30a518a384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:04.311565 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-64b2d32e-3283-4cf8-9d35-dc30a518a384 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:04.312823 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-64b2d32e-3283-4cf8-9d35-dc30a518a384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:04.384465 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffade25a-2107-4eda-956b-29c5cd455ff2 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:04.384800 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffade25a-2107-4eda-956b-29c5cd455ff2 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:04.385016 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffade25a-2107-4eda-956b-29c5cd455ff2 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:04.386846 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 101/210] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 07:30:04.391926 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 110/211] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:30:04.394205 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9f006-29f2-4b56-bc63-a238b17ef297 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:04.394775 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9f006-29f2-4b56-bc63-a238b17ef297 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:04.399368 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9f006-29f2-4b56-bc63-a238b17ef297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:04.422424 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-89c9f006-29f2-4b56-bc63-a238b17ef297 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:04.423776 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-89c9f006-29f2-4b56-bc63-a238b17ef297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:04.507441 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 102/212] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:30:04.672311 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2d32e-3283-4cf8-9d35-dc30a518a384 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:04.756020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:04.780502 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9f006-29f2-4b56-bc63-a238b17ef297 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:04.796140 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:04.806044 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2d32e-3283-4cf8-9d35-dc30a518a384 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:04.853826 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf38313-4bf9-4139-88ae-65c750210d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:04.854492 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf38313-4bf9-4139-88ae-65c750210d32 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:04.854771 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf38313-4bf9-4139-88ae-65c750210d32 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:04.855071 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf38313-4bf9-4139-88ae-65c750210d32 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:04.870579 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf38313-4bf9-4139-88ae-65c750210d32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:30:04.878437 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-dcf38313-4bf9-4139-88ae-65c750210d32 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 07:30:04.878437 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:04.878437 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:04.878437 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:04.878437 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:04.878437 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:04.878437 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:04.878437 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:04.878437 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:04.878437 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:04.878437 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:04.878437 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:04.878437 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:30:04.878437 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:30:04.878437 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:30:04.878437 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:30:04.879454 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:30:04.879454 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:30:04.879454 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:30:04.879454 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:30:04.879454 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:04.879454 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:04.879454 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:04.879454 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:04.879454 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:04.879454 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:04.879454 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:04.879454 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:04.879454 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:04.879454 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:04.879454 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:04.879454 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:04.880666 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:04.880666 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:04.880666 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:04.880666 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:04.880666 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:30:04.880666 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:30:04.880666 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:30:04.880666 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:30:04.880666 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:30:04.880666 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:30:04.880666 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 07:30:04.880666 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:30:04.880666 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 111/213] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:30:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:04.885623 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf38313-4bf9-4139-88ae-65c750210d32 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:04.902805 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9f006-29f2-4b56-bc63-a238b17ef297 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:04.950919 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851896d-15fa-4a8e-b0b5-db659e1bf229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:04.952001 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851896d-15fa-4a8e-b0b5-db659e1bf229 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:04.952493 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851896d-15fa-4a8e-b0b5-db659e1bf229 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:04.952957 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851896d-15fa-4a8e-b0b5-db659e1bf229 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:04.954325 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b851896d-15fa-4a8e-b0b5-db659e1bf229 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:04.956605 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b851896d-15fa-4a8e-b0b5-db659e1bf229 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:04.958458 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 103/214] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:30:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:30:04.964445 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851896d-15fa-4a8e-b0b5-db659e1bf229 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:05.008390 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf38313-4bf9-4139-88ae-65c750210d32 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:05.041801 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:05.047531 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf8c8f-2b44-4804-998f-150832d72669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:05.048147 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf8c8f-2b44-4804-998f-150832d72669 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:05.048428 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf8c8f-2b44-4804-998f-150832d72669 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:05.049803 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf8c8f-2b44-4804-998f-150832d72669 None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:05.050294 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf8c8f-2b44-4804-998f-150832d72669 None admin] RBAC: Adding query filter params (name=member) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:05.050600 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf8c8f-2b44-4804-998f-150832d72669 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:05.052066 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf8c8f-2b44-4804-998f-150832d72669 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:05.057392 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:05.061254 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 112/215] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 26 07:30:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:30:05.067833 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf8c8f-2b44-4804-998f-150832d72669 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:05.083149 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851896d-15fa-4a8e-b0b5-db659e1bf229 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:05.122608 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e81b6c-3f94-4d2e-95a0-c3172f814a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:05.124031 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e81b6c-3f94-4d2e-95a0-c3172f814a6e None admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:05.124853 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e81b6c-3f94-4d2e-95a0-c3172f814a6e None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:05.125561 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e81b6c-3f94-4d2e-95a0-c3172f814a6e None admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:05.126919 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e81b6c-3f94-4d2e-95a0-c3172f814a6e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:05.129215 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e81b6c-3f94-4d2e-95a0-c3172f814a6e None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:05.183349 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf8c8f-2b44-4804-998f-150832d72669 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:05.263604 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38967a1-125d-47cc-bb93-ae65dd966453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:05.264667 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38967a1-125d-47cc-bb93-ae65dd966453 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:05.264957 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38967a1-125d-47cc-bb93-ae65dd966453 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:05.265232 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38967a1-125d-47cc-bb93-ae65dd966453 None admin] PATH_INFO: `/v3/users/7a6f5a86bf7f4792931353b69f8f7210` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:05.282882 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38967a1-125d-47cc-bb93-ae65dd966453 None admin] RBAC: Authorizing `identity:get_user(user_id=7a6f5a86bf7f4792931353b69f8f7210)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:05.288302 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38967a1-125d-47cc-bb93-ae65dd966453 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:05.290317 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 113/216] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:30:05 2022] GET /identity/v3/users/7a6f5a86bf7f4792931353b69f8f7210 => generated 297 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:30:05.297447 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38967a1-125d-47cc-bb93-ae65dd966453 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:05.337818 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 104/217] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 26 07:30:04 2022] POST /identity/v3/users => generated 297 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 07:30:05.342660 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a551a-09dc-4242-bfd2-607b2fa20c2a None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:05.342660 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a551a-09dc-4242-bfd2-607b2fa20c2a None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:05.342660 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a551a-09dc-4242-bfd2-607b2fa20c2a None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:05.342660 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 105/218] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:30:05.342660 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9331b1-2834-4ce6-85eb-90059e926136 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:05.342660 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9331b1-2834-4ce6-85eb-90059e926136 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:05.343081 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9331b1-2834-4ce6-85eb-90059e926136 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:05.349376 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 106/219] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:30:05.350811 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbf002-244c-4077-bc35-b8a6353bff52 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:05.351191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbf002-244c-4077-bc35-b8a6353bff52 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:05.351458 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbf002-244c-4077-bc35-b8a6353bff52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:05.371778 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:05.374432 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-e7bbf002-244c-4077-bc35-b8a6353bff52 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:05.375726 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-e7bbf002-244c-4077-bc35-b8a6353bff52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:05.442363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38967a1-125d-47cc-bb93-ae65dd966453 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:05.466815 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 107/220] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:30:05.473430 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adb489-e605-4aa4-a516-5de59eff732d None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:05.473747 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adb489-e605-4aa4-a516-5de59eff732d None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:05.474016 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adb489-e605-4aa4-a516-5de59eff732d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:05.490511 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a57591-2a1e-4da4-90fd-94b939583379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:05.491577 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a57591-2a1e-4da4-90fd-94b939583379 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:05.492065 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a57591-2a1e-4da4-90fd-94b939583379 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:05.492562 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a57591-2a1e-4da4-90fd-94b939583379 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:05.495018 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-e3adb489-e605-4aa4-a516-5de59eff732d None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:05.496234 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-e3adb489-e605-4aa4-a516-5de59eff732d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:05.572369 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:05.587259 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 108/221] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:30:05.590023 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a57591-2a1e-4da4-90fd-94b939583379 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:05.600825 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a57591-2a1e-4da4-90fd-94b939583379 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:05.654334 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:05.722171 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 114/222] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:30:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 07:30:05.731133 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3adb489-e605-4aa4-a516-5de59eff732d None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:05.747142 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a57591-2a1e-4da4-90fd-94b939583379 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:05.884780 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a57591-2a1e-4da4-90fd-94b939583379 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:05.890555 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3adb489-e605-4aa4-a516-5de59eff732d None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:05.932886 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53487c7d-8698-4cda-ab64-159457324ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:05.933544 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53487c7d-8698-4cda-ab64-159457324ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:05.933823 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53487c7d-8698-4cda-ab64-159457324ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:05.935752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53487c7d-8698-4cda-ab64-159457324ad5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:05.947873 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b38b40-0fb7-4b47-9aca-26354603558b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:05.948546 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b38b40-0fb7-4b47-9aca-26354603558b None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:05.948834 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b38b40-0fb7-4b47-9aca-26354603558b None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:05.949095 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b38b40-0fb7-4b47-9aca-26354603558b None admin] PATH_INFO: `/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:05.950331 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b38b40-0fb7-4b47-9aca-26354603558b None admin] RBAC: Authorizing `identity:get_project(project_id=b59ea18f7e2d4d2dbe387a2dbc161c67)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:05.952087 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b38b40-0fb7-4b47-9aca-26354603558b None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:05.953939 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 109/223] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:30:05 2022] GET /identity/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67 => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:05.954724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b38b40-0fb7-4b47-9aca-26354603558b None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:05.956180 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53487c7d-8698-4cda-ab64-159457324ad5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:30:05.962684 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-53487c7d-8698-4cda-ab64-159457324ad5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 07:30:05.962684 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:05.962684 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:05.962684 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:05.962684 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:05.962684 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:05.962684 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:05.962684 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:05.962684 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:05.962684 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:05.962684 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:05.962684 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:05.962684 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:30:05.962684 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:30:05.962684 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:30:05.962684 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:30:05.963648 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:30:05.963648 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:30:05.963648 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:30:05.963648 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:30:05.963648 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:05.963648 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:05.963648 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:05.963648 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:05.963648 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:05.963648 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:05.963648 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:05.963648 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:05.963648 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:05.963648 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:05.963648 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:05.963648 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:05.964414 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:05.964414 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:05.964414 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:05.964414 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:05.964414 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:30:05.964414 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:30:05.964414 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:30:05.964414 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:30:05.964414 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:30:05.964414 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:30:05.964414 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 07:30:05.964414 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:30:05.967226 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 115/224] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 26 07:30:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 07:30:05.968856 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53487c7d-8698-4cda-ab64-159457324ad5 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:06.000325 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:06.039242 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:06.084344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b38b40-0fb7-4b47-9aca-26354603558b None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:06.106062 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53487c7d-8698-4cda-ab64-159457324ad5 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:06.130345 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4253a15-1051-4332-8a38-32be6dda9f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:06.131803 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4253a15-1051-4332-8a38-32be6dda9f51 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:06.132391 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4253a15-1051-4332-8a38-32be6dda9f51 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:06.132911 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4253a15-1051-4332-8a38-32be6dda9f51 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:06.149670 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4253a15-1051-4332-8a38-32be6dda9f51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:30:06.152753 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010a54f-a444-4ab0-9ea8-374b6a4b8548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:06.153377 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010a54f-a444-4ab0-9ea8-374b6a4b8548 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:06.153660 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010a54f-a444-4ab0-9ea8-374b6a4b8548 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:06.153933 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010a54f-a444-4ab0-9ea8-374b6a4b8548 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:06.154674 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010a54f-a444-4ab0-9ea8-374b6a4b8548 None admin] RBAC: Adding query filter params (role.id=854d2a8e89d94d8685ff7d5dc70494b5, scope.project.id=b59ea18f7e2d4d2dbe387a2dbc161c67, user.id=7a6f5a86bf7f4792931353b69f8f7210) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:06.155004 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010a54f-a444-4ab0-9ea8-374b6a4b8548 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:06.156260 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-f4253a15-1051-4332-8a38-32be6dda9f51 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:30:06.156260 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:06.156260 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:06.156260 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:06.156260 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:06.156260 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:06.156260 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:06.156260 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:06.156260 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:06.156260 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:06.156260 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:06.156260 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:06.156260 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:30:06.156260 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:30:06.156260 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:30:06.156260 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:30:06.157337 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:30:06.157337 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:30:06.157337 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:30:06.157337 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:30:06.157337 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:06.157337 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:06.157337 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:06.157337 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:06.157337 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:06.157337 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:06.157337 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:06.157337 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:06.157337 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:06.157337 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:06.157337 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:06.157337 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:06.158395 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:06.158395 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:06.158395 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:06.158395 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:06.158395 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:30:06.158395 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:30:06.158395 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:30:06.158395 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:30:06.158395 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:30:06.158395 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:30:06.158395 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:30:06.158395 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:30:06.159159 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010a54f-a444-4ab0-9ea8-374b6a4b8548 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:06.167201 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 110/225] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 26 07:30:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:06.167201 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4253a15-1051-4332-8a38-32be6dda9f51 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:06.167432 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 116/226] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:30:05 2022] GET /identity/v3/role_assignments?user.id=7a6f5a86bf7f4792931353b69f8f7210&scope.project.id=b59ea18f7e2d4d2dbe387a2dbc161c67&role.id=854d2a8e89d94d8685ff7d5dc70494b5 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:06.172219 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010a54f-a444-4ab0-9ea8-374b6a4b8548 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:06.303960 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:06.317154 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4253a15-1051-4332-8a38-32be6dda9f51 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:06.329614 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010a54f-a444-4ab0-9ea8-374b6a4b8548 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:06.352320 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:06.365470 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9475f547-f094-4b18-8850-c6eddacd55a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:06.366111 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475f547-f094-4b18-8850-c6eddacd55a4 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:06.366392 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475f547-f094-4b18-8850-c6eddacd55a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:06.366747 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475f547-f094-4b18-8850-c6eddacd55a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:06.367725 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9475f547-f094-4b18-8850-c6eddacd55a4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:06.368033 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9475f547-f094-4b18-8850-c6eddacd55a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:06.369650 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9475f547-f094-4b18-8850-c6eddacd55a4 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:06.381557 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 111/227] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:30:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:06.387523 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9475f547-f094-4b18-8850-c6eddacd55a4 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:06.436291 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1a64b-2e49-432b-84a1-2949ada7f2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:06.436842 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1a64b-2e49-432b-84a1-2949ada7f2d0 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:06.437192 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1a64b-2e49-432b-84a1-2949ada7f2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:06.437593 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1a64b-2e49-432b-84a1-2949ada7f2d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:06.438282 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f1a64b-2e49-432b-84a1-2949ada7f2d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:06.438591 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f1a64b-2e49-432b-84a1-2949ada7f2d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:06.440187 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f1a64b-2e49-432b-84a1-2949ada7f2d0 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:06.456437 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 117/228] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:30:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:06.462859 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1a64b-2e49-432b-84a1-2949ada7f2d0 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:06.589901 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9475f547-f094-4b18-8850-c6eddacd55a4 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:06.610001 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1a64b-2e49-432b-84a1-2949ada7f2d0 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:06.649469 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b322a-919a-48d1-852b-272d320313dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:06.650114 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b322a-919a-48d1-852b-272d320313dd None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:06.650395 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b322a-919a-48d1-852b-272d320313dd None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:06.650668 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b322a-919a-48d1-852b-272d320313dd None admin] PATH_INFO: `/v3/users/863db75ec4434daea0b315b557b9a91e` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:06.651984 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b322a-919a-48d1-852b-272d320313dd None admin] RBAC: Authorizing `identity:get_user(user_id=863db75ec4434daea0b315b557b9a91e)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:06.653517 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b322a-919a-48d1-852b-272d320313dd None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:06.655466 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 118/229] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:30:06 2022] GET /identity/v3/users/863db75ec4434daea0b315b557b9a91e => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:06.661923 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b322a-919a-48d1-852b-272d320313dd None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:06.676667 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77ea3e-6ffb-4518-8aab-bfbbf8101f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:06.677323 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77ea3e-6ffb-4518-8aab-bfbbf8101f63 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:06.677692 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77ea3e-6ffb-4518-8aab-bfbbf8101f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:06.677976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77ea3e-6ffb-4518-8aab-bfbbf8101f63 None admin] PATH_INFO: `/v3/users/863db75ec4434daea0b315b557b9a91e` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:06.679242 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77ea3e-6ffb-4518-8aab-bfbbf8101f63 None admin] RBAC: Authorizing `identity:get_user(user_id=863db75ec4434daea0b315b557b9a91e)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:06.680712 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77ea3e-6ffb-4518-8aab-bfbbf8101f63 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:06.683241 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:06.686391 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 112/230] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:30:06 2022] GET /identity/v3/users/863db75ec4434daea0b315b557b9a91e => generated 283 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:06.708610 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77ea3e-6ffb-4518-8aab-bfbbf8101f63 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:06.780743 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:06.838561 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77ea3e-6ffb-4518-8aab-bfbbf8101f63 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:06.884534 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239718d9-4814-4db3-aa0c-06c602caffbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:06.885416 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239718d9-4814-4db3-aa0c-06c602caffbe None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:06.885697 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239718d9-4814-4db3-aa0c-06c602caffbe None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:06.886330 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239718d9-4814-4db3-aa0c-06c602caffbe None admin] PATH_INFO: `/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:06.887609 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239718d9-4814-4db3-aa0c-06c602caffbe None admin] RBAC: Authorizing `identity:get_project(project_id=b59ea18f7e2d4d2dbe387a2dbc161c67)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:06.889683 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239718d9-4814-4db3-aa0c-06c602caffbe None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:06.891610 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 113/231] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:30:06 2022] GET /identity/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:30:06.898193 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239718d9-4814-4db3-aa0c-06c602caffbe None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:06.933730 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b322a-919a-48d1-852b-272d320313dd None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:07.008775 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d46104-2324-446e-b594-97b1d4096f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:07.009356 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d46104-2324-446e-b594-97b1d4096f0e None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:07.009637 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d46104-2324-446e-b594-97b1d4096f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:07.009910 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d46104-2324-446e-b594-97b1d4096f0e None admin] PATH_INFO: `/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:07.015312 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d46104-2324-446e-b594-97b1d4096f0e None admin] RBAC: Authorizing `identity:get_project(project_id=b59ea18f7e2d4d2dbe387a2dbc161c67)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:07.018326 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d46104-2324-446e-b594-97b1d4096f0e None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:07.024386 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 119/232] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:30:06 2022] GET /identity/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67 => generated 302 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:07.032873 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d46104-2324-446e-b594-97b1d4096f0e None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:07.066650 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239718d9-4814-4db3-aa0c-06c602caffbe None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:07.104801 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:07.149510 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:07.151786 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f6e08-dd0e-4149-8fda-38cc0ce63014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:07.152601 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f6e08-dd0e-4149-8fda-38cc0ce63014 None admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:07.152884 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f6e08-dd0e-4149-8fda-38cc0ce63014 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:07.153158 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f6e08-dd0e-4149-8fda-38cc0ce63014 None admin] PATH_INFO: `/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67/users/863db75ec4434daea0b315b557b9a91e/roles/865b733dc94e43589d2385826a23e137` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:07.161582 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f6e08-dd0e-4149-8fda-38cc0ce63014 None admin] RBAC: Authorizing `identity:create_grant(project_id=b59ea18f7e2d4d2dbe387a2dbc161c67, user_id=863db75ec4434daea0b315b557b9a91e, role_id=865b733dc94e43589d2385826a23e137)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:07.163330 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f6e08-dd0e-4149-8fda-38cc0ce63014 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:07.183460 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d46104-2324-446e-b594-97b1d4096f0e None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:07.224367 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c59042-1309-4962-b4f1-5a467ec193a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:07.225340 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c59042-1309-4962-b4f1-5a467ec193a7 None admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:07.225793 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c59042-1309-4962-b4f1-5a467ec193a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:07.226240 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c59042-1309-4962-b4f1-5a467ec193a7 None admin] PATH_INFO: `/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67/users/863db75ec4434daea0b315b557b9a91e/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:07.228531 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c59042-1309-4962-b4f1-5a467ec193a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=b59ea18f7e2d4d2dbe387a2dbc161c67, user_id=863db75ec4434daea0b315b557b9a91e, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:07.230252 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c59042-1309-4962-b4f1-5a467ec193a7 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:07.320467 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 114/233] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 26 07:30:06 2022] PUT /identity/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67/users/863db75ec4434daea0b315b557b9a91e/roles/865b733dc94e43589d2385826a23e137 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:30:07.372439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 120/234] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 26 07:30:07 2022] PUT /identity/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67/users/863db75ec4434daea0b315b557b9a91e/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:30:07.778135 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77171772-2628-4e25-9dae-ff09e8608383 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:07.778641 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77171772-2628-4e25-9dae-ff09e8608383 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:07.779171 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77171772-2628-4e25-9dae-ff09e8608383 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:07.781095 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 115/235] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:30:07.797489 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8cbcb4-abc8-45a4-83bd-1987be401efe None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:07.797819 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8cbcb4-abc8-45a4-83bd-1987be401efe None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:07.798059 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8cbcb4-abc8-45a4-83bd-1987be401efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:07.829031 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-de8cbcb4-abc8-45a4-83bd-1987be401efe None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:07.830373 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-de8cbcb4-abc8-45a4-83bd-1987be401efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:07.938739 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 121/236] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:30:08.204362 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ede603-99ba-404e-83b9-f2c742296ad6 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:08.204695 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ede603-99ba-404e-83b9-f2c742296ad6 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:08.205000 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ede603-99ba-404e-83b9-f2c742296ad6 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:08.206697 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 116/237] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:30:08.215247 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55675325-88cf-4a39-8980-37b3e3cc6449 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:08.215247 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55675325-88cf-4a39-8980-37b3e3cc6449 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:08.215247 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55675325-88cf-4a39-8980-37b3e3cc6449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:08.240026 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-55675325-88cf-4a39-8980-37b3e3cc6449 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:08.241578 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-55675325-88cf-4a39-8980-37b3e3cc6449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:08.331015 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:08.340276 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 122/238] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:30:08.360661 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ede603-99ba-404e-83b9-f2c742296ad6 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:08.541117 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ede603-99ba-404e-83b9-f2c742296ad6 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:08.596501 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f1529-bbf1-4b69-9fb0-76be46ea2195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:08.597254 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f1529-bbf1-4b69-9fb0-76be46ea2195 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:08.597453 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f1529-bbf1-4b69-9fb0-76be46ea2195 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:08.597717 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f1529-bbf1-4b69-9fb0-76be46ea2195 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:08.610366 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f1529-bbf1-4b69-9fb0-76be46ea2195 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:30:08.620890 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55675325-88cf-4a39-8980-37b3e3cc6449 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:08.621379 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-330f1529-bbf1-4b69-9fb0-76be46ea2195 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 07:30:08.621379 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:08.621379 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:08.621379 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:08.621379 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:08.621379 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:08.621379 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:08.621379 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:08.621379 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:08.621379 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:08.621379 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:08.621379 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:08.621379 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:30:08.621379 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:30:08.621379 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:30:08.621379 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:30:08.622210 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:30:08.622210 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:30:08.622210 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:30:08.622210 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:30:08.622210 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:08.622210 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:08.622210 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:08.622210 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:08.622210 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:08.622210 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:08.622210 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:08.622210 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:08.622210 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:08.622210 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:08.622210 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:08.622210 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:08.623412 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:08.623412 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:08.623412 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:08.623412 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:08.623412 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:30:08.623412 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:30:08.623412 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:30:08.623412 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:30:08.623412 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:30:08.623412 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:30:08.623412 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 07:30:08.623412 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:30:08.623412 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 117/239] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:30:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:08.640530 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f1529-bbf1-4b69-9fb0-76be46ea2195 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:08.693579 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:08.759601 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55675325-88cf-4a39-8980-37b3e3cc6449 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:08.763333 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f1529-bbf1-4b69-9fb0-76be46ea2195 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:08.800065 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5cd32-d42b-44c1-b7e4-5e7ca73abe4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:08.800630 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5cd32-d42b-44c1-b7e4-5e7ca73abe4d None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:08.800908 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5cd32-d42b-44c1-b7e4-5e7ca73abe4d None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:08.801182 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5cd32-d42b-44c1-b7e4-5e7ca73abe4d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:08.802508 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c5cd32-d42b-44c1-b7e4-5e7ca73abe4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:08.803684 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61652a-80ec-4aa6-bb40-8733e2fc3d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:08.804137 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c5cd32-d42b-44c1-b7e4-5e7ca73abe4d None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:08.804433 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61652a-80ec-4aa6-bb40-8733e2fc3d51 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:08.804920 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61652a-80ec-4aa6-bb40-8733e2fc3d51 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:08.805407 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61652a-80ec-4aa6-bb40-8733e2fc3d51 None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:08.805969 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 123/240] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:30:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:30:08.806568 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a61652a-80ec-4aa6-bb40-8733e2fc3d51 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:08.806976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a61652a-80ec-4aa6-bb40-8733e2fc3d51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:08.807204 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ef9fb-fdc3-405a-857d-8532d9593ab7 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:08.807592 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ef9fb-fdc3-405a-857d-8532d9593ab7 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:08.807758 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ef9fb-fdc3-405a-857d-8532d9593ab7 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:08.808467 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a61652a-80ec-4aa6-bb40-8733e2fc3d51 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:08.809148 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 124/241] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:30:08.816518 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ef9fb-fdc3-405a-857d-8532d9593ab7 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:08.819384 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 118/242] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 26 07:30:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:08.820712 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756e665-9b4b-4c25-bb3e-63672abeacb8 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:08.821004 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756e665-9b4b-4c25-bb3e-63672abeacb8 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:08.821283 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756e665-9b4b-4c25-bb3e-63672abeacb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:08.848167 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-5756e665-9b4b-4c25-bb3e-63672abeacb8 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:08.849631 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-5756e665-9b4b-4c25-bb3e-63672abeacb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:08.898118 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:08.930502 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 119/243] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 07:30:08.935884 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756e665-9b4b-4c25-bb3e-63672abeacb8 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:08.942804 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ef9fb-fdc3-405a-857d-8532d9593ab7 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:08.984819 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61006b-1b5b-4de7-b6cb-2ee66258ccb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:08.985444 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61006b-1b5b-4de7-b6cb-2ee66258ccb8 None admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:08.985724 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61006b-1b5b-4de7-b6cb-2ee66258ccb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:08.985993 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61006b-1b5b-4de7-b6cb-2ee66258ccb8 None admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:08.987682 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61006b-1b5b-4de7-b6cb-2ee66258ccb8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:08.990431 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61006b-1b5b-4de7-b6cb-2ee66258ccb8 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:09.016977 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:09.108041 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756e665-9b4b-4c25-bb3e-63672abeacb8 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:09.135665 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 125/244] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 26 07:30:08 2022] POST /identity/v3/users => generated 293 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:30:09.155871 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be12a0-d306-49f6-a94b-ae63ce20f727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:09.156576 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be12a0-d306-49f6-a94b-ae63ce20f727 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:09.156853 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be12a0-d306-49f6-a94b-ae63ce20f727 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:09.157126 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be12a0-d306-49f6-a94b-ae63ce20f727 None admin] PATH_INFO: `/v3/users/0fc9186da0164146965ccc92672459fa` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:09.174305 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be12a0-d306-49f6-a94b-ae63ce20f727 None admin] RBAC: Authorizing `identity:get_user(user_id=0fc9186da0164146965ccc92672459fa)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:09.176385 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be12a0-d306-49f6-a94b-ae63ce20f727 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:09.178485 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 120/245] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:30:08 2022] GET /identity/v3/users/0fc9186da0164146965ccc92672459fa => generated 297 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:09.188257 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61006b-1b5b-4de7-b6cb-2ee66258ccb8 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:09.307120 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be12a0-d306-49f6-a94b-ae63ce20f727 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:09.340987 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61006b-1b5b-4de7-b6cb-2ee66258ccb8 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:09.362452 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:09.383610 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9dddba-1790-4cba-bdc5-645f97327530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:09.384239 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9dddba-1790-4cba-bdc5-645f97327530 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:09.384519 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9dddba-1790-4cba-bdc5-645f97327530 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:09.384859 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9dddba-1790-4cba-bdc5-645f97327530 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:09.422923 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:09.432459 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be12a0-d306-49f6-a94b-ae63ce20f727 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:09.462410 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9dddba-1790-4cba-bdc5-645f97327530 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:09.463917 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9dddba-1790-4cba-bdc5-645f97327530 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:09.473515 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6230a15-8d4d-4601-bf44-0eaaed324781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:09.474476 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6230a15-8d4d-4601-bf44-0eaaed324781 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:09.475126 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6230a15-8d4d-4601-bf44-0eaaed324781 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:09.475593 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6230a15-8d4d-4601-bf44-0eaaed324781 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:09.487846 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6230a15-8d4d-4601-bf44-0eaaed324781 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:30:09.495900 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-f6230a15-8d4d-4601-bf44-0eaaed324781 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 07:30:09.495900 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:09.495900 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:09.495900 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:09.495900 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:09.495900 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:09.495900 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:09.495900 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:09.495900 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:09.495900 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:09.495900 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:09.495900 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:09.495900 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:30:09.495900 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:30:09.495900 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:30:09.495900 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:30:09.496776 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:30:09.496776 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:30:09.496776 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:30:09.496776 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:30:09.496776 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:09.496776 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:09.496776 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:09.496776 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:09.496776 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:09.496776 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:09.496776 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:09.496776 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:09.496776 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:09.496776 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:09.496776 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:09.496776 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:09.497545 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:09.497545 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:09.497545 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:09.497545 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:09.497545 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:30:09.497545 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:30:09.497545 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:30:09.497545 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:30:09.497545 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:30:09.497545 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:30:09.497545 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 07:30:09.497545 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:30:09.500816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 121/246] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:30:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 07:30:09.508664 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6230a15-8d4d-4601-bf44-0eaaed324781 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:09.598795 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 126/247] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:30:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 07:30:09.604859 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9dddba-1790-4cba-bdc5-645f97327530 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:09.626273 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:09.650901 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6230a15-8d4d-4601-bf44-0eaaed324781 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:09.707170 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2220cc-3f64-49c0-a38c-940b70dbb5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:09.708310 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2220cc-3f64-49c0-a38c-940b70dbb5b9 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:09.708784 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2220cc-3f64-49c0-a38c-940b70dbb5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:09.709246 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2220cc-3f64-49c0-a38c-940b70dbb5b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:09.710116 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2220cc-3f64-49c0-a38c-940b70dbb5b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:09.712316 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2220cc-3f64-49c0-a38c-940b70dbb5b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:09.714823 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2220cc-3f64-49c0-a38c-940b70dbb5b9 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:09.726804 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 122/248] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 26 07:30:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:09.732592 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2220cc-3f64-49c0-a38c-940b70dbb5b9 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:09.758878 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:09.759844 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9dddba-1790-4cba-bdc5-645f97327530 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:09.813128 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a42c49-7c2f-4cda-8466-8427087cd2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:09.813510 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a42c49-7c2f-4cda-8466-8427087cd2a1 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:09.813790 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a42c49-7c2f-4cda-8466-8427087cd2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:09.814060 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a42c49-7c2f-4cda-8466-8427087cd2a1 None admin] PATH_INFO: `/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:09.816266 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a42c49-7c2f-4cda-8466-8427087cd2a1 None admin] RBAC: Authorizing `identity:get_project(project_id=b59ea18f7e2d4d2dbe387a2dbc161c67)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:09.818621 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a42c49-7c2f-4cda-8466-8427087cd2a1 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:09.821433 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 127/249] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:30:09 2022] GET /identity/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:30:09.827620 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee46fbb-b42c-442b-ba92-fb5fba5fa8de None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:09.827913 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee46fbb-b42c-442b-ba92-fb5fba5fa8de None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:09.828163 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee46fbb-b42c-442b-ba92-fb5fba5fa8de None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:09.829502 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 128/250] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:30:09.830415 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee46fbb-b42c-442b-ba92-fb5fba5fa8de None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:09.883710 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2220cc-3f64-49c0-a38c-940b70dbb5b9 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:09.932390 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd949299-5995-4f24-b513-c2f4e317ad55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:09.933393 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd949299-5995-4f24-b513-c2f4e317ad55 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:09.933893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd949299-5995-4f24-b513-c2f4e317ad55 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:09.934414 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd949299-5995-4f24-b513-c2f4e317ad55 None admin] PATH_INFO: `/v3/users/7a6f5a86bf7f4792931353b69f8f7210` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:09.936594 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd949299-5995-4f24-b513-c2f4e317ad55 None admin] RBAC: Authorizing `identity:get_user(user_id=7a6f5a86bf7f4792931353b69f8f7210)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:09.938587 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd949299-5995-4f24-b513-c2f4e317ad55 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:09.941719 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 123/251] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:30:09 2022] GET /identity/v3/users/7a6f5a86bf7f4792931353b69f8f7210 => generated 297 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:30:09.943756 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fb861-ffea-440e-956c-cc7396dd5379 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:09.944247 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fb861-ffea-440e-956c-cc7396dd5379 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:09.944709 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fb861-ffea-440e-956c-cc7396dd5379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:09.953820 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:09.968584 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-4c3fb861-ffea-440e-956c-cc7396dd5379 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:09.970250 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-4c3fb861-ffea-440e-956c-cc7396dd5379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:09.979614 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee46fbb-b42c-442b-ba92-fb5fba5fa8de None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:10.035174 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a38822-dcfd-419d-b9d9-43ce233d80e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:10.036822 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a38822-dcfd-419d-b9d9-43ce233d80e3 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:10.037334 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a38822-dcfd-419d-b9d9-43ce233d80e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:10.037861 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a38822-dcfd-419d-b9d9-43ce233d80e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:10.039344 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a38822-dcfd-419d-b9d9-43ce233d80e3 None admin] RBAC: Adding query filter params (role.id=33d4ab731cf74a3ca8d583700668949d, scope.project.id=b59ea18f7e2d4d2dbe387a2dbc161c67, user.id=0fc9186da0164146965ccc92672459fa) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:10.040241 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a38822-dcfd-419d-b9d9-43ce233d80e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:10.042458 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a38822-dcfd-419d-b9d9-43ce233d80e3 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:10.053093 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 129/252] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:30:09 2022] GET /identity/v3/role_assignments?user.id=0fc9186da0164146965ccc92672459fa&scope.project.id=b59ea18f7e2d4d2dbe387a2dbc161c67&role.id=33d4ab731cf74a3ca8d583700668949d => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:10.054804 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a38822-dcfd-419d-b9d9-43ce233d80e3 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:10.071938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 124/253] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:30:10.116626 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b893b-170d-47e7-9b06-39b2fb9df8cd None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:10.117249 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b893b-170d-47e7-9b06-39b2fb9df8cd None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:10.117726 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b893b-170d-47e7-9b06-39b2fb9df8cd None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:10.121634 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 125/254] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:30:10.129637 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93272209-38d2-4664-b64c-0a6cb00f550e None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:10.130613 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93272209-38d2-4664-b64c-0a6cb00f550e None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:10.131345 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93272209-38d2-4664-b64c-0a6cb00f550e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:10.170373 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-93272209-38d2-4664-b64c-0a6cb00f550e None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:10.172223 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-93272209-38d2-4664-b64c-0a6cb00f550e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:10.174158 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a38822-dcfd-419d-b9d9-43ce233d80e3 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:10.186775 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:10.219946 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9ae01-c906-4d9a-9d9e-54009345deb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:10.222242 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9ae01-c906-4d9a-9d9e-54009345deb8 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:10.223019 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9ae01-c906-4d9a-9d9e-54009345deb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:10.224383 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9ae01-c906-4d9a-9d9e-54009345deb8 None admin] PATH_INFO: `/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:10.227512 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9ae01-c906-4d9a-9d9e-54009345deb8 None admin] RBAC: Authorizing `identity:get_project(project_id=b59ea18f7e2d4d2dbe387a2dbc161c67)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:10.229921 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9ae01-c906-4d9a-9d9e-54009345deb8 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:10.232495 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 130/255] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:30:10 2022] GET /identity/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:10.240140 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9ae01-c906-4d9a-9d9e-54009345deb8 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:10.282604 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:10.352454 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 126/256] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:30:10.393117 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9ae01-c906-4d9a-9d9e-54009345deb8 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:10.431125 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd4215b-8368-4944-a3f1-1986b0f1ef08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:10.432035 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4215b-8368-4944-a3f1-1986b0f1ef08 None admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:10.432477 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4215b-8368-4944-a3f1-1986b0f1ef08 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:10.432893 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4215b-8368-4944-a3f1-1986b0f1ef08 None admin] PATH_INFO: `/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67/users/7a6f5a86bf7f4792931353b69f8f7210/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:10.435152 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd4215b-8368-4944-a3f1-1986b0f1ef08 None admin] RBAC: Authorizing `identity:create_grant(project_id=b59ea18f7e2d4d2dbe387a2dbc161c67, user_id=7a6f5a86bf7f4792931353b69f8f7210, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:10.436757 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd4215b-8368-4944-a3f1-1986b0f1ef08 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:10.449975 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93272209-38d2-4664-b64c-0a6cb00f550e None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:10.519596 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 131/257] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 26 07:30:10 2022] PUT /identity/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67/users/7a6f5a86bf7f4792931353b69f8f7210/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:30:10.589887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93272209-38d2-4664-b64c-0a6cb00f550e None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:10.640366 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca40fb-9d7a-4871-af7b-d472629e5d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:10.641063 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca40fb-9d7a-4871-af7b-d472629e5d97 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:10.641342 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca40fb-9d7a-4871-af7b-d472629e5d97 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:10.641609 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca40fb-9d7a-4871-af7b-d472629e5d97 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:10.660644 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ca40fb-9d7a-4871-af7b-d472629e5d97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:30:10.665589 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-d3ca40fb-9d7a-4871-af7b-d472629e5d97 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 07:30:10.665589 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:10.665589 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:10.665589 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:10.665589 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:10.665589 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:10.665589 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:10.665589 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:10.665589 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:10.665589 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:10.665589 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:10.665589 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:10.665589 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:30:10.665589 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:30:10.665589 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:30:10.665589 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:30:10.666720 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:30:10.666720 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:30:10.666720 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:30:10.666720 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:30:10.666720 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:10.666720 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:10.666720 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:10.666720 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:10.666720 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:10.666720 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:10.666720 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:10.666720 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:10.666720 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:10.666720 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:10.666720 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:10.666720 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:10.667558 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:10.667558 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:10.667558 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:10.667558 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:10.667558 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:30:10.667558 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:30:10.667558 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:30:10.667558 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:30:10.667558 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:30:10.667558 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:30:10.667558 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 07:30:10.667558 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:30:10.667558 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 127/258] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 26 07:30:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:10.673921 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd4215b-8368-4944-a3f1-1986b0f1ef08 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:10.750450 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca40fb-9d7a-4871-af7b-d472629e5d97 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:10.758718 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:10.783407 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:10.808092 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd4215b-8368-4944-a3f1-1986b0f1ef08 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:10.845041 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e593c-f5c7-4b68-9309-f3eb38a390ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:10.845935 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e593c-f5c7-4b68-9309-f3eb38a390ce None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:10.846552 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e593c-f5c7-4b68-9309-f3eb38a390ce None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:10.846552 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e593c-f5c7-4b68-9309-f3eb38a390ce None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:10.847172 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e593c-f5c7-4b68-9309-f3eb38a390ce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:10.847468 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e593c-f5c7-4b68-9309-f3eb38a390ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:10.848865 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e593c-f5c7-4b68-9309-f3eb38a390ce None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:10.858072 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 132/259] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:30:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:10.867457 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e593c-f5c7-4b68-9309-f3eb38a390ce None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:10.995616 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca40fb-9d7a-4871-af7b-d472629e5d97 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:11.049740 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee41bb-2efb-4160-b2fb-38531e284b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:11.050052 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee41bb-2efb-4160-b2fb-38531e284b13 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:11.050226 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee41bb-2efb-4160-b2fb-38531e284b13 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:11.050492 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee41bb-2efb-4160-b2fb-38531e284b13 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:11.064893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ee41bb-2efb-4160-b2fb-38531e284b13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:30:11.074619 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-b1ee41bb-2efb-4160-b2fb-38531e284b13 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:30:11.074619 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:11.074619 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:11.074619 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:11.074619 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:11.074619 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:11.074619 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:11.074619 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:11.074619 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:11.074619 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:11.074619 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:11.074619 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:11.074619 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:30:11.074619 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:30:11.074619 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:30:11.074619 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:30:11.076803 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:30:11.076803 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:30:11.076803 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:30:11.076803 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:30:11.076803 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:11.076803 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:11.076803 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:11.076803 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:11.076803 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:11.076803 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:11.076803 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:11.076803 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:11.076803 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:11.076803 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:11.076803 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:11.076803 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:11.078820 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:11.078820 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:11.078820 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:11.078820 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:11.078820 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:30:11.078820 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:30:11.078820 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:30:11.078820 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:30:11.078820 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:30:11.078820 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:30:11.078820 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:30:11.078820 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:30:11.078820 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 128/260] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 26 07:30:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 07:30:11.087018 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee41bb-2efb-4160-b2fb-38531e284b13 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:11.087230 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e593c-f5c7-4b68-9309-f3eb38a390ce None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:11.172573 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98fc081-2f14-48aa-a6d8-b63f8cc8b45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:11.173235 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fc081-2f14-48aa-a6d8-b63f8cc8b45d None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:11.173678 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:11.175318 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fc081-2f14-48aa-a6d8-b63f8cc8b45d None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:11.175596 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fc081-2f14-48aa-a6d8-b63f8cc8b45d None admin] PATH_INFO: `/v3/users/863db75ec4434daea0b315b557b9a91e` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:11.179747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98fc081-2f14-48aa-a6d8-b63f8cc8b45d None admin] RBAC: Authorizing `identity:get_user(user_id=863db75ec4434daea0b315b557b9a91e)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:11.181349 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98fc081-2f14-48aa-a6d8-b63f8cc8b45d None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:11.187251 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 133/261] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:30:10 2022] GET /identity/v3/users/863db75ec4434daea0b315b557b9a91e => generated 283 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:11.189344 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98fc081-2f14-48aa-a6d8-b63f8cc8b45d None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:11.219333 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:11.245815 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee41bb-2efb-4160-b2fb-38531e284b13 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:11.313555 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282061aa-efac-4767-a138-457a0aafe31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:11.314489 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282061aa-efac-4767-a138-457a0aafe31d None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:11.315605 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282061aa-efac-4767-a138-457a0aafe31d None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:11.316061 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282061aa-efac-4767-a138-457a0aafe31d None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:11.316966 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282061aa-efac-4767-a138-457a0aafe31d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:11.317772 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282061aa-efac-4767-a138-457a0aafe31d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:11.320265 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282061aa-efac-4767-a138-457a0aafe31d None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:11.335418 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 129/262] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:30:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:11.348159 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282061aa-efac-4767-a138-457a0aafe31d None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:11.429841 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98fc081-2f14-48aa-a6d8-b63f8cc8b45d None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:11.517148 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282061aa-efac-4767-a138-457a0aafe31d None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:11.520825 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0355f2a-849b-4e79-8710-4672169450b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:11.521734 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0355f2a-849b-4e79-8710-4672169450b5 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:11.522198 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0355f2a-849b-4e79-8710-4672169450b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:11.522684 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0355f2a-849b-4e79-8710-4672169450b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:11.562403 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:11.587810 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1506d2-d202-4432-bc57-46c7ed4d2036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:11.588376 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1506d2-d202-4432-bc57-46c7ed4d2036 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:11.588657 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1506d2-d202-4432-bc57-46c7ed4d2036 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:11.588933 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1506d2-d202-4432-bc57-46c7ed4d2036 None admin] PATH_INFO: `/v3/users/863db75ec4434daea0b315b557b9a91e` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:11.592550 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1506d2-d202-4432-bc57-46c7ed4d2036 None admin] RBAC: Authorizing `identity:get_user(user_id=863db75ec4434daea0b315b557b9a91e)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:11.592550 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1506d2-d202-4432-bc57-46c7ed4d2036 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:11.595113 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 130/263] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:30:11 2022] GET /identity/v3/users/863db75ec4434daea0b315b557b9a91e => generated 283 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:11.600021 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1506d2-d202-4432-bc57-46c7ed4d2036 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:11.662794 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0355f2a-849b-4e79-8710-4672169450b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:11.664806 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0355f2a-849b-4e79-8710-4672169450b5 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:11.685274 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:11.832098 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 134/264] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:30:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 643 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 07:30:11.841755 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0355f2a-849b-4e79-8710-4672169450b5 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:11.844724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1506d2-d202-4432-bc57-46c7ed4d2036 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:11.907591 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31239a1a-6975-47dc-8c29-6821e22c69a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:11.909297 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31239a1a-6975-47dc-8c29-6821e22c69a8 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:11.909571 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31239a1a-6975-47dc-8c29-6821e22c69a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:11.909800 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31239a1a-6975-47dc-8c29-6821e22c69a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:12.049172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:12.055135 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0355f2a-849b-4e79-8710-4672169450b5 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:12.073681 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:12.075803 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31239a1a-6975-47dc-8c29-6821e22c69a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:12.077315 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31239a1a-6975-47dc-8c29-6821e22c69a8 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:12.120041 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a61ee-8a98-4c85-bace-0abd4f14c352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:12.120691 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a61ee-8a98-4c85-bace-0abd4f14c352 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:12.120969 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a61ee-8a98-4c85-bace-0abd4f14c352 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:12.121239 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a61ee-8a98-4c85-bace-0abd4f14c352 None admin] PATH_INFO: `/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:12.123595 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a61ee-8a98-4c85-bace-0abd4f14c352 None admin] RBAC: Authorizing `identity:get_project(project_id=b59ea18f7e2d4d2dbe387a2dbc161c67)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:12.125068 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a61ee-8a98-4c85-bace-0abd4f14c352 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:12.127261 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 135/265] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:30:11 2022] GET /identity/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67 => generated 302 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:30:12.140917 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a61ee-8a98-4c85-bace-0abd4f14c352 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:12.274917 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 131/266] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:30:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 675 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 07:30:12.280059 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31239a1a-6975-47dc-8c29-6821e22c69a8 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:12.284628 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a61ee-8a98-4c85-bace-0abd4f14c352 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:12.326845 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4203d-2dc4-44ae-b2ec-77c7a1bc63ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:12.328029 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4203d-2dc4-44ae-b2ec-77c7a1bc63ac None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:12.328904 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4203d-2dc4-44ae-b2ec-77c7a1bc63ac None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:12.329506 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4203d-2dc4-44ae-b2ec-77c7a1bc63ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:12.332058 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad4203d-2dc4-44ae-b2ec-77c7a1bc63ac None admin] RBAC: Adding query filter params (role.id=865b733dc94e43589d2385826a23e137, scope.project.id=b59ea18f7e2d4d2dbe387a2dbc161c67, user.id=863db75ec4434daea0b315b557b9a91e) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:12.332982 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad4203d-2dc4-44ae-b2ec-77c7a1bc63ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:12.334732 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad4203d-2dc4-44ae-b2ec-77c7a1bc63ac None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:12.343569 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 136/267] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:30:12 2022] GET /identity/v3/role_assignments?user.id=863db75ec4434daea0b315b557b9a91e&scope.project.id=b59ea18f7e2d4d2dbe387a2dbc161c67&role.id=865b733dc94e43589d2385826a23e137 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:12.397197 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:12.411435 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31239a1a-6975-47dc-8c29-6821e22c69a8 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:12.472983 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd01283-b6c9-4a71-b12f-097864584e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:12.473650 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd01283-b6c9-4a71-b12f-097864584e66 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:12.473930 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd01283-b6c9-4a71-b12f-097864584e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:12.474206 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd01283-b6c9-4a71-b12f-097864584e66 None admin] PATH_INFO: `/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:12.475398 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd01283-b6c9-4a71-b12f-097864584e66 None admin] RBAC: Authorizing `identity:get_project(project_id=b59ea18f7e2d4d2dbe387a2dbc161c67)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:12.476876 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd01283-b6c9-4a71-b12f-097864584e66 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:12.478513 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 132/268] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:30:12 2022] GET /identity/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:12.484964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4203d-2dc4-44ae-b2ec-77c7a1bc63ac None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:12.573400 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:12.654641 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4203d-2dc4-44ae-b2ec-77c7a1bc63ac None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:12.710295 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5661cf6-e84a-4871-b79e-02629bd77705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:12.710970 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5661cf6-e84a-4871-b79e-02629bd77705 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:12.711240 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5661cf6-e84a-4871-b79e-02629bd77705 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:12.711489 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5661cf6-e84a-4871-b79e-02629bd77705 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:12.712227 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5661cf6-e84a-4871-b79e-02629bd77705 None admin] RBAC: Adding query filter params (role.id=07ed857b2feb472f9fa9e7fe0b08582b, scope.project.id=b59ea18f7e2d4d2dbe387a2dbc161c67, user.id=863db75ec4434daea0b315b557b9a91e) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:12.712529 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5661cf6-e84a-4871-b79e-02629bd77705 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:12.713976 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5661cf6-e84a-4871-b79e-02629bd77705 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:12.720764 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 137/269] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:30:12 2022] GET /identity/v3/role_assignments?user.id=863db75ec4434daea0b315b557b9a91e&scope.project.id=b59ea18f7e2d4d2dbe387a2dbc161c67&role.id=07ed857b2feb472f9fa9e7fe0b08582b => generated 608 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:12.862170 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bfd3f-5e3f-40d8-aef5-c5ebe59210a7 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:12.862617 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bfd3f-5e3f-40d8-aef5-c5ebe59210a7 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:12.863084 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bfd3f-5e3f-40d8-aef5-c5ebe59210a7 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:12.865505 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 133/270] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:30:12.871080 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5434a0a-94ff-43d2-ae37-02e66c15404c None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:12.871451 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5434a0a-94ff-43d2-ae37-02e66c15404c None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:12.871666 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5434a0a-94ff-43d2-ae37-02e66c15404c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:12.893459 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f3506-aac7-43de-ae1f-20547155f972 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:12.893897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f3506-aac7-43de-ae1f-20547155f972 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:12.894128 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f3506-aac7-43de-ae1f-20547155f972 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:12.895520 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 134/271] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 07:30:12.902083 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438ed66-918b-484f-8008-381e4b2427c2 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:12.902348 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438ed66-918b-484f-8008-381e4b2427c2 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:12.902620 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438ed66-918b-484f-8008-381e4b2427c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:12.909343 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-e5434a0a-94ff-43d2-ae37-02e66c15404c None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:12.910634 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-e5434a0a-94ff-43d2-ae37-02e66c15404c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:12.934794 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-c438ed66-918b-484f-8008-381e4b2427c2 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:12.936033 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-c438ed66-918b-484f-8008-381e4b2427c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:13.030820 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 138/272] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:30:13.061718 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 135/273] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 07:30:13.221308 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df5c64-4d0d-4213-9c78-4a649ffafc70 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:13.221654 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df5c64-4d0d-4213-9c78-4a649ffafc70 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:13.221770 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df5c64-4d0d-4213-9c78-4a649ffafc70 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:13.223406 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 139/274] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:30:13.229090 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135be90c-0c08-4f61-926e-6fbb89dfae5a None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:13.229366 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135be90c-0c08-4f61-926e-6fbb89dfae5a None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:13.229636 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135be90c-0c08-4f61-926e-6fbb89dfae5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:13.251730 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-135be90c-0c08-4f61-926e-6fbb89dfae5a None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:13.252935 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-135be90c-0c08-4f61-926e-6fbb89dfae5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:13.334215 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df5c64-4d0d-4213-9c78-4a649ffafc70 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:13.339480 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 136/275] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:30:13.340415 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135be90c-0c08-4f61-926e-6fbb89dfae5a None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:13.367290 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:13.374534 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:13.466066 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df5c64-4d0d-4213-9c78-4a649ffafc70 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:13.475050 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135be90c-0c08-4f61-926e-6fbb89dfae5a None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:13.514613 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79e287-abfc-4b4e-ab13-e9f7060e51ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:13.515292 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79e287-abfc-4b4e-ab13-e9f7060e51ac None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:13.515572 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79e287-abfc-4b4e-ab13-e9f7060e51ac None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:13.515839 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79e287-abfc-4b4e-ab13-e9f7060e51ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:13.528833 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79e287-abfc-4b4e-ab13-e9f7060e51ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:30:13.530285 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f2fe7-dc55-4465-82ca-e2479f9f6d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:13.531488 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f2fe7-dc55-4465-82ca-e2479f9f6d28 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:13.532243 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f2fe7-dc55-4465-82ca-e2479f9f6d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:13.532832 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f2fe7-dc55-4465-82ca-e2479f9f6d28 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:13.534372 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-3c79e287-abfc-4b4e-ab13-e9f7060e51ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 07:30:13.534372 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:13.534372 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:13.534372 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:13.534372 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:13.534372 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:13.534372 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:13.534372 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:13.534372 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:13.534372 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:13.534372 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:13.534372 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:13.534372 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:30:13.534372 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:30:13.534372 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:30:13.534372 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:30:13.536020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:30:13.536020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:30:13.536020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:30:13.536020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:30:13.536020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:13.536020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:13.536020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:13.536020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:13.536020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:13.536020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:13.536020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:13.536020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:13.536020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:13.536020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:13.536020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:13.536020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:13.537468 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:13.537468 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:13.537468 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:13.537468 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:13.537468 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:30:13.537468 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:30:13.537468 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:30:13.537468 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:30:13.537468 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:30:13.537468 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:30:13.537468 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 07:30:13.537468 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:30:13.537468 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 140/276] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:30:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 07:30:13.537468 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a594dc3-4353-404e-8966-0cac53dbac46 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:13.538736 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a594dc3-4353-404e-8966-0cac53dbac46 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:13.538736 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a594dc3-4353-404e-8966-0cac53dbac46 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:13.538736 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 141/277] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:30:13.541373 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f2fe7-dc55-4465-82ca-e2479f9f6d28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:13.541596 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a594dc3-4353-404e-8966-0cac53dbac46 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:13.543617 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f2fe7-dc55-4465-82ca-e2479f9f6d28 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:13.545664 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 137/278] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:30:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:13.547691 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec7ab8-b95a-41d7-b43e-c96d5d49eeae None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:13.547976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec7ab8-b95a-41d7-b43e-c96d5d49eeae None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:13.548255 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec7ab8-b95a-41d7-b43e-c96d5d49eeae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:13.571256 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-d2ec7ab8-b95a-41d7-b43e-c96d5d49eeae None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:13.572512 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-d2ec7ab8-b95a-41d7-b43e-c96d5d49eeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:13.646169 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 138/279] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:30:13.646967 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec7ab8-b95a-41d7-b43e-c96d5d49eeae None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:13.666931 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:13.667631 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:13.676907 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a594dc3-4353-404e-8966-0cac53dbac46 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:13.717405 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba4442-89ee-43ac-a677-2f26c0f3dd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:13.718471 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba4442-89ee-43ac-a677-2f26c0f3dd7a None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:13.718471 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba4442-89ee-43ac-a677-2f26c0f3dd7a None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:13.718699 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba4442-89ee-43ac-a677-2f26c0f3dd7a None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:13.719341 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba4442-89ee-43ac-a677-2f26c0f3dd7a None admin] RBAC: Adding query filter params (name=member) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:13.719651 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba4442-89ee-43ac-a677-2f26c0f3dd7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:13.721693 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba4442-89ee-43ac-a677-2f26c0f3dd7a None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:13.732085 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 142/280] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 26 07:30:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:30:13.732367 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba4442-89ee-43ac-a677-2f26c0f3dd7a None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:13.784293 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec7ab8-b95a-41d7-b43e-c96d5d49eeae None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:13.827316 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a333b8ef-5565-48bd-ad54-f73da10c3371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:13.828073 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333b8ef-5565-48bd-ad54-f73da10c3371 None admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:13.828352 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333b8ef-5565-48bd-ad54-f73da10c3371 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:13.828624 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333b8ef-5565-48bd-ad54-f73da10c3371 None admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:13.829279 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a333b8ef-5565-48bd-ad54-f73da10c3371 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:13.831541 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a333b8ef-5565-48bd-ad54-f73da10c3371 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:13.860591 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba4442-89ee-43ac-a677-2f26c0f3dd7a None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:13.895438 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb283b4-c38f-400e-abaa-66826f644d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:13.896023 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb283b4-c38f-400e-abaa-66826f644d77 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:13.896291 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb283b4-c38f-400e-abaa-66826f644d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:13.896559 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb283b4-c38f-400e-abaa-66826f644d77 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:13.906895 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb283b4-c38f-400e-abaa-66826f644d77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:30:13.912844 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-fcb283b4-c38f-400e-abaa-66826f644d77 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 07:30:13.912844 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:13.912844 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:13.912844 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:13.912844 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:13.912844 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:13.912844 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:13.912844 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:13.912844 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:13.912844 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:13.912844 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:13.912844 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:13.912844 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:30:13.912844 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:30:13.912844 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:30:13.912844 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:30:13.913812 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:30:13.913812 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:30:13.913812 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:30:13.913812 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:30:13.913812 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:13.913812 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:13.913812 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:13.913812 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:13.913812 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:13.913812 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:13.913812 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:13.913812 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:13.913812 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:13.913812 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:13.913812 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:13.913812 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:13.914614 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:13.914614 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:13.914614 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:13.914614 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:13.914614 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:30:13.914614 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:30:13.914614 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:30:13.914614 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:30:13.914614 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:30:13.914614 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:30:13.914614 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 07:30:13.914614 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:30:13.931325 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 143/281] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:30:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:13.931325 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb283b4-c38f-400e-abaa-66826f644d77 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:13.938919 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:13.971669 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 139/282] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 26 07:30:13 2022] POST /identity/v3/users => generated 293 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:30:13.977122 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a333b8ef-5565-48bd-ad54-f73da10c3371 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:14.036481 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb283b4-c38f-400e-abaa-66826f644d77 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:14.077953 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea318cf6-4564-4ccb-b914-674cf36725fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:14.078611 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea318cf6-4564-4ccb-b914-674cf36725fd None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:14.078892 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea318cf6-4564-4ccb-b914-674cf36725fd None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:14.079296 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea318cf6-4564-4ccb-b914-674cf36725fd None admin] PATH_INFO: `/v3/users/fcad4246722e4e48aa584f49415f5448` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:14.098753 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:14.100519 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea318cf6-4564-4ccb-b914-674cf36725fd None admin] RBAC: Authorizing `identity:get_user(user_id=fcad4246722e4e48aa584f49415f5448)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:14.102066 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea318cf6-4564-4ccb-b914-674cf36725fd None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:14.104153 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 144/283] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:30:13 2022] GET /identity/v3/users/fcad4246722e4e48aa584f49415f5448 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:14.104697 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea318cf6-4564-4ccb-b914-674cf36725fd None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:14.135562 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a333b8ef-5565-48bd-ad54-f73da10c3371 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:14.180998 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936575d6-167e-4f83-b5b8-0f7a2fda662f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:14.180998 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936575d6-167e-4f83-b5b8-0f7a2fda662f None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:14.180998 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936575d6-167e-4f83-b5b8-0f7a2fda662f None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:14.180998 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936575d6-167e-4f83-b5b8-0f7a2fda662f None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:14.181396 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936575d6-167e-4f83-b5b8-0f7a2fda662f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:14.181463 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936575d6-167e-4f83-b5b8-0f7a2fda662f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:14.183334 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936575d6-167e-4f83-b5b8-0f7a2fda662f None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:14.193201 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 140/284] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 26 07:30:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:14.194393 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936575d6-167e-4f83-b5b8-0f7a2fda662f None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:14.198590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:14.233254 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea318cf6-4564-4ccb-b914-674cf36725fd None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:14.282226 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d64e5-65c0-443c-a159-e7c0a88d6c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:14.282943 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d64e5-65c0-443c-a159-e7c0a88d6c3f None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:14.283384 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d64e5-65c0-443c-a159-e7c0a88d6c3f None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:14.283738 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d64e5-65c0-443c-a159-e7c0a88d6c3f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:14.296141 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d64e5-65c0-443c-a159-e7c0a88d6c3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:30:14.301169 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-0b3d64e5-65c0-443c-a159-e7c0a88d6c3f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 07:30:14.301169 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:14.301169 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:14.301169 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:14.301169 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:14.301169 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:14.301169 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:14.301169 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:14.301169 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:14.301169 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:14.301169 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:14.301169 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:14.301169 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:30:14.301169 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:30:14.301169 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:30:14.301169 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:30:14.302053 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:30:14.302053 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:30:14.302053 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:30:14.302053 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:30:14.302053 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:14.302053 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:14.302053 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:14.302053 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:14.302053 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:14.302053 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:14.302053 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:14.302053 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:14.302053 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:14.302053 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:14.302053 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:14.302053 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:14.302823 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:14.302823 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:14.302823 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:14.302823 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:14.302823 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:30:14.302823 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:30:14.302823 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:30:14.302823 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:30:14.302823 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:30:14.302823 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:30:14.302823 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 07:30:14.302823 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:30:14.303922 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 145/285] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:30:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:14.303922 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d64e5-65c0-443c-a159-e7c0a88d6c3f None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:14.342887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936575d6-167e-4f83-b5b8-0f7a2fda662f None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:14.396012 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18123d10-bac1-40a5-9fec-f1e2370c99f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:14.396876 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18123d10-bac1-40a5-9fec-f1e2370c99f6 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:14.397359 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18123d10-bac1-40a5-9fec-f1e2370c99f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:14.397839 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18123d10-bac1-40a5-9fec-f1e2370c99f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:14.398745 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18123d10-bac1-40a5-9fec-f1e2370c99f6 None admin] RBAC: Adding query filter params (role.id=854d2a8e89d94d8685ff7d5dc70494b5, user.id=fcad4246722e4e48aa584f49415f5448, scope.system=all) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:14.399303 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18123d10-bac1-40a5-9fec-f1e2370c99f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:14.400950 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18123d10-bac1-40a5-9fec-f1e2370c99f6 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:14.406628 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 141/286] 10.222.0.42 () {56 vars in 1308 bytes} [Fri Aug 26 07:30:14 2022] GET /identity/v3/role_assignments?user.id=fcad4246722e4e48aa584f49415f5448&scope.system=all&role.id=854d2a8e89d94d8685ff7d5dc70494b5 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:14.407935 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18123d10-bac1-40a5-9fec-f1e2370c99f6 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:14.412344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:14.442025 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d64e5-65c0-443c-a159-e7c0a88d6c3f None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:14.483182 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ca7e0-4f68-4ec1-bef7-e412f529af17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:14.483956 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ca7e0-4f68-4ec1-bef7-e412f529af17 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:14.484310 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ca7e0-4f68-4ec1-bef7-e412f529af17 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:14.484848 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ca7e0-4f68-4ec1-bef7-e412f529af17 None admin] PATH_INFO: `/v3/users/0fc9186da0164146965ccc92672459fa` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:14.488267 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ca7e0-4f68-4ec1-bef7-e412f529af17 None admin] RBAC: Authorizing `identity:get_user(user_id=0fc9186da0164146965ccc92672459fa)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:14.490046 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ca7e0-4f68-4ec1-bef7-e412f529af17 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:14.492675 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 146/287] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:30:14 2022] GET /identity/v3/users/0fc9186da0164146965ccc92672459fa => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:14.498116 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ca7e0-4f68-4ec1-bef7-e412f529af17 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:14.512046 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:14.527089 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18123d10-bac1-40a5-9fec-f1e2370c99f6 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:14.567986 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e72a84-5ace-4457-8beb-9aba3fb28c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:14.568502 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e72a84-5ace-4457-8beb-9aba3fb28c3b None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:14.568776 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e72a84-5ace-4457-8beb-9aba3fb28c3b None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:14.569048 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e72a84-5ace-4457-8beb-9aba3fb28c3b None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:14.569777 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e72a84-5ace-4457-8beb-9aba3fb28c3b None admin] RBAC: Adding query filter params (name=member) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:14.570082 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e72a84-5ace-4457-8beb-9aba3fb28c3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:14.571562 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e72a84-5ace-4457-8beb-9aba3fb28c3b None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:14.581662 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 142/288] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 26 07:30:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:14.592486 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e72a84-5ace-4457-8beb-9aba3fb28c3b None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:14.674122 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ca7e0-4f68-4ec1-bef7-e412f529af17 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:14.699467 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:14.737305 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015d06d-cf83-4bf8-8d8b-002ecfbadf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:14.738690 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015d06d-cf83-4bf8-8d8b-002ecfbadf4f None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:14.739233 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015d06d-cf83-4bf8-8d8b-002ecfbadf4f None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:14.739720 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015d06d-cf83-4bf8-8d8b-002ecfbadf4f None admin] PATH_INFO: `/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:14.742834 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5015d06d-cf83-4bf8-8d8b-002ecfbadf4f None admin] RBAC: Authorizing `identity:get_project(project_id=b59ea18f7e2d4d2dbe387a2dbc161c67)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:14.744556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5015d06d-cf83-4bf8-8d8b-002ecfbadf4f None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:14.746728 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 147/289] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:30:14 2022] GET /identity/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67 => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:30:14.753095 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e72a84-5ace-4457-8beb-9aba3fb28c3b None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:14.754109 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015d06d-cf83-4bf8-8d8b-002ecfbadf4f None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:14.807670 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ea736-6cfc-424a-83f7-1048aed2c873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:14.808636 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ea736-6cfc-424a-83f7-1048aed2c873 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:14.810395 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ea736-6cfc-424a-83f7-1048aed2c873 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:14.811658 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ea736-6cfc-424a-83f7-1048aed2c873 None admin] PATH_INFO: `/v3/users/7a6f5a86bf7f4792931353b69f8f7210` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:14.813920 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ea736-6cfc-424a-83f7-1048aed2c873 None admin] RBAC: Authorizing `identity:get_user(user_id=7a6f5a86bf7f4792931353b69f8f7210)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:14.818369 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ea736-6cfc-424a-83f7-1048aed2c873 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:14.822223 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 143/290] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:30:14 2022] GET /identity/v3/users/7a6f5a86bf7f4792931353b69f8f7210 => generated 297 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:30:14.835104 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ea736-6cfc-424a-83f7-1048aed2c873 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:14.890870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:14.948405 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015d06d-cf83-4bf8-8d8b-002ecfbadf4f None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:15.006886 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c70211-07f8-4a15-b165-29e6f037f093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:15.008072 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c70211-07f8-4a15-b165-29e6f037f093 None admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:15.008553 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c70211-07f8-4a15-b165-29e6f037f093 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:15.009029 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c70211-07f8-4a15-b165-29e6f037f093 None admin] PATH_INFO: `/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67/users/0fc9186da0164146965ccc92672459fa/roles/33d4ab731cf74a3ca8d583700668949d` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:15.012313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c70211-07f8-4a15-b165-29e6f037f093 None admin] RBAC: Authorizing `identity:create_grant(project_id=b59ea18f7e2d4d2dbe387a2dbc161c67, user_id=0fc9186da0164146965ccc92672459fa, role_id=33d4ab731cf74a3ca8d583700668949d)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:15.015110 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c70211-07f8-4a15-b165-29e6f037f093 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:15.063410 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ea736-6cfc-424a-83f7-1048aed2c873 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:15.119636 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 148/291] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 26 07:30:14 2022] PUT /identity/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67/users/0fc9186da0164146965ccc92672459fa/roles/33d4ab731cf74a3ca8d583700668949d => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:30:15.130756 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:15.141508 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb7192-ea4d-46fd-97e6-4801f918aca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:15.144493 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb7192-ea4d-46fd-97e6-4801f918aca5 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:15.144493 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb7192-ea4d-46fd-97e6-4801f918aca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:15.144493 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb7192-ea4d-46fd-97e6-4801f918aca5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:15.260083 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bb7192-ea4d-46fd-97e6-4801f918aca5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:15.262563 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bb7192-ea4d-46fd-97e6-4801f918aca5 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:15.440758 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 144/292] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:30:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 07:30:15.449455 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c70211-07f8-4a15-b165-29e6f037f093 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:15.651289 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c70211-07f8-4a15-b165-29e6f037f093 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:15.706273 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:15.719967 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7aab83-c24d-44d9-a0e1-fbd4a9c7a25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:15.721655 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7aab83-c24d-44d9-a0e1-fbd4a9c7a25a None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:15.722129 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7aab83-c24d-44d9-a0e1-fbd4a9c7a25a None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:15.722600 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7aab83-c24d-44d9-a0e1-fbd4a9c7a25a None admin] PATH_INFO: `/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:15.728284 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7aab83-c24d-44d9-a0e1-fbd4a9c7a25a None admin] RBAC: Authorizing `identity:get_project(project_id=b59ea18f7e2d4d2dbe387a2dbc161c67)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:15.731253 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7aab83-c24d-44d9-a0e1-fbd4a9c7a25a None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:15.734531 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 149/293] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:30:15 2022] GET /identity/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67 => generated 302 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:15.743705 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb7192-ea4d-46fd-97e6-4801f918aca5 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:15.828606 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:15.968976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb7192-ea4d-46fd-97e6-4801f918aca5 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:16.029713 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04879872-71f2-4cd2-95b1-3efd80c91a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:16.030728 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04879872-71f2-4cd2-95b1-3efd80c91a09 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:16.031237 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04879872-71f2-4cd2-95b1-3efd80c91a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:16.031695 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04879872-71f2-4cd2-95b1-3efd80c91a09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:16.033603 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04879872-71f2-4cd2-95b1-3efd80c91a09 None admin] RBAC: Adding query filter params (role.id=854d2a8e89d94d8685ff7d5dc70494b5, scope.project.id=b59ea18f7e2d4d2dbe387a2dbc161c67, user.id=7a6f5a86bf7f4792931353b69f8f7210) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:16.034157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04879872-71f2-4cd2-95b1-3efd80c91a09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:16.036936 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04879872-71f2-4cd2-95b1-3efd80c91a09 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:16.047939 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 145/294] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:30:15 2022] GET /identity/v3/role_assignments?user.id=7a6f5a86bf7f4792931353b69f8f7210&scope.project.id=b59ea18f7e2d4d2dbe387a2dbc161c67&role.id=854d2a8e89d94d8685ff7d5dc70494b5 => generated 608 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:16.465875 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57844de8-dd79-4a10-9bb2-34bd2650551c None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:16.466415 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57844de8-dd79-4a10-9bb2-34bd2650551c None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:16.466415 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57844de8-dd79-4a10-9bb2-34bd2650551c None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:16.467773 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 150/295] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:30:16.473914 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd0b30-c26a-4788-b603-e6a953b86da4 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:16.474398 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd0b30-c26a-4788-b603-e6a953b86da4 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:16.474475 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd0b30-c26a-4788-b603-e6a953b86da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:16.494701 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-15dd0b30-c26a-4788-b603-e6a953b86da4 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:16.496158 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-15dd0b30-c26a-4788-b603-e6a953b86da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:16.582680 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 146/296] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 07:30:16.874626 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57844de8-dd79-4a10-9bb2-34bd2650551c None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:16.993902 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57844de8-dd79-4a10-9bb2-34bd2650551c None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:17.033513 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4095b440-904f-4582-871f-3f73d8336f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:17.034074 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095b440-904f-4582-871f-3f73d8336f20 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:17.034397 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095b440-904f-4582-871f-3f73d8336f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:17.034716 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095b440-904f-4582-871f-3f73d8336f20 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:17.036660 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4095b440-904f-4582-871f-3f73d8336f20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:17.038362 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4095b440-904f-4582-871f-3f73d8336f20 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:17.040405 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 151/297] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:30:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:17.046084 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd0b30-c26a-4788-b603-e6a953b86da4 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:17.061825 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddccddf-19a7-43a5-a152-697b32702a0c None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:17.062159 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddccddf-19a7-43a5-a152-697b32702a0c None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:17.062354 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddccddf-19a7-43a5-a152-697b32702a0c None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:17.064709 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 152/298] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 07:30:17.070170 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672c0d4-d498-4759-abea-d2cfaedc7c58 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:17.070479 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672c0d4-d498-4759-abea-d2cfaedc7c58 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:17.070750 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672c0d4-d498-4759-abea-d2cfaedc7c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:17.078394 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:17.091380 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-9672c0d4-d498-4759-abea-d2cfaedc7c58 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:17.092606 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-9672c0d4-d498-4759-abea-d2cfaedc7c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:17.165378 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:17.173632 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 153/299] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:30:17.175289 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819387f-b43e-4b43-9263-5918af4263e5 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:17.175431 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819387f-b43e-4b43-9263-5918af4263e5 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:17.175813 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819387f-b43e-4b43-9263-5918af4263e5 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:17.177124 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 154/300] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:30:17.184345 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd0b30-c26a-4788-b603-e6a953b86da4 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:17.188423 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6810da-c28c-46da-adba-69622dcc5e42 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:17.188952 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6810da-c28c-46da-adba-69622dcc5e42 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:17.190342 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6810da-c28c-46da-adba-69622dcc5e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:17.212363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-5e6810da-c28c-46da-adba-69622dcc5e42 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:17.214051 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-5e6810da-c28c-46da-adba-69622dcc5e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:17.225582 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12154883-371f-4858-80c4-b98b889affd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:17.226253 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12154883-371f-4858-80c4-b98b889affd7 None admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:17.226533 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12154883-371f-4858-80c4-b98b889affd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:17.226801 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12154883-371f-4858-80c4-b98b889affd7 None admin] PATH_INFO: `/v3/groups` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:17.227491 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12154883-371f-4858-80c4-b98b889affd7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:17.229007 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12154883-371f-4858-80c4-b98b889affd7 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:17.303128 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 155/301] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:30:17.310384 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 147/302] 10.222.0.42 () {60 vars in 1134 bytes} [Fri Aug 26 07:30:17 2022] POST /identity/v3/groups => generated 229 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:30:17.457609 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6810da-c28c-46da-adba-69622dcc5e42 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:17.575084 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12154883-371f-4858-80c4-b98b889affd7 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:17.581133 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6810da-c28c-46da-adba-69622dcc5e42 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:17.613235 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:17.624300 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c9d27e-1748-493e-b6db-727e04384681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:17.625489 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9d27e-1748-493e-b6db-727e04384681 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:17.625897 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9d27e-1748-493e-b6db-727e04384681 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:17.626349 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9d27e-1748-493e-b6db-727e04384681 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:17.638906 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c9d27e-1748-493e-b6db-727e04384681 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:30:17.646875 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-e4c9d27e-1748-493e-b6db-727e04384681 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 07:30:17.646875 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:17.646875 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:17.646875 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:17.646875 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:17.646875 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:17.646875 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:17.646875 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:17.646875 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:17.646875 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:17.646875 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:17.646875 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:17.646875 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:30:17.646875 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:30:17.646875 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:30:17.646875 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:30:17.648365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:30:17.648365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:30:17.648365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:30:17.648365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:30:17.648365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:17.648365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:17.648365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:17.648365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:17.648365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:17.648365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:17.648365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:17.648365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:17.648365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:17.648365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:17.648365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:17.648365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:17.649413 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:17.649413 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:17.649413 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:17.649413 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:17.649413 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:30:17.649413 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:30:17.649413 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:30:17.649413 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:30:17.649413 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:30:17.649413 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:30:17.649413 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 07:30:17.649413 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:30:17.653301 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 156/303] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:30:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:17.661398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c9d27e-1748-493e-b6db-727e04384681 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:17.689997 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:17.711352 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12154883-371f-4858-80c4-b98b889affd7 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:17.769308 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4e2b9-87fe-4d2b-a51f-5fc35f338089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:17.769957 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4e2b9-87fe-4d2b-a51f-5fc35f338089 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:17.770233 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4e2b9-87fe-4d2b-a51f-5fc35f338089 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:17.770500 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4e2b9-87fe-4d2b-a51f-5fc35f338089 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:17.781398 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a4e2b9-87fe-4d2b-a51f-5fc35f338089 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:30:17.787689 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-16a4e2b9-87fe-4d2b-a51f-5fc35f338089 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 07:30:17.787689 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:17.787689 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:17.787689 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:17.787689 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:17.787689 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:17.787689 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:17.787689 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:17.787689 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:17.787689 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:17.787689 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:17.787689 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:17.787689 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:30:17.787689 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:30:17.787689 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:30:17.787689 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:30:17.788723 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:30:17.788723 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:30:17.788723 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:30:17.788723 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:30:17.788723 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:17.788723 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:17.788723 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:17.788723 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:17.788723 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:17.788723 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:17.788723 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:17.788723 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:17.788723 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:17.788723 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:17.788723 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:17.788723 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:17.789535 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:17.789535 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:17.789535 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:17.789535 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:17.789535 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:30:17.789535 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:30:17.789535 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:30:17.789535 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:30:17.789535 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:30:17.789535 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:30:17.789535 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 07:30:17.789535 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:30:17.789535 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 148/304] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:30:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 07:30:17.792265 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325cb18-73e1-4edb-a48f-5320f978cd1c None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:17.792790 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325cb18-73e1-4edb-a48f-5320f978cd1c None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:17.793262 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325cb18-73e1-4edb-a48f-5320f978cd1c None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:17.794805 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 149/305] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:30:17.795735 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325cb18-73e1-4edb-a48f-5320f978cd1c None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:17.831153 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c9d27e-1748-493e-b6db-727e04384681 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:17.882213 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1099bb2f-2430-4453-9dd8-e4f7d53da27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:17.882820 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099bb2f-2430-4453-9dd8-e4f7d53da27d None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:17.883123 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099bb2f-2430-4453-9dd8-e4f7d53da27d None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:17.883390 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099bb2f-2430-4453-9dd8-e4f7d53da27d None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:17.884050 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1099bb2f-2430-4453-9dd8-e4f7d53da27d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:17.884347 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1099bb2f-2430-4453-9dd8-e4f7d53da27d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:17.885709 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1099bb2f-2430-4453-9dd8-e4f7d53da27d None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:17.898908 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 157/306] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 26 07:30:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:17.900108 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7aacda-9819-457c-ac19-41a0702936df None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:17.900394 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7aacda-9819-457c-ac19-41a0702936df None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:17.900662 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7aacda-9819-457c-ac19-41a0702936df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:17.914873 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325cb18-73e1-4edb-a48f-5320f978cd1c None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:17.919100 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-4b7aacda-9819-457c-ac19-41a0702936df None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:17.920347 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-4b7aacda-9819-457c-ac19-41a0702936df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:17.957608 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573eb69-caa2-48d7-96d7-c5ae50ea59c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:17.958231 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573eb69-caa2-48d7-96d7-c5ae50ea59c5 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:17.958511 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573eb69-caa2-48d7-96d7-c5ae50ea59c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:17.958779 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573eb69-caa2-48d7-96d7-c5ae50ea59c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:17.959487 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4573eb69-caa2-48d7-96d7-c5ae50ea59c5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:17.959790 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4573eb69-caa2-48d7-96d7-c5ae50ea59c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:17.961193 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4573eb69-caa2-48d7-96d7-c5ae50ea59c5 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:17.973057 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 150/307] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 26 07:30:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:17.973465 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:17.974650 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573eb69-caa2-48d7-96d7-c5ae50ea59c5 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:17.992011 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:18.002487 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 158/308] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:30:18.003623 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7aacda-9819-457c-ac19-41a0702936df None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:18.109168 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573eb69-caa2-48d7-96d7-c5ae50ea59c5 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:18.155731 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7aacda-9819-457c-ac19-41a0702936df None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:18.156822 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60198238-cf7c-4b2a-8310-88392c785b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:18.158244 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60198238-cf7c-4b2a-8310-88392c785b43 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:18.158875 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60198238-cf7c-4b2a-8310-88392c785b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:18.159370 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60198238-cf7c-4b2a-8310-88392c785b43 None admin] PATH_INFO: `/v3/users/9f9821a24bef45b48c49b94fb2cba7f8` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:18.176949 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60198238-cf7c-4b2a-8310-88392c785b43 None admin] RBAC: Authorizing `identity:get_user(user_id=9f9821a24bef45b48c49b94fb2cba7f8)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:18.178829 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60198238-cf7c-4b2a-8310-88392c785b43 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:18.180973 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 151/309] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:30:17 2022] GET /identity/v3/users/9f9821a24bef45b48c49b94fb2cba7f8 => generated 293 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:18.187504 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60198238-cf7c-4b2a-8310-88392c785b43 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:18.196835 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c160df5-c24a-4797-866a-f3a22b0e137d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:18.197552 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c160df5-c24a-4797-866a-f3a22b0e137d None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:18.197817 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c160df5-c24a-4797-866a-f3a22b0e137d None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:18.198088 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c160df5-c24a-4797-866a-f3a22b0e137d None admin] PATH_INFO: `/v3/users/fcad4246722e4e48aa584f49415f5448` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:18.199275 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c160df5-c24a-4797-866a-f3a22b0e137d None admin] RBAC: Authorizing `identity:get_user(user_id=fcad4246722e4e48aa584f49415f5448)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:18.201260 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c160df5-c24a-4797-866a-f3a22b0e137d None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:18.203623 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 159/310] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:30:18 2022] GET /identity/v3/users/fcad4246722e4e48aa584f49415f5448 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:18.212495 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c160df5-c24a-4797-866a-f3a22b0e137d None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:18.261389 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:18.281486 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:18.313226 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60198238-cf7c-4b2a-8310-88392c785b43 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:18.346107 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c160df5-c24a-4797-866a-f3a22b0e137d None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:18.353065 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de4b72-7786-4807-8a8c-666d2c5120b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:18.353691 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de4b72-7786-4807-8a8c-666d2c5120b6 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:18.353974 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de4b72-7786-4807-8a8c-666d2c5120b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:18.354248 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de4b72-7786-4807-8a8c-666d2c5120b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:18.355001 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de4b72-7786-4807-8a8c-666d2c5120b6 None admin] RBAC: Adding query filter params (role.id=33d4ab731cf74a3ca8d583700668949d, user.id=9f9821a24bef45b48c49b94fb2cba7f8, scope.system=all) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:18.355316 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de4b72-7786-4807-8a8c-666d2c5120b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:18.356761 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de4b72-7786-4807-8a8c-666d2c5120b6 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:18.371133 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 152/311] 10.222.0.42 () {56 vars in 1308 bytes} [Fri Aug 26 07:30:18 2022] GET /identity/v3/role_assignments?user.id=9f9821a24bef45b48c49b94fb2cba7f8&scope.system=all&role.id=33d4ab731cf74a3ca8d583700668949d => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:18.371133 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de4b72-7786-4807-8a8c-666d2c5120b6 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:18.405905 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745c628-dc76-4a19-95f5-e4da400e29b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:18.407110 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745c628-dc76-4a19-95f5-e4da400e29b9 None admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:18.407648 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745c628-dc76-4a19-95f5-e4da400e29b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:18.408168 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745c628-dc76-4a19-95f5-e4da400e29b9 None admin] PATH_INFO: `/v3/system/users/fcad4246722e4e48aa584f49415f5448/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:18.410730 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7745c628-dc76-4a19-95f5-e4da400e29b9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fcad4246722e4e48aa584f49415f5448, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:18.414522 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7745c628-dc76-4a19-95f5-e4da400e29b9 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:18.511194 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de4b72-7786-4807-8a8c-666d2c5120b6 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:18.531013 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 160/312] 10.222.0.42 () {58 vars in 1334 bytes} [Fri Aug 26 07:30:18 2022] PUT /identity/v3/system/users/fcad4246722e4e48aa584f49415f5448/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:30:18.556317 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:18.571762 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec2ecfc-da40-4a40-9a5a-35014dd5e692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:18.572496 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2ecfc-da40-4a40-9a5a-35014dd5e692 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:18.572834 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2ecfc-da40-4a40-9a5a-35014dd5e692 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:18.573112 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2ecfc-da40-4a40-9a5a-35014dd5e692 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:18.592486 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec2ecfc-da40-4a40-9a5a-35014dd5e692 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:30:18.598133 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-bec2ecfc-da40-4a40-9a5a-35014dd5e692 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 07:30:18.598133 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:18.598133 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:18.598133 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:18.598133 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:18.598133 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:18.598133 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:18.598133 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:18.598133 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:18.598133 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:18.598133 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:18.598133 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:18.598133 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:30:18.598133 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:30:18.598133 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:30:18.598133 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:30:18.599120 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:30:18.599120 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:30:18.599120 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:30:18.599120 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:30:18.599120 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:18.599120 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:18.599120 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:18.599120 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:18.599120 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:18.599120 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:18.599120 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:18.599120 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:18.599120 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:18.599120 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:18.599120 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:18.599120 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:18.600191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:18.600191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:18.600191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:18.600191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:18.600191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:30:18.600191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:30:18.600191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:30:18.600191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:30:18.600191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:30:18.600191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:30:18.600191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 07:30:18.600191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:30:18.600191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 153/313] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:30:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:18.608524 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745c628-dc76-4a19-95f5-e4da400e29b9 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:18.753702 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745c628-dc76-4a19-95f5-e4da400e29b9 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:18.771753 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:18.798573 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb00584-0f64-4623-b9d6-c44db065af16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:18.799416 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb00584-0f64-4623-b9d6-c44db065af16 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:18.799743 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb00584-0f64-4623-b9d6-c44db065af16 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:18.800023 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb00584-0f64-4623-b9d6-c44db065af16 None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:18.800852 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb00584-0f64-4623-b9d6-c44db065af16 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:18.801168 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb00584-0f64-4623-b9d6-c44db065af16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:18.803304 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb00584-0f64-4623-b9d6-c44db065af16 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:18.818898 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 161/314] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 26 07:30:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:18.828124 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec2ecfc-da40-4a40-9a5a-35014dd5e692 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:18.952881 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec2ecfc-da40-4a40-9a5a-35014dd5e692 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:18.993206 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806401fd-a8e2-4a84-835b-8e9490271e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:18.993929 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806401fd-a8e2-4a84-835b-8e9490271e74 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:18.994214 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806401fd-a8e2-4a84-835b-8e9490271e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:18.994662 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806401fd-a8e2-4a84-835b-8e9490271e74 None admin] PATH_INFO: `/v3/users/0fc9186da0164146965ccc92672459fa` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:18.996369 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806401fd-a8e2-4a84-835b-8e9490271e74 None admin] RBAC: Authorizing `identity:get_user(user_id=0fc9186da0164146965ccc92672459fa)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:18.998024 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806401fd-a8e2-4a84-835b-8e9490271e74 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:19.000689 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 154/315] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:30:18 2022] GET /identity/v3/users/0fc9186da0164146965ccc92672459fa => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:19.007720 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb00584-0f64-4623-b9d6-c44db065af16 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:19.121477 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb00584-0f64-4623-b9d6-c44db065af16 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:19.160394 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d3909-fef9-46b3-8ee0-8a556fd37fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:19.161016 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d3909-fef9-46b3-8ee0-8a556fd37fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:19.161296 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d3909-fef9-46b3-8ee0-8a556fd37fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:19.161568 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d3909-fef9-46b3-8ee0-8a556fd37fb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:19.208336 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:19.236974 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d3909-fef9-46b3-8ee0-8a556fd37fb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:19.238606 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d3909-fef9-46b3-8ee0-8a556fd37fb9 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:19.346031 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 162/316] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:30:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 07:30:19.351486 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806401fd-a8e2-4a84-835b-8e9490271e74 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:19.412346 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:19.450715 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106bcd6-23c9-4601-881d-2e54cc35d90a None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:19.451055 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106bcd6-23c9-4601-881d-2e54cc35d90a None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:19.451310 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106bcd6-23c9-4601-881d-2e54cc35d90a None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:19.453991 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 163/317] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 07:30:19.460639 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136eb23-a8ba-45bc-aa2f-9d3199259a34 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:19.460914 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136eb23-a8ba-45bc-aa2f-9d3199259a34 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:19.461189 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136eb23-a8ba-45bc-aa2f-9d3199259a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:19.471400 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806401fd-a8e2-4a84-835b-8e9490271e74 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:19.481554 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-d136eb23-a8ba-45bc-aa2f-9d3199259a34 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:19.482864 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-d136eb23-a8ba-45bc-aa2f-9d3199259a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:19.516770 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594247c4-f973-44ff-a6f7-1d481d20d4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:19.518378 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594247c4-f973-44ff-a6f7-1d481d20d4ae None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:19.518663 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594247c4-f973-44ff-a6f7-1d481d20d4ae None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:19.519158 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594247c4-f973-44ff-a6f7-1d481d20d4ae None admin] PATH_INFO: `/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:19.520956 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594247c4-f973-44ff-a6f7-1d481d20d4ae None admin] RBAC: Authorizing `identity:get_project(project_id=b59ea18f7e2d4d2dbe387a2dbc161c67)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:19.522689 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594247c4-f973-44ff-a6f7-1d481d20d4ae None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:19.525138 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 155/318] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:30:19 2022] GET /identity/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:19.530884 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594247c4-f973-44ff-a6f7-1d481d20d4ae None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:19.574696 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 164/319] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 07:30:19.657045 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594247c4-f973-44ff-a6f7-1d481d20d4ae None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:19.683431 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:19.696323 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c796b98-47c9-4603-a507-080525cdb6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:19.702258 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c796b98-47c9-4603-a507-080525cdb6fd None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:19.702258 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c796b98-47c9-4603-a507-080525cdb6fd None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:19.702258 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c796b98-47c9-4603-a507-080525cdb6fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:19.702258 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c796b98-47c9-4603-a507-080525cdb6fd None admin] RBAC: Adding query filter params (role.id=33d4ab731cf74a3ca8d583700668949d, scope.project.id=b59ea18f7e2d4d2dbe387a2dbc161c67, user.id=0fc9186da0164146965ccc92672459fa) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:19.702258 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c796b98-47c9-4603-a507-080525cdb6fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:19.702258 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c796b98-47c9-4603-a507-080525cdb6fd None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:19.709317 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 156/320] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:30:19 2022] GET /identity/v3/role_assignments?user.id=0fc9186da0164146965ccc92672459fa&scope.project.id=b59ea18f7e2d4d2dbe387a2dbc161c67&role.id=33d4ab731cf74a3ca8d583700668949d => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:19.907693 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136eb23-a8ba-45bc-aa2f-9d3199259a34 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:19.909944 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:20.027513 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136eb23-a8ba-45bc-aa2f-9d3199259a34 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:20.066433 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226f108-233c-4844-b7a0-bdeb404015c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:20.067160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226f108-233c-4844-b7a0-bdeb404015c5 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:20.067441 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226f108-233c-4844-b7a0-bdeb404015c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:20.067974 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226f108-233c-4844-b7a0-bdeb404015c5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:20.069104 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9226f108-233c-4844-b7a0-bdeb404015c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:20.070539 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9226f108-233c-4844-b7a0-bdeb404015c5 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:20.072344 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 165/321] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:30:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:20.077793 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c796b98-47c9-4603-a507-080525cdb6fd None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:20.211728 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c796b98-47c9-4603-a507-080525cdb6fd None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:20.256223 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253517ee-3f4d-4be1-b6e7-23cbe16c6f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:20.256875 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253517ee-3f4d-4be1-b6e7-23cbe16c6f4d None admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:20.257204 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253517ee-3f4d-4be1-b6e7-23cbe16c6f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:20.257479 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253517ee-3f4d-4be1-b6e7-23cbe16c6f4d None admin] PATH_INFO: `/v3/groups` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:20.258129 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253517ee-3f4d-4be1-b6e7-23cbe16c6f4d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:20.259718 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253517ee-3f4d-4be1-b6e7-23cbe16c6f4d None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:20.338216 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 157/322] 10.222.0.42 () {60 vars in 1134 bytes} [Fri Aug 26 07:30:20 2022] POST /identity/v3/groups => generated 226 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:30:20.498289 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08983d-39f2-4988-aa9b-f89daac0a98a None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:20.498907 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08983d-39f2-4988-aa9b-f89daac0a98a None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:20.499455 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08983d-39f2-4988-aa9b-f89daac0a98a None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:20.501419 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 166/323] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:30:20.507501 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4661eb-5dae-44ea-ac45-72e2ad31ae53 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:20.507789 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4661eb-5dae-44ea-ac45-72e2ad31ae53 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:20.508057 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4661eb-5dae-44ea-ac45-72e2ad31ae53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:20.528059 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-bf4661eb-5dae-44ea-ac45-72e2ad31ae53 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:20.529309 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-bf4661eb-5dae-44ea-ac45-72e2ad31ae53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:20.588468 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:20.609358 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c51334-a52b-4ab9-aa8e-57aef2f9683a None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:20.609358 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c51334-a52b-4ab9-aa8e-57aef2f9683a None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:20.609358 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c51334-a52b-4ab9-aa8e-57aef2f9683a None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:20.610169 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 167/324] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 07:30:20.615786 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 158/325] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:30:20.617097 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed167ada-bfb1-494b-b843-d1f0ea031d1b None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:20.617595 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed167ada-bfb1-494b-b843-d1f0ea031d1b None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:20.618057 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed167ada-bfb1-494b-b843-d1f0ea031d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:20.643206 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-ed167ada-bfb1-494b-b843-d1f0ea031d1b None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:20.644408 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-ed167ada-bfb1-494b-b843-d1f0ea031d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:20.724451 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:20.730602 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 168/326] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 07:30:20.897770 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4661eb-5dae-44ea-ac45-72e2ad31ae53 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:21.015411 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4661eb-5dae-44ea-ac45-72e2ad31ae53 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:21.024413 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed167ada-bfb1-494b-b843-d1f0ea031d1b None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:21.062489 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f51740-2158-4416-ab7e-7e4ea14beed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:21.063419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f51740-2158-4416-ab7e-7e4ea14beed6 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:21.064190 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f51740-2158-4416-ab7e-7e4ea14beed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:21.064619 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f51740-2158-4416-ab7e-7e4ea14beed6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:21.079733 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f51740-2158-4416-ab7e-7e4ea14beed6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:30:21.086315 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-56f51740-2158-4416-ab7e-7e4ea14beed6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 07:30:21.086315 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:21.086315 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:21.086315 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:21.086315 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:21.086315 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:21.086315 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:21.086315 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:21.086315 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:21.086315 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:21.086315 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:21.086315 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:21.086315 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:30:21.086315 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:30:21.086315 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:30:21.086315 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:30:21.087450 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:30:21.087450 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:30:21.087450 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:30:21.087450 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:30:21.087450 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:21.087450 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:21.087450 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:21.087450 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:21.087450 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:21.087450 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:21.087450 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:21.087450 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:21.087450 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:21.087450 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:21.087450 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:21.087450 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:21.088442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:21.088442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:21.088442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:21.088442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:21.088442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:30:21.088442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:30:21.088442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:30:21.088442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:30:21.088442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:30:21.088442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:30:21.088442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 07:30:21.088442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:30:21.090826 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 159/327] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:30:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:21.097072 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f51740-2158-4416-ab7e-7e4ea14beed6 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:21.156861 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:21.172054 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed167ada-bfb1-494b-b843-d1f0ea031d1b None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:21.226121 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df002aae-b491-4ad1-a342-485c6fef7227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:21.227160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df002aae-b491-4ad1-a342-485c6fef7227 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:21.227617 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df002aae-b491-4ad1-a342-485c6fef7227 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:21.228031 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df002aae-b491-4ad1-a342-485c6fef7227 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:21.241897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f51740-2158-4416-ab7e-7e4ea14beed6 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:21.242980 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df002aae-b491-4ad1-a342-485c6fef7227 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:30:21.249329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-df002aae-b491-4ad1-a342-485c6fef7227 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 07:30:21.249329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:21.249329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:21.249329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:21.249329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:21.249329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:21.249329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:21.249329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:21.249329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:21.249329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:21.249329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:21.249329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:21.249329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:30:21.249329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:30:21.249329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:30:21.249329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:30:21.250348 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:30:21.250348 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:30:21.250348 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:30:21.250348 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:30:21.250348 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:21.250348 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:21.250348 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:21.250348 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:21.250348 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:21.250348 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:21.250348 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:21.250348 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:21.250348 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:21.250348 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:21.250348 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:21.250348 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:21.251245 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:21.251245 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:21.251245 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:21.251245 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:21.251245 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:30:21.251245 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:30:21.251245 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:30:21.251245 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:30:21.251245 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:30:21.251245 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:30:21.251245 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 07:30:21.251245 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:30:21.251245 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 169/328] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:30:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 07:30:21.257575 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df002aae-b491-4ad1-a342-485c6fef7227 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:21.295910 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c97a5d-b2d6-4f33-9dd9-44e858a29583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:21.297076 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c97a5d-b2d6-4f33-9dd9-44e858a29583 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:21.297533 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c97a5d-b2d6-4f33-9dd9-44e858a29583 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:21.298110 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c97a5d-b2d6-4f33-9dd9-44e858a29583 None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:21.299675 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c97a5d-b2d6-4f33-9dd9-44e858a29583 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:21.300622 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c97a5d-b2d6-4f33-9dd9-44e858a29583 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:21.302731 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c97a5d-b2d6-4f33-9dd9-44e858a29583 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:21.314263 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 160/329] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 26 07:30:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:30:21.321163 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c97a5d-b2d6-4f33-9dd9-44e858a29583 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:21.362120 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:21.437115 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df002aae-b491-4ad1-a342-485c6fef7227 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:21.444806 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:21.448265 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c97a5d-b2d6-4f33-9dd9-44e858a29583 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:21.487981 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a345ce-9909-47a7-9dbf-762167a8acfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:21.488879 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a345ce-9909-47a7-9dbf-762167a8acfd None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:21.489338 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a345ce-9909-47a7-9dbf-762167a8acfd None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:21.489759 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a345ce-9909-47a7-9dbf-762167a8acfd None admin] PATH_INFO: `/v3/users/9f9821a24bef45b48c49b94fb2cba7f8` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:21.491315 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a345ce-9909-47a7-9dbf-762167a8acfd None admin] RBAC: Authorizing `identity:get_user(user_id=9f9821a24bef45b48c49b94fb2cba7f8)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:21.492931 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a345ce-9909-47a7-9dbf-762167a8acfd None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:21.499168 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 161/330] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:30:21 2022] GET /identity/v3/users/9f9821a24bef45b48c49b94fb2cba7f8 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:30:21.501144 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a345ce-9909-47a7-9dbf-762167a8acfd None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:21.541868 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd04bd-9cd5-41a8-a409-91610fedd09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:21.542494 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd04bd-9cd5-41a8-a409-91610fedd09f None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:21.542769 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd04bd-9cd5-41a8-a409-91610fedd09f None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:21.543094 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd04bd-9cd5-41a8-a409-91610fedd09f None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:21.543771 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd04bd-9cd5-41a8-a409-91610fedd09f None admin] RBAC: Adding query filter params (name=member) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:21.544072 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd04bd-9cd5-41a8-a409-91610fedd09f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:21.545454 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd04bd-9cd5-41a8-a409-91610fedd09f None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:21.581771 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 170/331] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 26 07:30:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:30:21.602072 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd04bd-9cd5-41a8-a409-91610fedd09f None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:21.624758 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a345ce-9909-47a7-9dbf-762167a8acfd None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:21.666432 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3640a8-d7bf-4c4f-86d4-bac468a10c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:21.667434 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3640a8-d7bf-4c4f-86d4-bac468a10c73 None admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:21.667858 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3640a8-d7bf-4c4f-86d4-bac468a10c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:21.668418 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3640a8-d7bf-4c4f-86d4-bac468a10c73 None admin] PATH_INFO: `/v3/system/users/9f9821a24bef45b48c49b94fb2cba7f8/roles/33d4ab731cf74a3ca8d583700668949d` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:21.670242 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3640a8-d7bf-4c4f-86d4-bac468a10c73 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9f9821a24bef45b48c49b94fb2cba7f8, role_id=33d4ab731cf74a3ca8d583700668949d)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:21.671830 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3640a8-d7bf-4c4f-86d4-bac468a10c73 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:21.759199 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 162/332] 10.222.0.42 () {58 vars in 1334 bytes} [Fri Aug 26 07:30:21 2022] PUT /identity/v3/system/users/9f9821a24bef45b48c49b94fb2cba7f8/roles/33d4ab731cf74a3ca8d583700668949d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:30:21.780951 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd04bd-9cd5-41a8-a409-91610fedd09f None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:21.812829 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:21.834591 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f49c0-bba4-40f1-a534-39f8f0ea6285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:21.835255 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f49c0-bba4-40f1-a534-39f8f0ea6285 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:21.835538 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f49c0-bba4-40f1-a534-39f8f0ea6285 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:21.835861 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f49c0-bba4-40f1-a534-39f8f0ea6285 None admin] PATH_INFO: `/v3/users/fcad4246722e4e48aa584f49415f5448` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:21.837101 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f49c0-bba4-40f1-a534-39f8f0ea6285 None admin] RBAC: Authorizing `identity:get_user(user_id=fcad4246722e4e48aa584f49415f5448)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:21.838553 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f49c0-bba4-40f1-a534-39f8f0ea6285 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:21.840298 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 171/333] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:30:21 2022] GET /identity/v3/users/fcad4246722e4e48aa584f49415f5448 => generated 293 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:21.846933 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3640a8-d7bf-4c4f-86d4-bac468a10c73 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:21.886055 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:21.968044 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3640a8-d7bf-4c4f-86d4-bac468a10c73 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:22.010250 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4113fe-8263-4e27-a000-24368b583252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:22.010872 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4113fe-8263-4e27-a000-24368b583252 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:22.011178 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4113fe-8263-4e27-a000-24368b583252 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:22.011453 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4113fe-8263-4e27-a000-24368b583252 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:22.012250 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4113fe-8263-4e27-a000-24368b583252 None admin] RBAC: Adding query filter params (role.id=854d2a8e89d94d8685ff7d5dc70494b5, user.id=fcad4246722e4e48aa584f49415f5448, scope.system=all) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:22.012561 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4113fe-8263-4e27-a000-24368b583252 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:22.013999 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4113fe-8263-4e27-a000-24368b583252 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:22.031398 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 163/334] 10.222.0.42 () {56 vars in 1308 bytes} [Fri Aug 26 07:30:21 2022] GET /identity/v3/role_assignments?user.id=fcad4246722e4e48aa584f49415f5448&scope.system=all&role.id=854d2a8e89d94d8685ff7d5dc70494b5 => generated 510 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:22.983560 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752ea82-93fd-4721-b967-ce03de93e255 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:22.984085 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752ea82-93fd-4721-b967-ce03de93e255 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:22.984085 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752ea82-93fd-4721-b967-ce03de93e255 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:22.985719 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 172/335] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:30:22.991822 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7614f-7733-4f3f-bf1e-845cf68fcbe8 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:22.992293 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7614f-7733-4f3f-bf1e-845cf68fcbe8 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:22.992397 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7614f-7733-4f3f-bf1e-845cf68fcbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:23.018101 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-79d7614f-7733-4f3f-bf1e-845cf68fcbe8 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:23.019368 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-79d7614f-7733-4f3f-bf1e-845cf68fcbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:23.134813 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 164/336] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:30:23.777946 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752ea82-93fd-4721-b967-ce03de93e255 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:23.922016 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752ea82-93fd-4721-b967-ce03de93e255 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:23.974201 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b6e61-029e-48c2-a2a1-52549e59ff4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:23.975391 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b6e61-029e-48c2-a2a1-52549e59ff4e None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:23.975994 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b6e61-029e-48c2-a2a1-52549e59ff4e None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:23.976666 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b6e61-029e-48c2-a2a1-52549e59ff4e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:23.994888 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b6e61-029e-48c2-a2a1-52549e59ff4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:30:24.001020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-3d4b6e61-029e-48c2-a2a1-52549e59ff4e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 07:30:24.001020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:24.001020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:24.001020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:24.001020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:24.001020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:24.001020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:24.001020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:24.001020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:24.001020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:24.001020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:24.001020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:24.001020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:30:24.001020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:30:24.001020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:30:24.001020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:30:24.002484 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:30:24.002484 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:30:24.002484 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:30:24.002484 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:30:24.002484 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:24.002484 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:24.002484 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:24.002484 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:24.002484 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:24.002484 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:24.002484 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:24.002484 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:24.002484 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:24.002484 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:24.002484 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:24.002484 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:24.003318 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:24.003318 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:24.003318 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:24.003318 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:24.003318 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:30:24.003318 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:30:24.003318 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:30:24.003318 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:30:24.003318 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:30:24.003318 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:30:24.003318 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 07:30:24.003318 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:30:24.005638 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 173/337] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:30:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:24.011863 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d7614f-7733-4f3f-bf1e-845cf68fcbe8 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:24.059459 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:24.166653 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d7614f-7733-4f3f-bf1e-845cf68fcbe8 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:24.218726 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178376f5-35a8-4b74-b128-f33830c2a1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:24.219389 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178376f5-35a8-4b74-b128-f33830c2a1fe None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:24.219736 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178376f5-35a8-4b74-b128-f33830c2a1fe None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:24.220164 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178376f5-35a8-4b74-b128-f33830c2a1fe None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:24.221073 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178376f5-35a8-4b74-b128-f33830c2a1fe None admin] RBAC: Adding query filter params (name=member) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:24.221500 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178376f5-35a8-4b74-b128-f33830c2a1fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:24.222915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178376f5-35a8-4b74-b128-f33830c2a1fe None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:24.232943 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 165/338] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 26 07:30:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:24.240149 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b6e61-029e-48c2-a2a1-52549e59ff4e None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:24.317410 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:24.347052 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62502c29-ff46-40d9-a52f-7b1713a79a03 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:24.347365 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62502c29-ff46-40d9-a52f-7b1713a79a03 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:24.347613 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62502c29-ff46-40d9-a52f-7b1713a79a03 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:24.349086 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 166/339] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 07:30:24.354763 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41107214-7713-43b9-a68b-4a7cc743cb72 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:24.355092 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41107214-7713-43b9-a68b-4a7cc743cb72 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:24.355373 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41107214-7713-43b9-a68b-4a7cc743cb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:24.388638 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-41107214-7713-43b9-a68b-4a7cc743cb72 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:24.390017 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-41107214-7713-43b9-a68b-4a7cc743cb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:24.397992 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b6e61-029e-48c2-a2a1-52549e59ff4e None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:24.476623 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d5fd0-8e82-4604-b782-1ad989d26ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:24.477259 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d5fd0-8e82-4604-b782-1ad989d26ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:24.477712 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d5fd0-8e82-4604-b782-1ad989d26ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:24.477989 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d5fd0-8e82-4604-b782-1ad989d26ad5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:24.504205 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 167/340] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:30:24.580576 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d5fd0-8e82-4604-b782-1ad989d26ad5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:24.581987 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d5fd0-8e82-4604-b782-1ad989d26ad5 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:24.641963 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:24.708537 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 174/341] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:30:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 07:30:24.713986 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41107214-7713-43b9-a68b-4a7cc743cb72 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:24.735475 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:24.839789 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41107214-7713-43b9-a68b-4a7cc743cb72 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:24.894967 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d700dc-436e-463f-b021-098366b7b5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:24.895644 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d700dc-436e-463f-b021-098366b7b5ab None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:24.895925 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d700dc-436e-463f-b021-098366b7b5ab None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:24.896204 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d700dc-436e-463f-b021-098366b7b5ab None admin] PATH_INFO: `/v3/projects/3729de3353c34b84aa5d098e5bee6d98` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:24.899671 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d700dc-436e-463f-b021-098366b7b5ab None admin] RBAC: Authorizing `identity:get_project(project_id=3729de3353c34b84aa5d098e5bee6d98)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:24.901148 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d700dc-436e-463f-b021-098366b7b5ab None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:24.903148 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 168/342] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:30:24 2022] GET /identity/v3/projects/3729de3353c34b84aa5d098e5bee6d98 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:24.908467 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d5fd0-8e82-4604-b782-1ad989d26ad5 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:25.004206 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d700dc-436e-463f-b021-098366b7b5ab None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:25.053445 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d5fd0-8e82-4604-b782-1ad989d26ad5 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:25.115517 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffbf37e-3b0e-46f9-91e8-d41b6bd50375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:25.116003 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbf37e-3b0e-46f9-91e8-d41b6bd50375 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:25.116307 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbf37e-3b0e-46f9-91e8-d41b6bd50375 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:25.116586 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbf37e-3b0e-46f9-91e8-d41b6bd50375 None admin] PATH_INFO: `/v3/groups/0e1fd22d4d75490e8a4563ebfe376b4d` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:25.127849 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffbf37e-3b0e-46f9-91e8-d41b6bd50375 None admin] RBAC: Authorizing `identity:get_group(group_id=0e1fd22d4d75490e8a4563ebfe376b4d)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:25.130411 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffbf37e-3b0e-46f9-91e8-d41b6bd50375 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:25.131370 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:25.134070 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 175/343] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Aug 26 07:30:24 2022] GET /identity/v3/groups/0e1fd22d4d75490e8a4563ebfe376b4d => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:25.136865 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37a629-4345-4df1-b3d8-5a74bc9f9c64 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:25.137628 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37a629-4345-4df1-b3d8-5a74bc9f9c64 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:25.138103 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37a629-4345-4df1-b3d8-5a74bc9f9c64 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:25.142209 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 176/344] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:30:25.142209 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae6af7-f092-4075-8804-21fe575756fd None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:25.142907 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae6af7-f092-4075-8804-21fe575756fd None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:25.143376 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae6af7-f092-4075-8804-21fe575756fd None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:25.145557 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 177/345] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:30:25.150032 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae6af7-f092-4075-8804-21fe575756fd None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:25.160111 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d700dc-436e-463f-b021-098366b7b5ab None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:25.176766 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:25.220623 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf72ec9-4011-42d6-92f2-f70ba53f1cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:25.221580 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf72ec9-4011-42d6-92f2-f70ba53f1cd4 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:25.222055 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf72ec9-4011-42d6-92f2-f70ba53f1cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:25.222507 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf72ec9-4011-42d6-92f2-f70ba53f1cd4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:25.239644 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf72ec9-4011-42d6-92f2-f70ba53f1cd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:30:25.245851 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-aaf72ec9-4011-42d6-92f2-f70ba53f1cd4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 07:30:25.245851 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:25.245851 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:25.245851 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:25.245851 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:25.245851 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:25.245851 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:25.245851 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:25.245851 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:25.245851 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:25.245851 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:25.245851 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:25.245851 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:30:25.245851 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:30:25.245851 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:30:25.245851 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:30:25.246752 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:30:25.246752 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:30:25.246752 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:30:25.246752 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:30:25.246752 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:25.246752 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:25.246752 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:25.246752 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:25.246752 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:25.246752 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:25.246752 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:25.246752 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:25.246752 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:25.246752 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:25.246752 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:25.246752 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:25.247616 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:25.247616 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:25.247616 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:25.247616 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:25.247616 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:30:25.247616 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:30:25.247616 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:30:25.247616 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:30:25.247616 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:30:25.247616 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:30:25.247616 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 07:30:25.247616 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:30:25.250161 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 169/346] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 26 07:30:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 07:30:25.252518 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66dedb-afb8-4ac1-9d7f-d6b963d3ea49 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:25.253045 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66dedb-afb8-4ac1-9d7f-d6b963d3ea49 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:25.253607 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66dedb-afb8-4ac1-9d7f-d6b963d3ea49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:25.273938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-ea66dedb-afb8-4ac1-9d7f-d6b963d3ea49 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:25.275622 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-ea66dedb-afb8-4ac1-9d7f-d6b963d3ea49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:25.352585 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae6af7-f092-4075-8804-21fe575756fd None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:25.362064 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 170/347] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:30:25.364370 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9da37-f15c-4c82-86e0-a90a94241cc7 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:25.364891 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9da37-f15c-4c82-86e0-a90a94241cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:25.365362 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9da37-f15c-4c82-86e0-a90a94241cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:25.390180 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-8db9da37-f15c-4c82-86e0-a90a94241cc7 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:25.392456 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-8db9da37-f15c-4c82-86e0-a90a94241cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:25.398910 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291825c-2ec8-49f2-8fe3-0931bb6dfcdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:25.399646 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291825c-2ec8-49f2-8fe3-0931bb6dfcdd None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:25.399885 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291825c-2ec8-49f2-8fe3-0931bb6dfcdd None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:25.400085 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291825c-2ec8-49f2-8fe3-0931bb6dfcdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:25.400828 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291825c-2ec8-49f2-8fe3-0931bb6dfcdd None admin] RBAC: Adding query filter params (group.id=0e1fd22d4d75490e8a4563ebfe376b4d, role.id=854d2a8e89d94d8685ff7d5dc70494b5, scope.project.id=3729de3353c34b84aa5d098e5bee6d98) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:25.401136 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291825c-2ec8-49f2-8fe3-0931bb6dfcdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:25.402594 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291825c-2ec8-49f2-8fe3-0931bb6dfcdd None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:25.424351 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 178/348] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Aug 26 07:30:25 2022] GET /identity/v3/role_assignments?group.id=0e1fd22d4d75490e8a4563ebfe376b4d&scope.project.id=3729de3353c34b84aa5d098e5bee6d98&role.id=854d2a8e89d94d8685ff7d5dc70494b5 => generated 260 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:25.425616 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291825c-2ec8-49f2-8fe3-0931bb6dfcdd None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:25.499390 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:25.507920 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 171/349] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:30:25.577593 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:25.618004 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291825c-2ec8-49f2-8fe3-0931bb6dfcdd None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:25.669549 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5a8ca-60f6-49c3-84c3-a2b98d66a422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:25.670096 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5a8ca-60f6-49c3-84c3-a2b98d66a422 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:25.670380 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5a8ca-60f6-49c3-84c3-a2b98d66a422 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:25.670656 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5a8ca-60f6-49c3-84c3-a2b98d66a422 None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:25.671386 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f5a8ca-60f6-49c3-84c3-a2b98d66a422 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:25.671694 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f5a8ca-60f6-49c3-84c3-a2b98d66a422 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:25.673891 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f5a8ca-60f6-49c3-84c3-a2b98d66a422 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:25.686766 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 179/350] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:30:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:25.694159 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db9da37-f15c-4c82-86e0-a90a94241cc7 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:25.786466 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6b0fd-cf5f-4236-9dd4-62ae8ea8123e None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:25.786787 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6b0fd-cf5f-4236-9dd4-62ae8ea8123e None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:25.787074 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6b0fd-cf5f-4236-9dd4-62ae8ea8123e None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:25.788411 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 180/351] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:30:25.794011 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a7c89-8aed-4b7a-8472-5477a0cd2dfa None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:25.794287 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a7c89-8aed-4b7a-8472-5477a0cd2dfa None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:25.794567 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a7c89-8aed-4b7a-8472-5477a0cd2dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:25.831312 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-f44a7c89-8aed-4b7a-8472-5477a0cd2dfa None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:25.832557 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-f44a7c89-8aed-4b7a-8472-5477a0cd2dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:25.883391 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db9da37-f15c-4c82-86e0-a90a94241cc7 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:25.925067 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c86c95-62ba-48cf-b096-e6edc6f966a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:25.926342 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c86c95-62ba-48cf-b096-e6edc6f966a9 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:25.927195 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c86c95-62ba-48cf-b096-e6edc6f966a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:25.927667 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c86c95-62ba-48cf-b096-e6edc6f966a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:25.954004 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 181/352] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 07:30:25.959727 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a7c89-8aed-4b7a-8472-5477a0cd2dfa None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:26.046374 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:26.050720 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c86c95-62ba-48cf-b096-e6edc6f966a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:26.052457 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c86c95-62ba-48cf-b096-e6edc6f966a9 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:26.082093 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:26.127918 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a7c89-8aed-4b7a-8472-5477a0cd2dfa None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:26.178579 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f478fb-3799-42e7-ae30-a6d00360a992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:26.179165 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f478fb-3799-42e7-ae30-a6d00360a992 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:26.179832 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f478fb-3799-42e7-ae30-a6d00360a992 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:26.180133 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f478fb-3799-42e7-ae30-a6d00360a992 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:26.185211 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 172/353] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:30:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 07:30:26.191797 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adab9ee-d2d7-479f-80d3-2cd2da8224d1 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:26.192472 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adab9ee-d2d7-479f-80d3-2cd2da8224d1 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:26.193228 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adab9ee-d2d7-479f-80d3-2cd2da8224d1 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:26.194387 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f478fb-3799-42e7-ae30-a6d00360a992 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:30:26.195112 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 173/354] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:26 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:30:26.196049 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adab9ee-d2d7-479f-80d3-2cd2da8224d1 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:26.199849 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-b6f478fb-3799-42e7-ae30-a6d00360a992 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 07:30:26.199849 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:26.199849 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:26.199849 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:26.199849 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:26.199849 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:26.199849 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:26.199849 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:26.199849 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:26.199849 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:26.199849 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:26.199849 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:26.199849 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:30:26.199849 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:30:26.199849 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:30:26.199849 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:30:26.200831 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:30:26.200831 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:30:26.200831 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:30:26.200831 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:30:26.200831 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:26.200831 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:26.200831 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:26.200831 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:26.200831 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:26.200831 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:26.200831 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:26.200831 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:26.200831 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:26.200831 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:26.200831 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:26.200831 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:26.201660 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:26.201660 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:26.201660 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:26.201660 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:26.201660 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:30:26.201660 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:30:26.201660 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:30:26.201660 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:30:26.201660 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:30:26.201660 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:30:26.201660 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 07:30:26.201660 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:30:26.201660 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 182/355] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 26 07:30:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:26.202333 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f478fb-3799-42e7-ae30-a6d00360a992 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:26.359221 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f478fb-3799-42e7-ae30-a6d00360a992 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:26.373175 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:26.378209 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adab9ee-d2d7-479f-80d3-2cd2da8224d1 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:26.409430 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:26.417925 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf7530-f7db-438f-bb37-58378da1bd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:26.418579 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf7530-f7db-438f-bb37-58378da1bd1c None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:26.418886 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf7530-f7db-438f-bb37-58378da1bd1c None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:26.419326 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf7530-f7db-438f-bb37-58378da1bd1c None admin] PATH_INFO: `/v3/projects/3729de3353c34b84aa5d098e5bee6d98` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:26.420497 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccf7530-f7db-438f-bb37-58378da1bd1c None admin] RBAC: Authorizing `identity:get_project(project_id=3729de3353c34b84aa5d098e5bee6d98)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:26.422203 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccf7530-f7db-438f-bb37-58378da1bd1c None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:26.422969 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7ac3a-43b7-435e-afc8-d0e976726299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:26.424356 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7ac3a-43b7-435e-afc8-d0e976726299 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:26.424687 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7ac3a-43b7-435e-afc8-d0e976726299 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:26.424795 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 183/356] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:30:26 2022] GET /identity/v3/projects/3729de3353c34b84aa5d098e5bee6d98 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:26.425050 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7ac3a-43b7-435e-afc8-d0e976726299 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:26.425862 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caddc1b-1a68-46c5-bbc0-df74b4df5d4b None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:26.426310 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caddc1b-1a68-46c5-bbc0-df74b4df5d4b None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:26.426476 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caddc1b-1a68-46c5-bbc0-df74b4df5d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:26.445939 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e7ac3a-43b7-435e-afc8-d0e976726299 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:30:26.450878 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-28e7ac3a-43b7-435e-afc8-d0e976726299 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 07:30:26.450878 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:26.450878 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:26.450878 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:26.450878 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:26.450878 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:26.450878 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:26.450878 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:26.450878 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:26.450878 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:26.450878 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:26.450878 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:26.450878 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:30:26.450878 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:30:26.450878 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:30:26.450878 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:30:26.451783 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:30:26.451783 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:30:26.451783 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:30:26.451783 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:30:26.451783 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:26.451783 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:26.451783 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:26.451783 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:26.451783 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:26.451783 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:26.451783 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:26.451783 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:26.451783 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:26.451783 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:26.451783 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:26.451783 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:26.457442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:26.457442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:26.457442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:26.457442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:26.457442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:30:26.457442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:30:26.457442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:30:26.457442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:30:26.457442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:30:26.457442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:30:26.457442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 07:30:26.457442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:30:26.457442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 174/357] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:30:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:26.458307 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-2caddc1b-1a68-46c5-bbc0-df74b4df5d4b None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:26.458402 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7ac3a-43b7-435e-afc8-d0e976726299 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:26.458484 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-2caddc1b-1a68-46c5-bbc0-df74b4df5d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:26.554494 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 184/358] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:30:26.554494 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caddc1b-1a68-46c5-bbc0-df74b4df5d4b None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:26.610242 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7ac3a-43b7-435e-afc8-d0e976726299 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:26.650004 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6891b60-8a30-4adc-b6c8-3395ccb8ed75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:26.650977 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6891b60-8a30-4adc-b6c8-3395ccb8ed75 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:26.651507 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6891b60-8a30-4adc-b6c8-3395ccb8ed75 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:26.652027 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6891b60-8a30-4adc-b6c8-3395ccb8ed75 None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:26.652912 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6891b60-8a30-4adc-b6c8-3395ccb8ed75 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:26.653419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6891b60-8a30-4adc-b6c8-3395ccb8ed75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:26.655130 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6891b60-8a30-4adc-b6c8-3395ccb8ed75 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:26.667212 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 175/359] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:30:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:26.668564 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6891b60-8a30-4adc-b6c8-3395ccb8ed75 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:26.674005 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caddc1b-1a68-46c5-bbc0-df74b4df5d4b None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:26.698046 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:26.708419 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:26.717418 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0f8e3-2907-4dbd-af0d-6db04fa35fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:26.718154 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0f8e3-2907-4dbd-af0d-6db04fa35fd6 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:26.718508 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0f8e3-2907-4dbd-af0d-6db04fa35fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:26.718872 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0f8e3-2907-4dbd-af0d-6db04fa35fd6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:26.736505 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa0f8e3-2907-4dbd-af0d-6db04fa35fd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:30:26.741928 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-7aa0f8e3-2907-4dbd-af0d-6db04fa35fd6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 07:30:26.741928 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:26.741928 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:26.741928 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:26.741928 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:26.741928 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:26.741928 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:26.741928 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:26.741928 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:26.741928 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:26.741928 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:26.741928 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:26.741928 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:30:26.741928 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:30:26.741928 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:30:26.741928 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:30:26.744301 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:30:26.744301 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:30:26.744301 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:30:26.744301 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:30:26.744301 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:26.744301 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:26.744301 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:26.744301 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:26.744301 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:26.744301 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:26.744301 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:26.744301 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:26.744301 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:26.744301 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:26.744301 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:26.744301 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:26.745441 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:26.745441 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:26.745441 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:26.745441 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:26.745441 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:30:26.745441 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:30:26.745441 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:30:26.745441 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:30:26.745441 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:30:26.745441 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:30:26.745441 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 07:30:26.745441 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:30:26.745441 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 185/360] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:30:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:26.745441 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0f8e3-2907-4dbd-af0d-6db04fa35fd6 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:26.802251 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6891b60-8a30-4adc-b6c8-3395ccb8ed75 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:26.841907 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbacf1d1-a8a4-4067-bfce-66210145ba25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:26.842554 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacf1d1-a8a4-4067-bfce-66210145ba25 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:26.842831 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacf1d1-a8a4-4067-bfce-66210145ba25 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:26.843136 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacf1d1-a8a4-4067-bfce-66210145ba25 None admin] PATH_INFO: `/v3/groups/0e1fd22d4d75490e8a4563ebfe376b4d` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:26.844397 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbacf1d1-a8a4-4067-bfce-66210145ba25 None admin] RBAC: Authorizing `identity:get_group(group_id=0e1fd22d4d75490e8a4563ebfe376b4d)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:26.846919 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbacf1d1-a8a4-4067-bfce-66210145ba25 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:26.849001 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 176/361] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Aug 26 07:30:26 2022] GET /identity/v3/groups/0e1fd22d4d75490e8a4563ebfe376b4d => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:26.850215 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbacf1d1-a8a4-4067-bfce-66210145ba25 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:26.914177 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0f8e3-2907-4dbd-af0d-6db04fa35fd6 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:26.956235 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcdb8e4-109c-4d6c-9646-09318caf0922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:26.957179 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcdb8e4-109c-4d6c-9646-09318caf0922 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:26.957660 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcdb8e4-109c-4d6c-9646-09318caf0922 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:26.958121 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcdb8e4-109c-4d6c-9646-09318caf0922 None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:26.959000 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcdb8e4-109c-4d6c-9646-09318caf0922 None admin] RBAC: Adding query filter params (name=member) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:26.959499 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcdb8e4-109c-4d6c-9646-09318caf0922 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:26.961146 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcdb8e4-109c-4d6c-9646-09318caf0922 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:26.971110 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 186/362] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 26 07:30:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:26.972268 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcdb8e4-109c-4d6c-9646-09318caf0922 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:26.977856 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:26.988947 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbacf1d1-a8a4-4067-bfce-66210145ba25 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:27.029467 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:27.033827 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df7d1be-b75c-4490-b2ec-78d9f60ea3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:27.034663 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7d1be-b75c-4490-b2ec-78d9f60ea3d7 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:27.035132 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7d1be-b75c-4490-b2ec-78d9f60ea3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:27.035541 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7d1be-b75c-4490-b2ec-78d9f60ea3d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:27.097568 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcdb8e4-109c-4d6c-9646-09318caf0922 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:27.124801 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df7d1be-b75c-4490-b2ec-78d9f60ea3d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:27.126978 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df7d1be-b75c-4490-b2ec-78d9f60ea3d7 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:27.156640 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0021d37-0f03-44f5-ba46-80acefb82075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:27.157590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0021d37-0f03-44f5-ba46-80acefb82075 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:27.158067 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0021d37-0f03-44f5-ba46-80acefb82075 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:27.158508 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0021d37-0f03-44f5-ba46-80acefb82075 None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:27.159561 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0021d37-0f03-44f5-ba46-80acefb82075 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:27.160048 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0021d37-0f03-44f5-ba46-80acefb82075 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:27.161603 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0021d37-0f03-44f5-ba46-80acefb82075 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:27.170941 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 187/363] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 26 07:30:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:27.172094 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0021d37-0f03-44f5-ba46-80acefb82075 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:27.259455 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:27.274658 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 177/364] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:30:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 07:30:27.278355 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df7d1be-b75c-4490-b2ec-78d9f60ea3d7 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:27.324374 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0021d37-0f03-44f5-ba46-80acefb82075 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:27.345447 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:27.373068 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5173b5-6838-4c00-a8f5-b3a94e3a5e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:27.373681 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5173b5-6838-4c00-a8f5-b3a94e3a5e58 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:27.373957 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5173b5-6838-4c00-a8f5-b3a94e3a5e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:27.374229 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5173b5-6838-4c00-a8f5-b3a94e3a5e58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:27.375552 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5173b5-6838-4c00-a8f5-b3a94e3a5e58 None admin] RBAC: Adding query filter params (group.id=0e1fd22d4d75490e8a4563ebfe376b4d, role.id=865b733dc94e43589d2385826a23e137, scope.project.id=3729de3353c34b84aa5d098e5bee6d98) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:27.375862 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5173b5-6838-4c00-a8f5-b3a94e3a5e58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:27.378145 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5173b5-6838-4c00-a8f5-b3a94e3a5e58 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:27.385673 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 188/365] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Aug 26 07:30:27 2022] GET /identity/v3/role_assignments?group.id=0e1fd22d4d75490e8a4563ebfe376b4d&scope.project.id=3729de3353c34b84aa5d098e5bee6d98&role.id=865b733dc94e43589d2385826a23e137 => generated 260 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:27.386275 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5173b5-6838-4c00-a8f5-b3a94e3a5e58 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:27.449653 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df7d1be-b75c-4490-b2ec-78d9f60ea3d7 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:27.514858 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b8a44-6baf-4784-b90f-5f52a76b1de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:27.515662 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b8a44-6baf-4784-b90f-5f52a76b1de0 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:27.515942 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b8a44-6baf-4784-b90f-5f52a76b1de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:27.516210 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b8a44-6baf-4784-b90f-5f52a76b1de0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:27.533857 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b8a44-6baf-4784-b90f-5f52a76b1de0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:30:27.534874 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5173b5-6838-4c00-a8f5-b3a94e3a5e58 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:27.538634 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-a36b8a44-6baf-4784-b90f-5f52a76b1de0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:30:27.538634 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:27.538634 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:27.538634 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:27.538634 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:27.538634 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:27.538634 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:27.538634 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:27.538634 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:27.538634 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:27.538634 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:27.538634 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:27.538634 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:30:27.538634 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:30:27.538634 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:30:27.538634 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:30:27.539655 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:30:27.539655 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:30:27.539655 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:30:27.539655 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:30:27.539655 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:27.539655 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:27.539655 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:27.539655 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:27.539655 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:27.539655 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:27.539655 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:27.539655 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:27.539655 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:27.539655 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:27.539655 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:27.539655 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:27.541112 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:27.541112 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:27.541112 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:27.541112 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:27.541112 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:30:27.541112 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:30:27.541112 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:30:27.541112 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:30:27.541112 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:30:27.541112 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:30:27.541112 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:30:27.541112 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:30:27.541112 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 178/366] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 26 07:30:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:27.541777 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b8a44-6baf-4784-b90f-5f52a76b1de0 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:27.590256 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064b656-2119-42d3-8c14-9d92f3072f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:27.591308 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064b656-2119-42d3-8c14-9d92f3072f31 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:27.591789 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064b656-2119-42d3-8c14-9d92f3072f31 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:27.592362 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064b656-2119-42d3-8c14-9d92f3072f31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:27.604054 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:27.648918 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:27.660362 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b8a44-6baf-4784-b90f-5f52a76b1de0 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:27.675885 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064b656-2119-42d3-8c14-9d92f3072f31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:27.677874 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064b656-2119-42d3-8c14-9d92f3072f31 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:27.698540 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf2987-0cf1-41f7-a5b1-52e72593483d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:27.699208 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf2987-0cf1-41f7-a5b1-52e72593483d None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:27.699491 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf2987-0cf1-41f7-a5b1-52e72593483d None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:27.699763 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf2987-0cf1-41f7-a5b1-52e72593483d None admin] PATH_INFO: `/v3/users/9f9821a24bef45b48c49b94fb2cba7f8` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:27.701087 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf2987-0cf1-41f7-a5b1-52e72593483d None admin] RBAC: Authorizing `identity:get_user(user_id=9f9821a24bef45b48c49b94fb2cba7f8)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:27.702876 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf2987-0cf1-41f7-a5b1-52e72593483d None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:27.705374 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 179/367] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:30:27 2022] GET /identity/v3/users/9f9821a24bef45b48c49b94fb2cba7f8 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:27.706682 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf2987-0cf1-41f7-a5b1-52e72593483d None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:27.836932 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 189/368] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:30:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 07:30:27.837981 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064b656-2119-42d3-8c14-9d92f3072f31 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:27.867632 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf2987-0cf1-41f7-a5b1-52e72593483d None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:27.900959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:27.926349 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e885a4-431f-42f4-b842-2d89dff93081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:27.927035 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e885a4-431f-42f4-b842-2d89dff93081 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:27.927312 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e885a4-431f-42f4-b842-2d89dff93081 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:27.927587 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e885a4-431f-42f4-b842-2d89dff93081 None admin] PATH_INFO: `/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:27.928765 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e885a4-431f-42f4-b842-2d89dff93081 None admin] RBAC: Authorizing `identity:get_project(project_id=b59ea18f7e2d4d2dbe387a2dbc161c67)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:27.930629 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e885a4-431f-42f4-b842-2d89dff93081 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:27.932267 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 180/369] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:30:27 2022] GET /identity/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:27.933097 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e885a4-431f-42f4-b842-2d89dff93081 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:27.949316 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:27.985398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064b656-2119-42d3-8c14-9d92f3072f31 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:28.031619 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec36644-16c5-4c6c-ad21-c9445bcf0b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:28.032233 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec36644-16c5-4c6c-ad21-c9445bcf0b18 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:28.032539 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec36644-16c5-4c6c-ad21-c9445bcf0b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:28.032838 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec36644-16c5-4c6c-ad21-c9445bcf0b18 None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:28.036110 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec36644-16c5-4c6c-ad21-c9445bcf0b18 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:28.036110 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec36644-16c5-4c6c-ad21-c9445bcf0b18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:28.036110 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec36644-16c5-4c6c-ad21-c9445bcf0b18 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:28.050554 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 190/370] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:30:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:28.052837 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325f5a0-82f0-430a-ac64-a98677c56ccd None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:28.052973 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325f5a0-82f0-430a-ac64-a98677c56ccd None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:28.053246 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325f5a0-82f0-430a-ac64-a98677c56ccd None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:28.054762 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 191/371] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:30:28.055484 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325f5a0-82f0-430a-ac64-a98677c56ccd None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:28.080780 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e885a4-431f-42f4-b842-2d89dff93081 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:28.145015 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a2ec5-8083-4de7-857e-8a64b12837bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:28.145893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a2ec5-8083-4de7-857e-8a64b12837bf None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:28.146308 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a2ec5-8083-4de7-857e-8a64b12837bf None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:28.146708 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a2ec5-8083-4de7-857e-8a64b12837bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:28.147610 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a2ec5-8083-4de7-857e-8a64b12837bf None admin] RBAC: Adding query filter params (role.id=33d4ab731cf74a3ca8d583700668949d, user.id=9f9821a24bef45b48c49b94fb2cba7f8, scope.system=all) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:28.148107 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a2ec5-8083-4de7-857e-8a64b12837bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:28.150673 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a2ec5-8083-4de7-857e-8a64b12837bf None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:28.168342 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 181/372] 10.222.0.42 () {56 vars in 1308 bytes} [Fri Aug 26 07:30:27 2022] GET /identity/v3/role_assignments?user.id=9f9821a24bef45b48c49b94fb2cba7f8&scope.system=all&role.id=33d4ab731cf74a3ca8d583700668949d => generated 510 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:28.168342 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a2ec5-8083-4de7-857e-8a64b12837bf None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:28.224359 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:28.234276 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325f5a0-82f0-430a-ac64-a98677c56ccd None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:28.292425 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a2ec5-8083-4de7-857e-8a64b12837bf None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:28.293501 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e8116-a4e8-4a02-9667-43326b22e6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:28.294326 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e8116-a4e8-4a02-9667-43326b22e6e9 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:28.294773 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e8116-a4e8-4a02-9667-43326b22e6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:28.295293 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e8116-a4e8-4a02-9667-43326b22e6e9 None admin] PATH_INFO: `/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:28.299798 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e8116-a4e8-4a02-9667-43326b22e6e9 None admin] RBAC: Authorizing `identity:get_project(project_id=b59ea18f7e2d4d2dbe387a2dbc161c67)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:28.301596 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e8116-a4e8-4a02-9667-43326b22e6e9 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:28.303877 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 192/373] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:30:28 2022] GET /identity/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67 => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:28.310456 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e8116-a4e8-4a02-9667-43326b22e6e9 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:28.322526 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:28.342404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca64e6-0828-478f-a202-965e7308b5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:28.343135 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca64e6-0828-478f-a202-965e7308b5d2 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:28.343420 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca64e6-0828-478f-a202-965e7308b5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:28.343705 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca64e6-0828-478f-a202-965e7308b5d2 None admin] PATH_INFO: `/v3/groups/0e1fd22d4d75490e8a4563ebfe376b4d` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:28.345510 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ca64e6-0828-478f-a202-965e7308b5d2 None admin] RBAC: Authorizing `identity:get_group(group_id=0e1fd22d4d75490e8a4563ebfe376b4d)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:28.347236 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ca64e6-0828-478f-a202-965e7308b5d2 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:28.349561 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 182/374] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Aug 26 07:30:28 2022] GET /identity/v3/groups/0e1fd22d4d75490e8a4563ebfe376b4d => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:28.350610 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c23337-de95-4cfe-ad88-a191a2de06c7 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:28.350826 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c23337-de95-4cfe-ad88-a191a2de06c7 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:28.351120 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c23337-de95-4cfe-ad88-a191a2de06c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:28.373801 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-e5c23337-de95-4cfe-ad88-a191a2de06c7 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:28.377048 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-e5c23337-de95-4cfe-ad88-a191a2de06c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:28.477551 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e8116-a4e8-4a02-9667-43326b22e6e9 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:28.486821 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 183/375] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:30:28.492385 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c23337-de95-4cfe-ad88-a191a2de06c7 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:28.523724 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6cd90e-0505-4936-956a-418c7f14e1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:28.524356 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cd90e-0505-4936-956a-418c7f14e1b9 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:28.524775 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cd90e-0505-4936-956a-418c7f14e1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:28.525186 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cd90e-0505-4936-956a-418c7f14e1b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:28.550493 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:28.637766 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c23337-de95-4cfe-ad88-a191a2de06c7 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:28.654587 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6cd90e-0505-4936-956a-418c7f14e1b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:28.657176 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6cd90e-0505-4936-956a-418c7f14e1b9 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:28.670399 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:28.697282 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ebd3d-0e4e-4c82-bbab-befd3639f5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:28.698229 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ebd3d-0e4e-4c82-bbab-befd3639f5fa None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:28.698882 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ebd3d-0e4e-4c82-bbab-befd3639f5fa None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:28.699328 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ebd3d-0e4e-4c82-bbab-befd3639f5fa None admin] PATH_INFO: `/v3/groups/0e1fd22d4d75490e8a4563ebfe376b4d` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:28.701378 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0ebd3d-0e4e-4c82-bbab-befd3639f5fa None admin] RBAC: Authorizing `identity:get_group(group_id=0e1fd22d4d75490e8a4563ebfe376b4d)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:28.703663 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0ebd3d-0e4e-4c82-bbab-befd3639f5fa None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:28.706568 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 184/376] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Aug 26 07:30:28 2022] GET /identity/v3/groups/0e1fd22d4d75490e8a4563ebfe376b4d => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:28.707959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ebd3d-0e4e-4c82-bbab-befd3639f5fa None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:28.852648 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 193/377] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:30:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 07:30:28.853589 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6cd90e-0505-4936-956a-418c7f14e1b9 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:28.884210 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ebd3d-0e4e-4c82-bbab-befd3639f5fa None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:28.901395 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:28.941905 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb8aed-d146-442e-8cdc-85359ff63a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:28.943319 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb8aed-d146-442e-8cdc-85359ff63a17 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:28.943319 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb8aed-d146-442e-8cdc-85359ff63a17 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:28.943319 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb8aed-d146-442e-8cdc-85359ff63a17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:28.945636 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb8aed-d146-442e-8cdc-85359ff63a17 None admin] RBAC: Adding query filter params (group.id=0e1fd22d4d75490e8a4563ebfe376b4d, role.id=865b733dc94e43589d2385826a23e137, scope.project.id=b59ea18f7e2d4d2dbe387a2dbc161c67) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:28.945948 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb8aed-d146-442e-8cdc-85359ff63a17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:28.948351 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb8aed-d146-442e-8cdc-85359ff63a17 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:28.962473 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 185/378] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Aug 26 07:30:28 2022] GET /identity/v3/role_assignments?group.id=0e1fd22d4d75490e8a4563ebfe376b4d&scope.project.id=b59ea18f7e2d4d2dbe387a2dbc161c67&role.id=865b733dc94e43589d2385826a23e137 => generated 260 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:28.963390 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb8aed-d146-442e-8cdc-85359ff63a17 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:29.052550 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6cd90e-0505-4936-956a-418c7f14e1b9 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:29.063157 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:29.123864 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56cf8f3-595f-4699-bf4f-151dafe00fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:29.124800 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56cf8f3-595f-4699-bf4f-151dafe00fd2 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:29.125217 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56cf8f3-595f-4699-bf4f-151dafe00fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:29.125647 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56cf8f3-595f-4699-bf4f-151dafe00fd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:29.127144 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56cf8f3-595f-4699-bf4f-151dafe00fd2 None admin] RBAC: Adding query filter params (group.id=0e1fd22d4d75490e8a4563ebfe376b4d, role.id=854d2a8e89d94d8685ff7d5dc70494b5, scope.project.id=b59ea18f7e2d4d2dbe387a2dbc161c67) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:29.127614 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56cf8f3-595f-4699-bf4f-151dafe00fd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:29.129259 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56cf8f3-595f-4699-bf4f-151dafe00fd2 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:29.154465 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 194/379] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Aug 26 07:30:28 2022] GET /identity/v3/role_assignments?group.id=0e1fd22d4d75490e8a4563ebfe376b4d&scope.project.id=b59ea18f7e2d4d2dbe387a2dbc161c67&role.id=854d2a8e89d94d8685ff7d5dc70494b5 => generated 260 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:29.155429 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56cf8f3-595f-4699-bf4f-151dafe00fd2 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:29.171678 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb8aed-d146-442e-8cdc-85359ff63a17 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:29.214853 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6aba6b-f8b0-4c7b-8d62-1011cbabdcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:29.215879 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6aba6b-f8b0-4c7b-8d62-1011cbabdcf5 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:29.216443 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6aba6b-f8b0-4c7b-8d62-1011cbabdcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:29.216913 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6aba6b-f8b0-4c7b-8d62-1011cbabdcf5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:29.233110 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6aba6b-f8b0-4c7b-8d62-1011cbabdcf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:30:29.241347 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-1d6aba6b-f8b0-4c7b-8d62-1011cbabdcf5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 07:30:29.241347 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:29.241347 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:29.241347 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:29.241347 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:29.241347 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:29.241347 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:29.241347 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:29.241347 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:29.241347 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:29.241347 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:29.241347 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:29.241347 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:30:29.241347 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:30:29.241347 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:30:29.241347 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:30:29.242491 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:30:29.242491 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:30:29.242491 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:30:29.242491 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:30:29.242491 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:29.242491 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:29.242491 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:29.242491 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:29.242491 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:29.242491 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:29.242491 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:29.242491 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:29.242491 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:29.242491 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:29.242491 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:29.242491 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:29.243401 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:29.243401 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:29.243401 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:29.243401 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:29.243401 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:30:29.243401 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:30:29.243401 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:30:29.243401 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:30:29.243401 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:30:29.243401 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:30:29.243401 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 07:30:29.243401 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:30:29.251637 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 186/380] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:30:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:29.256079 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6aba6b-f8b0-4c7b-8d62-1011cbabdcf5 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:29.334728 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:29.358933 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56cf8f3-595f-4699-bf4f-151dafe00fd2 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:29.449607 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cbc287-7c3a-4662-98c8-9bef0e95c3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:29.450280 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbc287-7c3a-4662-98c8-9bef0e95c3c4 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:29.450627 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbc287-7c3a-4662-98c8-9bef0e95c3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:29.450902 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbc287-7c3a-4662-98c8-9bef0e95c3c4 None admin] PATH_INFO: `/v3/projects/05529a2e6f734315b4cede55fbcb5c2c` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:29.453885 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cbc287-7c3a-4662-98c8-9bef0e95c3c4 None admin] RBAC: Authorizing `identity:get_project(project_id=05529a2e6f734315b4cede55fbcb5c2c)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:29.455879 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cbc287-7c3a-4662-98c8-9bef0e95c3c4 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:29.457530 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 195/381] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:30:29 2022] GET /identity/v3/projects/05529a2e6f734315b4cede55fbcb5c2c => generated 344 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:29.459741 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6aba6b-f8b0-4c7b-8d62-1011cbabdcf5 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:29.463891 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cbc287-7c3a-4662-98c8-9bef0e95c3c4 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:29.545704 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6964191-8c8d-427f-8f9c-523791208c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:29.546331 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6964191-8c8d-427f-8f9c-523791208c88 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:29.546605 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6964191-8c8d-427f-8f9c-523791208c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:29.546872 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6964191-8c8d-427f-8f9c-523791208c88 None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:29.546974 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:29.547571 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6964191-8c8d-427f-8f9c-523791208c88 None admin] RBAC: Adding query filter params (name=member) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:29.548414 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6964191-8c8d-427f-8f9c-523791208c88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:29.549864 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6964191-8c8d-427f-8f9c-523791208c88 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:29.562464 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 187/382] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 26 07:30:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:29.568529 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6964191-8c8d-427f-8f9c-523791208c88 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:29.683885 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6964191-8c8d-427f-8f9c-523791208c88 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:29.687359 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:29.735238 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b5899-8884-427c-9b0e-2d9255f88a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:29.735238 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b5899-8884-427c-9b0e-2d9255f88a1d None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:29.735238 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b5899-8884-427c-9b0e-2d9255f88a1d None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:29.736135 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b5899-8884-427c-9b0e-2d9255f88a1d None admin] PATH_INFO: `/v3/groups/0e1fd22d4d75490e8a4563ebfe376b4d` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:29.738426 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1b5899-8884-427c-9b0e-2d9255f88a1d None admin] RBAC: Authorizing `identity:get_group(group_id=0e1fd22d4d75490e8a4563ebfe376b4d)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:29.739938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1b5899-8884-427c-9b0e-2d9255f88a1d None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:29.741717 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 188/383] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Aug 26 07:30:29 2022] GET /identity/v3/groups/0e1fd22d4d75490e8a4563ebfe376b4d => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:29.748679 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cbc287-7c3a-4662-98c8-9bef0e95c3c4 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:29.749718 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e973b4-b92c-4368-9aab-65c4d10021ed None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:29.750001 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e973b4-b92c-4368-9aab-65c4d10021ed None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:29.750278 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e973b4-b92c-4368-9aab-65c4d10021ed None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:29.751977 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 189/384] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 07:30:29.756641 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e973b4-b92c-4368-9aab-65c4d10021ed None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:29.793319 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e869b1-84aa-4a96-a193-66caa0719742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:29.794000 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e869b1-84aa-4a96-a193-66caa0719742 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:29.794278 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e869b1-84aa-4a96-a193-66caa0719742 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:29.794551 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e869b1-84aa-4a96-a193-66caa0719742 None admin] PATH_INFO: `/v3/groups/d7501b95d34b467aa2869b650b27574a` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:29.801375 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e869b1-84aa-4a96-a193-66caa0719742 None admin] RBAC: Authorizing `identity:get_group(group_id=d7501b95d34b467aa2869b650b27574a)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:29.803439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e869b1-84aa-4a96-a193-66caa0719742 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:29.805576 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 196/385] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Aug 26 07:30:29 2022] GET /identity/v3/groups/d7501b95d34b467aa2869b650b27574a => generated 229 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:29.807530 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9fcc38-1e12-4715-a67a-6b9fa7ea70fc None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:29.807805 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9fcc38-1e12-4715-a67a-6b9fa7ea70fc None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:29.808075 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9fcc38-1e12-4715-a67a-6b9fa7ea70fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:29.839012 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-dd9fcc38-1e12-4715-a67a-6b9fa7ea70fc None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:29.839012 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-dd9fcc38-1e12-4715-a67a-6b9fa7ea70fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:29.886928 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e973b4-b92c-4368-9aab-65c4d10021ed None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:29.935898 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 197/386] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:30:29.936066 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e421d83-0c62-46c5-9759-89c42ceac4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:29.937245 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e421d83-0c62-46c5-9759-89c42ceac4fb None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:29.937245 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e421d83-0c62-46c5-9759-89c42ceac4fb None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:29.937245 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e421d83-0c62-46c5-9759-89c42ceac4fb None admin] PATH_INFO: `/v3/projects/3729de3353c34b84aa5d098e5bee6d98` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:29.939381 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e421d83-0c62-46c5-9759-89c42ceac4fb None admin] RBAC: Authorizing `identity:get_project(project_id=3729de3353c34b84aa5d098e5bee6d98)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:29.939804 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9fcc38-1e12-4715-a67a-6b9fa7ea70fc None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:29.942370 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e421d83-0c62-46c5-9759-89c42ceac4fb None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:29.951009 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 190/387] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:30:29 2022] GET /identity/v3/projects/3729de3353c34b84aa5d098e5bee6d98 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:29.951009 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e421d83-0c62-46c5-9759-89c42ceac4fb None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:30.012356 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:30.027938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:30.121037 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9fcc38-1e12-4715-a67a-6b9fa7ea70fc None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:30.168458 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e60e2-8d1e-4133-9f37-e6c49ebe3680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:30.169087 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e60e2-8d1e-4133-9f37-e6c49ebe3680 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:30.169364 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e60e2-8d1e-4133-9f37-e6c49ebe3680 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:30.169634 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e60e2-8d1e-4133-9f37-e6c49ebe3680 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:30.170368 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8e60e2-8d1e-4133-9f37-e6c49ebe3680 None admin] RBAC: Adding query filter params (group.id=d7501b95d34b467aa2869b650b27574a, role.id=07ed857b2feb472f9fa9e7fe0b08582b, scope.project.id=05529a2e6f734315b4cede55fbcb5c2c) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:30.170674 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8e60e2-8d1e-4133-9f37-e6c49ebe3680 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:30.172762 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8e60e2-8d1e-4133-9f37-e6c49ebe3680 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:30.182246 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 198/388] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Aug 26 07:30:29 2022] GET /identity/v3/role_assignments?group.id=d7501b95d34b467aa2869b650b27574a&scope.project.id=05529a2e6f734315b4cede55fbcb5c2c&role.id=07ed857b2feb472f9fa9e7fe0b08582b => generated 260 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:30.215962 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e421d83-0c62-46c5-9759-89c42ceac4fb None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:30.247681 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e60e2-8d1e-4133-9f37-e6c49ebe3680 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:30.263778 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67fc68-23ee-4d24-a43f-2cbb3fb8f9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:30.264825 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67fc68-23ee-4d24-a43f-2cbb3fb8f9cf None admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:30.265314 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67fc68-23ee-4d24-a43f-2cbb3fb8f9cf None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:30.265768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67fc68-23ee-4d24-a43f-2cbb3fb8f9cf None admin] PATH_INFO: `/v3/projects/3729de3353c34b84aa5d098e5bee6d98/groups/0e1fd22d4d75490e8a4563ebfe376b4d/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:30.267972 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67fc68-23ee-4d24-a43f-2cbb3fb8f9cf None admin] RBAC: Authorizing `identity:create_grant(project_id=3729de3353c34b84aa5d098e5bee6d98, group_id=0e1fd22d4d75490e8a4563ebfe376b4d, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:30.269853 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67fc68-23ee-4d24-a43f-2cbb3fb8f9cf None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:30.352610 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 191/389] 10.222.0.42 () {58 vars in 1442 bytes} [Fri Aug 26 07:30:29 2022] PUT /identity/v3/projects/3729de3353c34b84aa5d098e5bee6d98/groups/0e1fd22d4d75490e8a4563ebfe376b4d/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:30:30.388834 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:30.395687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e60e2-8d1e-4133-9f37-e6c49ebe3680 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:30.448436 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69763baa-954f-4903-bf84-b323970a5e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:30.449106 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69763baa-954f-4903-bf84-b323970a5e16 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:30.449381 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69763baa-954f-4903-bf84-b323970a5e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:30.449644 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69763baa-954f-4903-bf84-b323970a5e16 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:30.469588 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69763baa-954f-4903-bf84-b323970a5e16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:30:30.475558 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-69763baa-954f-4903-bf84-b323970a5e16 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 07:30:30.475558 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:30.475558 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:30.475558 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:30.475558 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:30.475558 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:30.475558 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:30.475558 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:30.475558 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:30.475558 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:30.475558 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:30.475558 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:30.475558 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:30:30.475558 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:30:30.475558 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:30:30.475558 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:30:30.476564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:30:30.476564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:30:30.476564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:30:30.476564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:30:30.476564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:30.476564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:30.476564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:30.476564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:30.476564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:30.476564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:30.476564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:30.476564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:30.476564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:30.476564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:30.476564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:30.476564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:30.477399 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:30.477399 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:30.477399 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:30.477399 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:30.477399 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:30:30.477399 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:30:30.477399 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:30:30.477399 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:30:30.477399 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:30:30.477399 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:30:30.477399 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 07:30:30.477399 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:30:30.483564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 199/390] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 26 07:30:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:30.492716 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67fc68-23ee-4d24-a43f-2cbb3fb8f9cf None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:30.676316 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67fc68-23ee-4d24-a43f-2cbb3fb8f9cf None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:30.679435 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:30.728195 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834050a1-525e-40ec-b191-e80ebabb3560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:30.729491 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834050a1-525e-40ec-b191-e80ebabb3560 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:30.729987 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834050a1-525e-40ec-b191-e80ebabb3560 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:30.730346 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834050a1-525e-40ec-b191-e80ebabb3560 None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:30.731153 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834050a1-525e-40ec-b191-e80ebabb3560 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:30.731601 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834050a1-525e-40ec-b191-e80ebabb3560 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:30.733095 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834050a1-525e-40ec-b191-e80ebabb3560 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:30.757207 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 192/391] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:30:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:30.763005 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69763baa-954f-4903-bf84-b323970a5e16 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:30.935010 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69763baa-954f-4903-bf84-b323970a5e16 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:31.041802 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000936e4-a6cd-4b8a-9ba3-17643c03cb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:31.042377 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000936e4-a6cd-4b8a-9ba3-17643c03cb64 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:31.042658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000936e4-a6cd-4b8a-9ba3-17643c03cb64 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:31.042934 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000936e4-a6cd-4b8a-9ba3-17643c03cb64 None admin] PATH_INFO: `/v3/groups/0e1fd22d4d75490e8a4563ebfe376b4d` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:31.044119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000936e4-a6cd-4b8a-9ba3-17643c03cb64 None admin] RBAC: Authorizing `identity:get_group(group_id=0e1fd22d4d75490e8a4563ebfe376b4d)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:31.045623 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000936e4-a6cd-4b8a-9ba3-17643c03cb64 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:31.047508 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 200/392] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Aug 26 07:30:30 2022] GET /identity/v3/groups/0e1fd22d4d75490e8a4563ebfe376b4d => generated 226 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:31.053588 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834050a1-525e-40ec-b191-e80ebabb3560 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:31.221298 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834050a1-525e-40ec-b191-e80ebabb3560 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:31.276026 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290c44b-f869-4412-9a0b-8a43dea25ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:31.277042 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290c44b-f869-4412-9a0b-8a43dea25ba3 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:31.277524 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290c44b-f869-4412-9a0b-8a43dea25ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:31.277996 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290c44b-f869-4412-9a0b-8a43dea25ba3 None admin] PATH_INFO: `/v3/projects/3729de3353c34b84aa5d098e5bee6d98` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:31.283738 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290c44b-f869-4412-9a0b-8a43dea25ba3 None admin] RBAC: Authorizing `identity:get_project(project_id=3729de3353c34b84aa5d098e5bee6d98)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:31.285483 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290c44b-f869-4412-9a0b-8a43dea25ba3 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:31.287418 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 193/393] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:30:31 2022] GET /identity/v3/projects/3729de3353c34b84aa5d098e5bee6d98 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:31.293416 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000936e4-a6cd-4b8a-9ba3-17643c03cb64 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:31.338460 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:31.420371 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000936e4-a6cd-4b8a-9ba3-17643c03cb64 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:31.440545 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eabf92-ad0f-46d2-881e-5d4dd01d2c8c None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:31.441503 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eabf92-ad0f-46d2-881e-5d4dd01d2c8c None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:31.441973 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eabf92-ad0f-46d2-881e-5d4dd01d2c8c None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:31.443901 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 194/394] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:30:31.452453 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8230fa2-e6d7-4016-874b-b19ceace9879 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:31.453068 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8230fa2-e6d7-4016-874b-b19ceace9879 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:31.453560 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8230fa2-e6d7-4016-874b-b19ceace9879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:31.465690 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af084fe-bff7-4783-8219-c7b19ca2bf56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:31.466364 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af084fe-bff7-4783-8219-c7b19ca2bf56 None admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:31.466642 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af084fe-bff7-4783-8219-c7b19ca2bf56 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:31.466978 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af084fe-bff7-4783-8219-c7b19ca2bf56 None admin] PATH_INFO: `/v3/projects/3729de3353c34b84aa5d098e5bee6d98/groups/0e1fd22d4d75490e8a4563ebfe376b4d/roles/865b733dc94e43589d2385826a23e137` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:31.469262 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af084fe-bff7-4783-8219-c7b19ca2bf56 None admin] RBAC: Authorizing `identity:create_grant(project_id=3729de3353c34b84aa5d098e5bee6d98, group_id=0e1fd22d4d75490e8a4563ebfe376b4d, role_id=865b733dc94e43589d2385826a23e137)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:31.472300 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af084fe-bff7-4783-8219-c7b19ca2bf56 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:31.492590 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-b8230fa2-e6d7-4016-874b-b19ceace9879 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:31.493824 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-b8230fa2-e6d7-4016-874b-b19ceace9879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:31.527017 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:31.556818 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 201/395] 10.222.0.42 () {58 vars in 1442 bytes} [Fri Aug 26 07:30:31 2022] PUT /identity/v3/projects/3729de3353c34b84aa5d098e5bee6d98/groups/0e1fd22d4d75490e8a4563ebfe376b4d/roles/865b733dc94e43589d2385826a23e137 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:30:31.576932 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9bd197-627f-47ce-9db0-4542ee5d362c None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:31.577242 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9bd197-627f-47ce-9db0-4542ee5d362c None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:31.578603 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9bd197-627f-47ce-9db0-4542ee5d362c None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:31.582020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 202/396] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 07:30:31.587598 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb9363-4a4d-4f45-beb8-d7d9af2ca815 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:31.587913 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb9363-4a4d-4f45-beb8-d7d9af2ca815 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:31.588443 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb9363-4a4d-4f45-beb8-d7d9af2ca815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:31.635015 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-53fb9363-4a4d-4f45-beb8-d7d9af2ca815 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:31.635015 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-53fb9363-4a4d-4f45-beb8-d7d9af2ca815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:31.641038 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 195/397] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:30:31.766217 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 203/398] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:30:32.054057 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8230fa2-e6d7-4016-874b-b19ceace9879 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:32.175488 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb9363-4a4d-4f45-beb8-d7d9af2ca815 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:32.192696 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:32.301821 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8230fa2-e6d7-4016-874b-b19ceace9879 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:32.381089 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb9363-4a4d-4f45-beb8-d7d9af2ca815 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:32.415778 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf36f27-ad6b-4394-8af1-15d1069a1dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:32.416866 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf36f27-ad6b-4394-8af1-15d1069a1dd4 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:32.417632 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf36f27-ad6b-4394-8af1-15d1069a1dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:32.418105 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf36f27-ad6b-4394-8af1-15d1069a1dd4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:32.442143 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf36f27-ad6b-4394-8af1-15d1069a1dd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:30:32.455431 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-baf36f27-ad6b-4394-8af1-15d1069a1dd4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 07:30:32.455431 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:32.455431 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:32.455431 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:32.455431 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:32.455431 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:32.455431 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:32.455431 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:32.455431 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:32.455431 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:32.455431 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:32.455431 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:32.455431 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:30:32.455431 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:30:32.455431 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:30:32.455431 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:30:32.456372 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:30:32.456372 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:30:32.456372 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:30:32.456372 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:30:32.456372 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:32.456372 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:32.456372 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:32.456372 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:32.456372 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:32.456372 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:32.456372 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:32.456372 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:32.456372 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:32.456372 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:32.456372 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:32.456372 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:32.457162 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:32.457162 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:32.457162 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:32.457162 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:32.457162 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:30:32.457162 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:30:32.457162 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:30:32.457162 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:30:32.457162 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:30:32.457162 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:30:32.457162 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 07:30:32.457162 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:30:32.461460 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 196/399] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 26 07:30:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 407 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:32.473899 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf36f27-ad6b-4394-8af1-15d1069a1dd4 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:32.499144 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9335f-b85b-4fcb-b212-316004a5bb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:32.502027 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9335f-b85b-4fcb-b212-316004a5bb4d None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:32.503365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9335f-b85b-4fcb-b212-316004a5bb4d None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:32.503884 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9335f-b85b-4fcb-b212-316004a5bb4d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:32.540794 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:32.542325 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a9335f-b85b-4fcb-b212-316004a5bb4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:30:32.560346 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-12a9335f-b85b-4fcb-b212-316004a5bb4d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 07:30:32.560346 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:32.560346 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:32.560346 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:32.560346 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:32.560346 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:32.560346 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:32.560346 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:32.560346 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:32.560346 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:32.560346 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:32.560346 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:32.560346 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:30:32.560346 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:30:32.560346 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:30:32.560346 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:30:32.561306 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:30:32.561306 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:30:32.561306 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:30:32.561306 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:30:32.561306 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:32.561306 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:32.561306 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:32.561306 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:32.561306 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:32.561306 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:32.561306 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:32.561306 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:32.561306 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:32.561306 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:32.561306 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:32.561306 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:32.562100 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:32.562100 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:32.562100 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:32.562100 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:32.562100 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:30:32.562100 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:30:32.562100 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:30:32.562100 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:30:32.562100 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:30:32.562100 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:30:32.562100 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 07:30:32.562100 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:30:32.571174 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 204/400] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:30:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:32.575059 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9335f-b85b-4fcb-b212-316004a5bb4d None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:32.698918 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf36f27-ad6b-4394-8af1-15d1069a1dd4 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:32.700467 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:32.744489 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1735e1f3-7b41-4354-a5af-a5dc40de85b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:32.745122 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735e1f3-7b41-4354-a5af-a5dc40de85b9 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:32.745403 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735e1f3-7b41-4354-a5af-a5dc40de85b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:32.745675 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735e1f3-7b41-4354-a5af-a5dc40de85b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:32.746356 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1735e1f3-7b41-4354-a5af-a5dc40de85b9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:32.746656 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1735e1f3-7b41-4354-a5af-a5dc40de85b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:32.748097 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1735e1f3-7b41-4354-a5af-a5dc40de85b9 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:32.754681 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9335f-b85b-4fcb-b212-316004a5bb4d None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:32.758827 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 197/401] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:30:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:32.762134 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358124bd-a067-4267-9fb7-514793585703 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:32.762134 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358124bd-a067-4267-9fb7-514793585703 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:32.762134 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358124bd-a067-4267-9fb7-514793585703 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:32.766337 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 198/402] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:30:32.767880 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358124bd-a067-4267-9fb7-514793585703 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:32.805011 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c2bfc3-b8aa-4e3c-a827-2dbcd177be2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:32.805903 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2bfc3-b8aa-4e3c-a827-2dbcd177be2e None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:32.806185 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2bfc3-b8aa-4e3c-a827-2dbcd177be2e None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:32.806456 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2bfc3-b8aa-4e3c-a827-2dbcd177be2e None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:32.807653 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c2bfc3-b8aa-4e3c-a827-2dbcd177be2e None admin] RBAC: Adding query filter params (name=member) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:32.807966 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c2bfc3-b8aa-4e3c-a827-2dbcd177be2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:32.809612 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c2bfc3-b8aa-4e3c-a827-2dbcd177be2e None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:32.823549 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 205/403] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 26 07:30:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:32.824834 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611287b-2c90-4725-90a8-fab8fb2f4f00 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:32.825122 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611287b-2c90-4725-90a8-fab8fb2f4f00 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:32.825397 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611287b-2c90-4725-90a8-fab8fb2f4f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:32.853969 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-2611287b-2c90-4725-90a8-fab8fb2f4f00 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:32.855559 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-2611287b-2c90-4725-90a8-fab8fb2f4f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:32.879340 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:32.917600 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358124bd-a067-4267-9fb7-514793585703 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:32.962515 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd7252-f8d5-4156-819c-bdfe0a6dc140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:32.963254 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd7252-f8d5-4156-819c-bdfe0a6dc140 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:32.963542 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd7252-f8d5-4156-819c-bdfe0a6dc140 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:32.963837 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd7252-f8d5-4156-819c-bdfe0a6dc140 None admin] PATH_INFO: `/v3/groups/0e1fd22d4d75490e8a4563ebfe376b4d` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:32.964951 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd7252-f8d5-4156-819c-bdfe0a6dc140 None admin] RBAC: Authorizing `identity:get_group(group_id=0e1fd22d4d75490e8a4563ebfe376b4d)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:32.975256 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd7252-f8d5-4156-819c-bdfe0a6dc140 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:32.975420 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 206/404] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:30:32.975420 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2611287b-2c90-4725-90a8-fab8fb2f4f00 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:32.975589 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 199/405] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Aug 26 07:30:32 2022] GET /identity/v3/groups/0e1fd22d4d75490e8a4563ebfe376b4d => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:32.975589 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0dee43-ae38-407e-ad0b-fbb0d2901d72 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:32.975589 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0dee43-ae38-407e-ad0b-fbb0d2901d72 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:32.975589 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0dee43-ae38-407e-ad0b-fbb0d2901d72 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:32.975589 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 200/406] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:30:32.976067 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0dee43-ae38-407e-ad0b-fbb0d2901d72 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:33.070971 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:33.114177 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0dee43-ae38-407e-ad0b-fbb0d2901d72 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:33.118354 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2611287b-2c90-4725-90a8-fab8fb2f4f00 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:33.164592 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2e8ff-376b-47eb-b2b1-5f87586ebb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:33.165225 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499ec07-ea21-414c-8abb-ecd2cafca468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:33.165505 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2e8ff-376b-47eb-b2b1-5f87586ebb45 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:33.165935 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2e8ff-376b-47eb-b2b1-5f87586ebb45 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:33.166308 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2e8ff-376b-47eb-b2b1-5f87586ebb45 None admin] PATH_INFO: `/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:33.166519 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499ec07-ea21-414c-8abb-ecd2cafca468 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:33.166937 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499ec07-ea21-414c-8abb-ecd2cafca468 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:33.167426 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499ec07-ea21-414c-8abb-ecd2cafca468 None admin] PATH_INFO: `/v3/groups/0e1fd22d4d75490e8a4563ebfe376b4d` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:33.167799 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f2e8ff-376b-47eb-b2b1-5f87586ebb45 None admin] RBAC: Authorizing `identity:get_project(project_id=b59ea18f7e2d4d2dbe387a2dbc161c67)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:33.168931 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5499ec07-ea21-414c-8abb-ecd2cafca468 None admin] RBAC: Authorizing `identity:get_group(group_id=0e1fd22d4d75490e8a4563ebfe376b4d)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:33.169506 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f2e8ff-376b-47eb-b2b1-5f87586ebb45 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:33.170743 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5499ec07-ea21-414c-8abb-ecd2cafca468 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:33.176671 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 201/407] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:30:32 2022] GET /identity/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:33.176671 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157699c5-0d03-4bee-b300-d91d54879194 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:33.176671 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157699c5-0d03-4bee-b300-d91d54879194 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:33.176671 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157699c5-0d03-4bee-b300-d91d54879194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:33.179564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 207/408] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Aug 26 07:30:32 2022] GET /identity/v3/groups/0e1fd22d4d75490e8a4563ebfe376b4d => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:33.183409 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499ec07-ea21-414c-8abb-ecd2cafca468 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:33.201724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-157699c5-0d03-4bee-b300-d91d54879194 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:33.204936 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-157699c5-0d03-4bee-b300-d91d54879194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:33.269690 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:33.314698 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 202/409] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:30:33.320534 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157699c5-0d03-4bee-b300-d91d54879194 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:33.432609 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499ec07-ea21-414c-8abb-ecd2cafca468 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:33.494744 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157699c5-0d03-4bee-b300-d91d54879194 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:33.520347 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a7ef4-678e-4127-bb39-11378ddceee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:33.521795 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a7ef4-678e-4127-bb39-11378ddceee8 None admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:33.522439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a7ef4-678e-4127-bb39-11378ddceee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:33.523699 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a7ef4-678e-4127-bb39-11378ddceee8 None admin] PATH_INFO: `/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67/groups/0e1fd22d4d75490e8a4563ebfe376b4d/roles/865b733dc94e43589d2385826a23e137` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:33.528785 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a7ef4-678e-4127-bb39-11378ddceee8 None admin] RBAC: Authorizing `identity:create_grant(project_id=b59ea18f7e2d4d2dbe387a2dbc161c67, group_id=0e1fd22d4d75490e8a4563ebfe376b4d, role_id=865b733dc94e43589d2385826a23e137)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:33.530714 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a7ef4-678e-4127-bb39-11378ddceee8 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:33.536064 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:33.559663 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7caf069-5a42-4961-8399-df3c38ec1864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:33.560696 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7caf069-5a42-4961-8399-df3c38ec1864 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:33.561176 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7caf069-5a42-4961-8399-df3c38ec1864 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:33.561665 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7caf069-5a42-4961-8399-df3c38ec1864 None admin] PATH_INFO: `/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:33.563120 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7caf069-5a42-4961-8399-df3c38ec1864 None admin] RBAC: Authorizing `identity:get_project(project_id=b59ea18f7e2d4d2dbe387a2dbc161c67)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:33.565428 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7caf069-5a42-4961-8399-df3c38ec1864 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:33.576507 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 203/410] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:30:33 2022] GET /identity/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67 => generated 302 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:33.577721 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7caf069-5a42-4961-8399-df3c38ec1864 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:33.595324 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:33.619151 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 208/411] 10.222.0.42 () {58 vars in 1442 bytes} [Fri Aug 26 07:30:33 2022] PUT /identity/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67/groups/0e1fd22d4d75490e8a4563ebfe376b4d/roles/865b733dc94e43589d2385826a23e137 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:30:33.620569 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a7ef4-678e-4127-bb39-11378ddceee8 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:33.778145 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a7ef4-678e-4127-bb39-11378ddceee8 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:33.847021 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c011a7-8ef6-4798-a6c8-cbe0649d0757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:33.848456 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c011a7-8ef6-4798-a6c8-cbe0649d0757 None admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:33.848624 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c011a7-8ef6-4798-a6c8-cbe0649d0757 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:33.850066 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c011a7-8ef6-4798-a6c8-cbe0649d0757 None admin] PATH_INFO: `/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67/groups/0e1fd22d4d75490e8a4563ebfe376b4d/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:33.853835 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c011a7-8ef6-4798-a6c8-cbe0649d0757 None admin] RBAC: Authorizing `identity:create_grant(project_id=b59ea18f7e2d4d2dbe387a2dbc161c67, group_id=0e1fd22d4d75490e8a4563ebfe376b4d, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:33.855753 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c011a7-8ef6-4798-a6c8-cbe0649d0757 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:33.893312 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7caf069-5a42-4961-8399-df3c38ec1864 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:33.955144 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a6225-5623-49f5-946e-e57faafccfed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:33.955976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a6225-5623-49f5-946e-e57faafccfed None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:33.956380 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a6225-5623-49f5-946e-e57faafccfed None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:33.956890 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a6225-5623-49f5-946e-e57faafccfed None admin] PATH_INFO: `/v3/roles/member` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:33.961455 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 209/412] 10.222.0.42 () {58 vars in 1442 bytes} [Fri Aug 26 07:30:33 2022] PUT /identity/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67/groups/0e1fd22d4d75490e8a4563ebfe376b4d/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:30:33.962411 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c011a7-8ef6-4798-a6c8-cbe0649d0757 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:33.991104 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64a6225-5623-49f5-946e-e57faafccfed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:30:34.002820 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-a64a6225-5623-49f5-946e-e57faafccfed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 07:30:34.002820 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:34.002820 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:34.002820 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:34.002820 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:34.002820 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:34.002820 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:34.002820 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:34.002820 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:34.002820 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:34.002820 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:34.002820 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:34.002820 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:30:34.002820 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:30:34.002820 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:30:34.002820 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:30:34.004010 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:30:34.004010 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:30:34.004010 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:30:34.004010 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:30:34.004010 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:34.004010 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:34.004010 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:34.004010 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:34.004010 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:34.004010 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:34.004010 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:34.004010 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:34.004010 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:34.004010 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:34.004010 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:34.004010 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:34.005008 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:34.005008 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:34.005008 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:34.005008 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:34.005008 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:30:34.005008 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:30:34.005008 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:30:34.005008 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:30:34.005008 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:30:34.005008 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:30:34.005008 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 07:30:34.005008 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:30:34.008443 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 204/413] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:30:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 431 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:34.027099 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a6225-5623-49f5-946e-e57faafccfed None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:34.111923 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:34.118012 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:34.168814 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a6225-5623-49f5-946e-e57faafccfed None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:34.202432 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c011a7-8ef6-4798-a6c8-cbe0649d0757 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:34.218522 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80edbdca-91ac-440b-92c9-bbb3a5ddeb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:34.219704 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80edbdca-91ac-440b-92c9-bbb3a5ddeb38 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:34.219704 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80edbdca-91ac-440b-92c9-bbb3a5ddeb38 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:34.220127 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80edbdca-91ac-440b-92c9-bbb3a5ddeb38 None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:34.221304 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80edbdca-91ac-440b-92c9-bbb3a5ddeb38 None admin] RBAC: Adding query filter params (name=member) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:34.221782 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80edbdca-91ac-440b-92c9-bbb3a5ddeb38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:34.224324 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80edbdca-91ac-440b-92c9-bbb3a5ddeb38 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:34.253574 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 205/414] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 26 07:30:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:34.259780 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daff616-2212-45a0-b613-47b7c50e0421 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:34.260736 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daff616-2212-45a0-b613-47b7c50e0421 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:34.261216 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daff616-2212-45a0-b613-47b7c50e0421 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:34.263872 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 206/415] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:34 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:30:34.264955 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66eb2ed-e0a6-458d-8af0-35142cbf817f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:34.265864 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66eb2ed-e0a6-458d-8af0-35142cbf817f None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:34.266347 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66eb2ed-e0a6-458d-8af0-35142cbf817f None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:34.266863 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66eb2ed-e0a6-458d-8af0-35142cbf817f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:34.269398 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daff616-2212-45a0-b613-47b7c50e0421 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:34.294747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66eb2ed-e0a6-458d-8af0-35142cbf817f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:30:34.303471 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-b66eb2ed-e0a6-458d-8af0-35142cbf817f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:30:34.303471 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:34.303471 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:34.303471 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:34.303471 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:34.303471 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:34.303471 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:34.303471 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:34.303471 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:34.303471 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:34.303471 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:34.303471 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:34.303471 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:30:34.303471 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:30:34.303471 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:30:34.303471 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:30:34.304412 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:30:34.304412 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:30:34.304412 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:30:34.304412 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:30:34.304412 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:34.304412 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:34.304412 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:34.304412 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:34.304412 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:34.304412 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:34.304412 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:34.304412 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:34.304412 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:34.304412 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:34.304412 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:34.304412 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:34.305199 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:34.305199 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:34.305199 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:34.305199 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:34.305199 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:30:34.305199 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:30:34.305199 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:30:34.305199 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:30:34.305199 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:30:34.305199 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:30:34.305199 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:30:34.305199 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:30:34.311427 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 210/416] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 26 07:30:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:34.314967 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711b89b-69d3-489e-a8e4-4b5fadd031c5 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:34.315966 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711b89b-69d3-489e-a8e4-4b5fadd031c5 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:34.316913 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711b89b-69d3-489e-a8e4-4b5fadd031c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:34.346847 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-8711b89b-69d3-489e-a8e4-4b5fadd031c5 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:34.349198 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-8711b89b-69d3-489e-a8e4-4b5fadd031c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:34.461926 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 211/417] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:30:34.465549 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711b89b-69d3-489e-a8e4-4b5fadd031c5 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:34.575505 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:34.727040 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daff616-2212-45a0-b613-47b7c50e0421 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:34.840108 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:34.846802 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711b89b-69d3-489e-a8e4-4b5fadd031c5 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:34.857858 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01194906-426a-4c91-8e49-ea8e57a4a5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:34.868815 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01194906-426a-4c91-8e49-ea8e57a4a5fd None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:34.868815 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01194906-426a-4c91-8e49-ea8e57a4a5fd None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:34.868815 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01194906-426a-4c91-8e49-ea8e57a4a5fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:34.955259 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a21cd1-3eeb-4ba2-9f1d-2c3a1137b71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:34.959344 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a21cd1-3eeb-4ba2-9f1d-2c3a1137b71e None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:34.961087 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a21cd1-3eeb-4ba2-9f1d-2c3a1137b71e None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:34.961658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a21cd1-3eeb-4ba2-9f1d-2c3a1137b71e None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:34.965571 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a21cd1-3eeb-4ba2-9f1d-2c3a1137b71e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:34.967519 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a21cd1-3eeb-4ba2-9f1d-2c3a1137b71e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:34.977922 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a21cd1-3eeb-4ba2-9f1d-2c3a1137b71e None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:35.013283 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 212/418] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:30:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 550 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:35.015786 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a21cd1-3eeb-4ba2-9f1d-2c3a1137b71e None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:35.057864 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01194906-426a-4c91-8e49-ea8e57a4a5fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:35.058447 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01194906-426a-4c91-8e49-ea8e57a4a5fd None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:35.143413 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a21cd1-3eeb-4ba2-9f1d-2c3a1137b71e None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:35.152744 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:35.168697 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 207/419] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:30:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 901 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 07:30:35.169661 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01194906-426a-4c91-8e49-ea8e57a4a5fd None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:35.188446 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc615a3-a343-4c34-9f35-021e6fb73d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:35.189618 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc615a3-a343-4c34-9f35-021e6fb73d60 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:35.190094 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc615a3-a343-4c34-9f35-021e6fb73d60 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:35.190598 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc615a3-a343-4c34-9f35-021e6fb73d60 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:35.205106 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc615a3-a343-4c34-9f35-021e6fb73d60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:30:35.205816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:35.220941 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-5dc615a3-a343-4c34-9f35-021e6fb73d60 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 07:30:35.220941 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:35.220941 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:35.220941 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:35.220941 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:35.220941 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:35.220941 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:35.220941 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:35.220941 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:35.220941 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:35.220941 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:35.220941 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:35.220941 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:30:35.220941 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:30:35.220941 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:30:35.220941 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:30:35.221917 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:30:35.221917 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:30:35.221917 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:30:35.221917 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:30:35.221917 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:35.221917 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:35.221917 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:35.221917 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:35.221917 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:35.221917 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:35.221917 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:35.221917 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:35.221917 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:35.221917 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:35.221917 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:35.221917 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:35.222705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:35.222705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:35.222705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:35.222705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:35.222705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:30:35.222705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:30:35.222705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:30:35.222705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:30:35.222705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:30:35.222705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:30:35.222705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 07:30:35.222705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:30:35.224720 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 213/420] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 26 07:30:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:35.225766 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc615a3-a343-4c34-9f35-021e6fb73d60 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:35.301830 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01194906-426a-4c91-8e49-ea8e57a4a5fd None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:35.341198 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d172cef7-f4fc-4c7d-a1a4-fcd79cbe9aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:35.341859 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172cef7-f4fc-4c7d-a1a4-fcd79cbe9aca None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:35.342135 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172cef7-f4fc-4c7d-a1a4-fcd79cbe9aca None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:35.342408 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172cef7-f4fc-4c7d-a1a4-fcd79cbe9aca None admin] PATH_INFO: `/v3/groups/d7501b95d34b467aa2869b650b27574a` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:35.344036 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d172cef7-f4fc-4c7d-a1a4-fcd79cbe9aca None admin] RBAC: Authorizing `identity:get_group(group_id=d7501b95d34b467aa2869b650b27574a)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:35.345533 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d172cef7-f4fc-4c7d-a1a4-fcd79cbe9aca None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:35.347264 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 208/421] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Aug 26 07:30:35 2022] GET /identity/v3/groups/d7501b95d34b467aa2869b650b27574a => generated 229 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:35.348123 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d172cef7-f4fc-4c7d-a1a4-fcd79cbe9aca None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:35.363268 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc615a3-a343-4c34-9f35-021e6fb73d60 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:35.414043 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1622768-c98b-4b56-8a1d-27a936636d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:35.415167 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1622768-c98b-4b56-8a1d-27a936636d6d None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:35.415659 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1622768-c98b-4b56-8a1d-27a936636d6d None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:35.416108 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1622768-c98b-4b56-8a1d-27a936636d6d None admin] PATH_INFO: `/v3/projects/3729de3353c34b84aa5d098e5bee6d98` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:35.417603 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1622768-c98b-4b56-8a1d-27a936636d6d None admin] RBAC: Authorizing `identity:get_project(project_id=3729de3353c34b84aa5d098e5bee6d98)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:35.419352 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1622768-c98b-4b56-8a1d-27a936636d6d None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:35.421764 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 214/422] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:30:35 2022] GET /identity/v3/projects/3729de3353c34b84aa5d098e5bee6d98 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:35.423426 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1622768-c98b-4b56-8a1d-27a936636d6d None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:35.464519 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:35.467867 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:35.469119 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d172cef7-f4fc-4c7d-a1a4-fcd79cbe9aca None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:35.510074 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480e3ae-2639-424b-b8d9-bc507f71d849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:35.510695 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480e3ae-2639-424b-b8d9-bc507f71d849 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:35.510970 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480e3ae-2639-424b-b8d9-bc507f71d849 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:35.511266 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480e3ae-2639-424b-b8d9-bc507f71d849 None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:35.511936 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480e3ae-2639-424b-b8d9-bc507f71d849 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:35.512235 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480e3ae-2639-424b-b8d9-bc507f71d849 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:35.513633 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480e3ae-2639-424b-b8d9-bc507f71d849 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:35.528682 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 209/423] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:30:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:35.529716 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480e3ae-2639-424b-b8d9-bc507f71d849 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:35.555378 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1622768-c98b-4b56-8a1d-27a936636d6d None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:35.596766 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cdd734-ac64-4f46-b5ae-7cbf41e825a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:35.598362 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cdd734-ac64-4f46-b5ae-7cbf41e825a5 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:35.598883 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cdd734-ac64-4f46-b5ae-7cbf41e825a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:35.599390 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cdd734-ac64-4f46-b5ae-7cbf41e825a5 None admin] PATH_INFO: `/v3/projects/05529a2e6f734315b4cede55fbcb5c2c` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:35.601001 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cdd734-ac64-4f46-b5ae-7cbf41e825a5 None admin] RBAC: Authorizing `identity:get_project(project_id=05529a2e6f734315b4cede55fbcb5c2c)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:35.602726 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cdd734-ac64-4f46-b5ae-7cbf41e825a5 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:35.608988 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 215/424] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:30:35 2022] GET /identity/v3/projects/05529a2e6f734315b4cede55fbcb5c2c => generated 344 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:35.610901 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cdd734-ac64-4f46-b5ae-7cbf41e825a5 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:35.649998 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480e3ae-2639-424b-b8d9-bc507f71d849 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:35.696129 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294625b-63a1-47cc-8d4e-24862bff4e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:35.696777 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294625b-63a1-47cc-8d4e-24862bff4e06 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:35.697250 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294625b-63a1-47cc-8d4e-24862bff4e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:35.697528 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294625b-63a1-47cc-8d4e-24862bff4e06 None admin] PATH_INFO: `/v3/groups/0e1fd22d4d75490e8a4563ebfe376b4d` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:35.698794 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294625b-63a1-47cc-8d4e-24862bff4e06 None admin] RBAC: Authorizing `identity:get_group(group_id=0e1fd22d4d75490e8a4563ebfe376b4d)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:35.700393 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294625b-63a1-47cc-8d4e-24862bff4e06 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:35.702298 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 210/425] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Aug 26 07:30:35 2022] GET /identity/v3/groups/0e1fd22d4d75490e8a4563ebfe376b4d => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:35.703072 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294625b-63a1-47cc-8d4e-24862bff4e06 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:35.739185 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:35.753722 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cdd734-ac64-4f46-b5ae-7cbf41e825a5 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:35.756087 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:35.800785 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7bbbbf-b300-4051-a7c9-11eb25cc98e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:35.801561 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7bbbbf-b300-4051-a7c9-11eb25cc98e3 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:35.802019 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7bbbbf-b300-4051-a7c9-11eb25cc98e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:35.802392 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7bbbbf-b300-4051-a7c9-11eb25cc98e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:35.825136 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294625b-63a1-47cc-8d4e-24862bff4e06 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:35.881187 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524196a-0450-456a-afdf-7606fcd5d75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:35.881981 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524196a-0450-456a-afdf-7606fcd5d75d None admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:35.882265 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524196a-0450-456a-afdf-7606fcd5d75d None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:35.882540 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524196a-0450-456a-afdf-7606fcd5d75d None admin] PATH_INFO: `/v3/projects/05529a2e6f734315b4cede55fbcb5c2c/groups/d7501b95d34b467aa2869b650b27574a/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:35.884489 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524196a-0450-456a-afdf-7606fcd5d75d None admin] RBAC: Authorizing `identity:create_grant(project_id=05529a2e6f734315b4cede55fbcb5c2c, group_id=d7501b95d34b467aa2869b650b27574a, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:35.885931 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524196a-0450-456a-afdf-7606fcd5d75d None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:35.888607 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7bbbbf-b300-4051-a7c9-11eb25cc98e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:35.890398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7bbbbf-b300-4051-a7c9-11eb25cc98e3 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:35.995019 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 211/426] 10.222.0.42 () {58 vars in 1442 bytes} [Fri Aug 26 07:30:35 2022] PUT /identity/v3/projects/05529a2e6f734315b4cede55fbcb5c2c/groups/d7501b95d34b467aa2869b650b27574a/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:30:35.995019 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524196a-0450-456a-afdf-7606fcd5d75d None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:36.025200 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 216/427] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:30:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 07:30:36.026846 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f15924-b89a-489c-9f87-49b727440878 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:36.027280 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f15924-b89a-489c-9f87-49b727440878 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:36.027703 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f15924-b89a-489c-9f87-49b727440878 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:36.029202 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 217/428] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:30:36.034762 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f15924-b89a-489c-9f87-49b727440878 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:36.038346 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:36.164485 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:36.192302 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524196a-0450-456a-afdf-7606fcd5d75d None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:36.207191 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f15924-b89a-489c-9f87-49b727440878 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:36.242708 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3624f9-269b-4da1-8f4d-8eff14a40897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:36.243727 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3624f9-269b-4da1-8f4d-8eff14a40897 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:36.244233 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3624f9-269b-4da1-8f4d-8eff14a40897 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:36.244816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3624f9-269b-4da1-8f4d-8eff14a40897 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:36.245749 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3624f9-269b-4da1-8f4d-8eff14a40897 None admin] RBAC: Adding query filter params (group.id=0e1fd22d4d75490e8a4563ebfe376b4d, role.id=854d2a8e89d94d8685ff7d5dc70494b5, scope.project.id=3729de3353c34b84aa5d098e5bee6d98) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:36.246255 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3624f9-269b-4da1-8f4d-8eff14a40897 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:36.247881 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966b8e3-d107-4b13-80eb-645bf14430ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:36.248172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3624f9-269b-4da1-8f4d-8eff14a40897 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:36.253965 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966b8e3-d107-4b13-80eb-645bf14430ab None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:36.253965 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966b8e3-d107-4b13-80eb-645bf14430ab None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:36.253965 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966b8e3-d107-4b13-80eb-645bf14430ab None admin] PATH_INFO: `/v3/projects/3729de3353c34b84aa5d098e5bee6d98` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:36.254793 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966b8e3-d107-4b13-80eb-645bf14430ab None admin] RBAC: Authorizing `identity:get_project(project_id=3729de3353c34b84aa5d098e5bee6d98)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:36.256293 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966b8e3-d107-4b13-80eb-645bf14430ab None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:36.258247 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 218/429] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:30:36 2022] GET /identity/v3/projects/3729de3353c34b84aa5d098e5bee6d98 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:36.264312 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78fd12-f719-4c61-99b7-28e7151e61ec None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:36.264463 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 212/430] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Aug 26 07:30:35 2022] GET /identity/v3/role_assignments?group.id=0e1fd22d4d75490e8a4563ebfe376b4d&scope.project.id=3729de3353c34b84aa5d098e5bee6d98&role.id=854d2a8e89d94d8685ff7d5dc70494b5 => generated 611 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:36.264544 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78fd12-f719-4c61-99b7-28e7151e61ec None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:36.264544 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78fd12-f719-4c61-99b7-28e7151e61ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:36.264698 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b797ae-a571-448f-8645-d9c6f5636dc6 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:36.264698 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b797ae-a571-448f-8645-d9c6f5636dc6 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:36.264698 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b797ae-a571-448f-8645-d9c6f5636dc6 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:36.264698 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 213/431] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:30:36.267473 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b797ae-a571-448f-8645-d9c6f5636dc6 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:36.288486 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-2d78fd12-f719-4c61-99b7-28e7151e61ec None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:36.289792 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-2d78fd12-f719-4c61-99b7-28e7151e61ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:36.399715 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:36.406537 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 219/432] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:30:36.408966 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4293f0d-6b5f-46bf-9b99-9d3cb23a0f53 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:36.417453 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4293f0d-6b5f-46bf-9b99-9d3cb23a0f53 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:36.417453 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4293f0d-6b5f-46bf-9b99-9d3cb23a0f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:36.417665 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b797ae-a571-448f-8645-d9c6f5636dc6 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:36.432604 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-d4293f0d-6b5f-46bf-9b99-9d3cb23a0f53 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:36.434205 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-d4293f0d-6b5f-46bf-9b99-9d3cb23a0f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:36.475537 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08bb85-66a3-493c-a7bb-2624a9ad7d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:36.476748 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08bb85-66a3-493c-a7bb-2624a9ad7d94 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:36.477331 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08bb85-66a3-493c-a7bb-2624a9ad7d94 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:36.477805 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08bb85-66a3-493c-a7bb-2624a9ad7d94 None admin] PATH_INFO: `/v3/groups/0e1fd22d4d75490e8a4563ebfe376b4d` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:36.480792 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc08bb85-66a3-493c-a7bb-2624a9ad7d94 None admin] RBAC: Authorizing `identity:get_group(group_id=0e1fd22d4d75490e8a4563ebfe376b4d)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:36.483890 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc08bb85-66a3-493c-a7bb-2624a9ad7d94 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:36.489741 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 214/433] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Aug 26 07:30:36 2022] GET /identity/v3/groups/0e1fd22d4d75490e8a4563ebfe376b4d => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:36.499871 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08bb85-66a3-493c-a7bb-2624a9ad7d94 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:36.544664 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 220/434] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:30:36.555586 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:36.654512 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08bb85-66a3-493c-a7bb-2624a9ad7d94 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:36.694298 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752b49f-6e4a-4687-b514-2dbc3313360c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:36.694839 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752b49f-6e4a-4687-b514-2dbc3313360c None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:36.695152 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752b49f-6e4a-4687-b514-2dbc3313360c None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:36.696589 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752b49f-6e4a-4687-b514-2dbc3313360c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:36.697326 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3752b49f-6e4a-4687-b514-2dbc3313360c None admin] RBAC: Adding query filter params (group.id=0e1fd22d4d75490e8a4563ebfe376b4d, role.id=865b733dc94e43589d2385826a23e137, scope.project.id=3729de3353c34b84aa5d098e5bee6d98) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:36.697683 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3752b49f-6e4a-4687-b514-2dbc3313360c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:36.699299 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3752b49f-6e4a-4687-b514-2dbc3313360c None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:36.707143 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 215/435] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Aug 26 07:30:36 2022] GET /identity/v3/role_assignments?group.id=0e1fd22d4d75490e8a4563ebfe376b4d&scope.project.id=3729de3353c34b84aa5d098e5bee6d98&role.id=865b733dc94e43589d2385826a23e137 => generated 611 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:30:36.718829 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4293f0d-6b5f-46bf-9b99-9d3cb23a0f53 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:36.849503 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4293f0d-6b5f-46bf-9b99-9d3cb23a0f53 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:36.884975 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:36.891141 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3149658-7d1f-46da-90fe-1ff03d50ed51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:36.892567 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3149658-7d1f-46da-90fe-1ff03d50ed51 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:36.898001 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3149658-7d1f-46da-90fe-1ff03d50ed51 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:36.898001 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3149658-7d1f-46da-90fe-1ff03d50ed51 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:36.904796 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752b49f-6e4a-4687-b514-2dbc3313360c None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:36.913354 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3149658-7d1f-46da-90fe-1ff03d50ed51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:30:36.918541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-a3149658-7d1f-46da-90fe-1ff03d50ed51 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 07:30:36.918541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:36.918541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:36.918541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:36.918541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:36.918541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:36.918541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:36.918541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:36.918541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:36.918541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:36.918541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:36.918541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:36.918541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:30:36.918541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:30:36.918541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:30:36.918541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:30:36.919478 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:30:36.919478 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:30:36.919478 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:30:36.919478 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:30:36.919478 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:36.919478 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:36.919478 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:36.919478 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:36.919478 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:36.919478 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:36.919478 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:36.919478 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:36.919478 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:36.919478 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:36.919478 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:36.919478 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:36.920439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:36.920439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:36.920439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:36.920439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:36.920439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:30:36.920439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:30:36.920439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:30:36.920439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:30:36.920439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:30:36.920439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:30:36.920439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 07:30:36.920439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:30:36.920439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 221/436] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 26 07:30:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:36.929356 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3149658-7d1f-46da-90fe-1ff03d50ed51 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:37.050334 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:37.077072 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752b49f-6e4a-4687-b514-2dbc3313360c None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:37.107100 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3149658-7d1f-46da-90fe-1ff03d50ed51 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:37.139754 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a57e8-f923-4ee1-8092-b6e979d53382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:37.140462 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a57e8-f923-4ee1-8092-b6e979d53382 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:37.140750 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a57e8-f923-4ee1-8092-b6e979d53382 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:37.141003 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a57e8-f923-4ee1-8092-b6e979d53382 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:37.159167 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a57e8-f923-4ee1-8092-b6e979d53382 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:30:37.164005 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-166a57e8-f923-4ee1-8092-b6e979d53382 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 07:30:37.164005 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:37.164005 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:37.164005 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:37.164005 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:37.164005 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:37.164005 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:37.164005 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:37.164005 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:37.164005 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:37.164005 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:37.164005 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:37.164005 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:30:37.164005 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:30:37.164005 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:30:37.164005 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:30:37.164893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:30:37.164893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:30:37.164893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:30:37.164893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:30:37.164893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:37.164893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:37.164893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:37.164893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:37.164893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:37.164893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:37.164893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:37.164893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:37.164893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:37.164893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:37.164893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:37.164893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:37.165693 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:37.165693 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:37.165693 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:37.165693 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:37.165693 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:30:37.165693 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:30:37.165693 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:30:37.165693 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:30:37.165693 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:30:37.165693 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:30:37.165693 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 07:30:37.165693 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:30:37.165693 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 216/437] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:30:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 07:30:37.170432 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0948ca-293a-4014-ad36-b4324eee4730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:37.170432 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0948ca-293a-4014-ad36-b4324eee4730 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:37.170432 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0948ca-293a-4014-ad36-b4324eee4730 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:37.170432 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0948ca-293a-4014-ad36-b4324eee4730 None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:37.170795 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0948ca-293a-4014-ad36-b4324eee4730 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:37.170795 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0948ca-293a-4014-ad36-b4324eee4730 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:37.171324 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a57e8-f923-4ee1-8092-b6e979d53382 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:37.173011 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0948ca-293a-4014-ad36-b4324eee4730 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:37.191030 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 222/438] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:30:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:30:37.196239 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0948ca-293a-4014-ad36-b4324eee4730 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:37.276195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:37.334891 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a57e8-f923-4ee1-8092-b6e979d53382 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:37.346518 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0948ca-293a-4014-ad36-b4324eee4730 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:37.373566 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f779f7-c9ca-4bd1-98f0-0b9864aeb0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:37.374322 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f779f7-c9ca-4bd1-98f0-0b9864aeb0c8 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:37.374666 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f779f7-c9ca-4bd1-98f0-0b9864aeb0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:37.374940 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f779f7-c9ca-4bd1-98f0-0b9864aeb0c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:37.375645 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f779f7-c9ca-4bd1-98f0-0b9864aeb0c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:37.375996 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f779f7-c9ca-4bd1-98f0-0b9864aeb0c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:37.377376 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f779f7-c9ca-4bd1-98f0-0b9864aeb0c8 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:37.386146 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 217/439] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 26 07:30:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:37.392354 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f779f7-c9ca-4bd1-98f0-0b9864aeb0c8 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:37.392711 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53d6f4d-ebf9-40a6-99fc-3ab7f6d9f8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:37.393376 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d6f4d-ebf9-40a6-99fc-3ab7f6d9f8ae None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:37.393700 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d6f4d-ebf9-40a6-99fc-3ab7f6d9f8ae None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:37.393969 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d6f4d-ebf9-40a6-99fc-3ab7f6d9f8ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:37.403126 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:37.472150 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53d6f4d-ebf9-40a6-99fc-3ab7f6d9f8ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:37.473795 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53d6f4d-ebf9-40a6-99fc-3ab7f6d9f8ae None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:37.508674 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f779f7-c9ca-4bd1-98f0-0b9864aeb0c8 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:37.535081 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:37.547935 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704bc5a8-5897-4f37-8227-f36387108aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:37.548706 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704bc5a8-5897-4f37-8227-f36387108aa4 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:37.552081 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704bc5a8-5897-4f37-8227-f36387108aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:37.552081 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704bc5a8-5897-4f37-8227-f36387108aa4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:37.589008 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 223/440] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:30:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 07:30:37.595208 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53d6f4d-ebf9-40a6-99fc-3ab7f6d9f8ae None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:37.639514 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704bc5a8-5897-4f37-8227-f36387108aa4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:37.641007 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704bc5a8-5897-4f37-8227-f36387108aa4 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:37.660753 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:37.733526 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53d6f4d-ebf9-40a6-99fc-3ab7f6d9f8ae None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:37.775025 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 218/441] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:30:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 07:30:37.776466 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879bd8f-499e-4b16-9774-ca4a05c34357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:37.777096 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879bd8f-499e-4b16-9774-ca4a05c34357 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:37.777369 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879bd8f-499e-4b16-9774-ca4a05c34357 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:37.777633 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879bd8f-499e-4b16-9774-ca4a05c34357 None admin] PATH_INFO: `/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:37.779042 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f879bd8f-499e-4b16-9774-ca4a05c34357 None admin] RBAC: Authorizing `identity:get_project(project_id=b59ea18f7e2d4d2dbe387a2dbc161c67)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:37.779178 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704bc5a8-5897-4f37-8227-f36387108aa4 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:37.780491 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f879bd8f-499e-4b16-9774-ca4a05c34357 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:37.783354 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 224/442] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:30:37 2022] GET /identity/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:30:37.787605 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879bd8f-499e-4b16-9774-ca4a05c34357 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:37.811245 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:37.901861 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704bc5a8-5897-4f37-8227-f36387108aa4 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:37.911892 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:37.919923 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879bd8f-499e-4b16-9774-ca4a05c34357 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:37.958217 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af50e8-80a7-42a3-b158-a67a582a4fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:37.959165 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af50e8-80a7-42a3-b158-a67a582a4fe4 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:37.959511 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af50e8-80a7-42a3-b158-a67a582a4fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:37.959871 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af50e8-80a7-42a3-b158-a67a582a4fe4 None admin] PATH_INFO: `/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:37.961070 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50af50e8-80a7-42a3-b158-a67a582a4fe4 None admin] RBAC: Authorizing `identity:get_project(project_id=b59ea18f7e2d4d2dbe387a2dbc161c67)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:37.962596 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50af50e8-80a7-42a3-b158-a67a582a4fe4 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:37.964158 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 219/443] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:30:37 2022] GET /identity/v3/projects/b59ea18f7e2d4d2dbe387a2dbc161c67 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:30:37.966239 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d749c13-e8bd-4804-b079-77ebe9eae0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:37.966946 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d749c13-e8bd-4804-b079-77ebe9eae0c4 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:37.967323 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d749c13-e8bd-4804-b079-77ebe9eae0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:37.967722 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d749c13-e8bd-4804-b079-77ebe9eae0c4 None admin] PATH_INFO: `/v3/groups/0e1fd22d4d75490e8a4563ebfe376b4d` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:37.969208 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d749c13-e8bd-4804-b079-77ebe9eae0c4 None admin] RBAC: Authorizing `identity:get_group(group_id=0e1fd22d4d75490e8a4563ebfe376b4d)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:37.970096 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af50e8-80a7-42a3-b158-a67a582a4fe4 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:37.971401 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d749c13-e8bd-4804-b079-77ebe9eae0c4 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:37.973143 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 225/444] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Aug 26 07:30:37 2022] GET /identity/v3/groups/0e1fd22d4d75490e8a4563ebfe376b4d => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:30:37.978927 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d749c13-e8bd-4804-b079-77ebe9eae0c4 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:38.092066 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:38.096137 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af50e8-80a7-42a3-b158-a67a582a4fe4 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:38.105059 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d749c13-e8bd-4804-b079-77ebe9eae0c4 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:38.133525 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167a705-f531-4faf-bb7d-d32467980f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:38.134271 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167a705-f531-4faf-bb7d-d32467980f80 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:38.134557 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167a705-f531-4faf-bb7d-d32467980f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:38.134876 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167a705-f531-4faf-bb7d-d32467980f80 None admin] PATH_INFO: `/v3/groups/0e1fd22d4d75490e8a4563ebfe376b4d` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:38.136131 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1167a705-f531-4faf-bb7d-d32467980f80 None admin] RBAC: Authorizing `identity:get_group(group_id=0e1fd22d4d75490e8a4563ebfe376b4d)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:38.137756 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1167a705-f531-4faf-bb7d-d32467980f80 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:38.139828 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 220/445] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Aug 26 07:30:37 2022] GET /identity/v3/groups/0e1fd22d4d75490e8a4563ebfe376b4d => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:30:38.144406 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854c5f1-0cf0-457e-bb61-b0a5ab05d109 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:38.144636 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854c5f1-0cf0-457e-bb61-b0a5ab05d109 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:38.144908 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854c5f1-0cf0-457e-bb61-b0a5ab05d109 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:38.147464 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 221/446] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:30:38.147561 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea19c71-5d38-440d-9c13-1ede1b142f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:38.147653 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854c5f1-0cf0-457e-bb61-b0a5ab05d109 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:38.147724 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea19c71-5d38-440d-9c13-1ede1b142f6c None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:38.147724 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea19c71-5d38-440d-9c13-1ede1b142f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:38.148011 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea19c71-5d38-440d-9c13-1ede1b142f6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:38.148844 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea19c71-5d38-440d-9c13-1ede1b142f6c None admin] RBAC: Adding query filter params (group.id=0e1fd22d4d75490e8a4563ebfe376b4d, role.id=865b733dc94e43589d2385826a23e137, scope.project.id=b59ea18f7e2d4d2dbe387a2dbc161c67) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:38.149146 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea19c71-5d38-440d-9c13-1ede1b142f6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:38.151493 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea19c71-5d38-440d-9c13-1ede1b142f6c None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:38.160041 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 226/447] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Aug 26 07:30:37 2022] GET /identity/v3/role_assignments?group.id=0e1fd22d4d75490e8a4563ebfe376b4d&scope.project.id=b59ea18f7e2d4d2dbe387a2dbc161c67&role.id=865b733dc94e43589d2385826a23e137 => generated 611 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:30:38.161552 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3716326-7587-4355-8cef-8466109c57f1 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:38.161835 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3716326-7587-4355-8cef-8466109c57f1 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:38.162107 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3716326-7587-4355-8cef-8466109c57f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:38.182595 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-f3716326-7587-4355-8cef-8466109c57f1 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:38.183907 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-f3716326-7587-4355-8cef-8466109c57f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:38.206252 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:38.270355 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 227/448] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:30:38.276640 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854c5f1-0cf0-457e-bb61-b0a5ab05d109 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:38.323657 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747b274-012f-4312-baa7-cec5bd4ce6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:38.324352 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747b274-012f-4312-baa7-cec5bd4ce6c1 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:38.324584 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747b274-012f-4312-baa7-cec5bd4ce6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:38.324855 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747b274-012f-4312-baa7-cec5bd4ce6c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:38.325599 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747b274-012f-4312-baa7-cec5bd4ce6c1 None admin] RBAC: Adding query filter params (group.id=0e1fd22d4d75490e8a4563ebfe376b4d, role.id=854d2a8e89d94d8685ff7d5dc70494b5, scope.project.id=b59ea18f7e2d4d2dbe387a2dbc161c67) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:38.325902 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747b274-012f-4312-baa7-cec5bd4ce6c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:38.327603 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747b274-012f-4312-baa7-cec5bd4ce6c1 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:38.335194 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 222/449] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Aug 26 07:30:38 2022] GET /identity/v3/role_assignments?group.id=0e1fd22d4d75490e8a4563ebfe376b4d&scope.project.id=b59ea18f7e2d4d2dbe387a2dbc161c67&role.id=854d2a8e89d94d8685ff7d5dc70494b5 => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:38.553116 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3716326-7587-4355-8cef-8466109c57f1 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:38.649743 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:38.668788 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3716326-7587-4355-8cef-8466109c57f1 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:38.714343 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5300b-cbfe-4fdf-854b-0fd162f47bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:38.715352 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5300b-cbfe-4fdf-854b-0fd162f47bff None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:38.715625 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5300b-cbfe-4fdf-854b-0fd162f47bff None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:38.715891 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5300b-cbfe-4fdf-854b-0fd162f47bff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:38.728196 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5300b-cbfe-4fdf-854b-0fd162f47bff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:30:38.732960 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-fdd5300b-cbfe-4fdf-854b-0fd162f47bff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:30:38.732960 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:38.732960 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:38.732960 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:38.732960 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:38.732960 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:38.732960 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:38.732960 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:38.732960 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:38.732960 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:38.732960 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:38.732960 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:38.732960 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:30:38.732960 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:30:38.732960 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:30:38.732960 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:30:38.734338 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:30:38.734338 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:30:38.734338 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:30:38.734338 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:30:38.734338 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:38.734338 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:38.734338 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:38.734338 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:38.734338 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:38.734338 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:38.734338 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:38.734338 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:38.734338 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:38.734338 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:38.734338 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:38.734338 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:38.735839 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:38.735839 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:38.735839 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:38.735839 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:38.735839 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:30:38.735839 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:30:38.735839 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:30:38.735839 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:30:38.735839 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:30:38.735839 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:30:38.735839 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:30:38.735839 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:30:38.735839 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 228/450] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 26 07:30:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:38.740737 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747b274-012f-4312-baa7-cec5bd4ce6c1 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:38.852936 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747b274-012f-4312-baa7-cec5bd4ce6c1 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:38.860671 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:38.891592 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95084a5a-a504-45bb-856a-c40a2975176e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:38.892222 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95084a5a-a504-45bb-856a-c40a2975176e None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:38.892489 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95084a5a-a504-45bb-856a-c40a2975176e None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:38.892763 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95084a5a-a504-45bb-856a-c40a2975176e None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:38.893450 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95084a5a-a504-45bb-856a-c40a2975176e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:38.893754 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95084a5a-a504-45bb-856a-c40a2975176e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:38.895193 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95084a5a-a504-45bb-856a-c40a2975176e None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:38.904464 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 223/451] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:30:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:38.910267 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5300b-cbfe-4fdf-854b-0fd162f47bff None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:39.012688 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5300b-cbfe-4fdf-854b-0fd162f47bff None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:39.046148 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae8913-957e-4aa4-9b91-ced03dd6e3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:39.046752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae8913-957e-4aa4-9b91-ced03dd6e3d9 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:39.047058 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae8913-957e-4aa4-9b91-ced03dd6e3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:39.048330 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae8913-957e-4aa4-9b91-ced03dd6e3d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:39.060950 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:39.117692 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ae8913-957e-4aa4-9b91-ced03dd6e3d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:39.119204 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ae8913-957e-4aa4-9b91-ced03dd6e3d9 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:39.223161 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 229/452] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:30:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 07:30:39.228986 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95084a5a-a504-45bb-856a-c40a2975176e None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:39.336176 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95084a5a-a504-45bb-856a-c40a2975176e None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:39.371694 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b9a5c-8b8c-4442-bef0-0dce89ea88a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:39.372249 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b9a5c-8b8c-4442-bef0-0dce89ea88a0 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:39.372530 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b9a5c-8b8c-4442-bef0-0dce89ea88a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:39.372807 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b9a5c-8b8c-4442-bef0-0dce89ea88a0 None admin] PATH_INFO: `/v3/projects/05529a2e6f734315b4cede55fbcb5c2c` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:39.374010 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b9a5c-8b8c-4442-bef0-0dce89ea88a0 None admin] RBAC: Authorizing `identity:get_project(project_id=05529a2e6f734315b4cede55fbcb5c2c)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:39.375446 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b9a5c-8b8c-4442-bef0-0dce89ea88a0 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:39.377712 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 224/453] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:30:39 2022] GET /identity/v3/projects/05529a2e6f734315b4cede55fbcb5c2c => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:39.383414 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae8913-957e-4aa4-9b91-ced03dd6e3d9 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:39.429289 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:39.486297 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae8913-957e-4aa4-9b91-ced03dd6e3d9 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:39.521472 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e739c-8ec2-4513-b4b9-bce13ea78a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:39.522102 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e739c-8ec2-4513-b4b9-bce13ea78a4c None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:39.522377 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e739c-8ec2-4513-b4b9-bce13ea78a4c None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:39.522647 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e739c-8ec2-4513-b4b9-bce13ea78a4c None admin] PATH_INFO: `/v3/groups/d7501b95d34b467aa2869b650b27574a` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:39.523849 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927e739c-8ec2-4513-b4b9-bce13ea78a4c None admin] RBAC: Authorizing `identity:get_group(group_id=d7501b95d34b467aa2869b650b27574a)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:39.525290 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927e739c-8ec2-4513-b4b9-bce13ea78a4c None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:39.526856 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 230/454] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Aug 26 07:30:39 2022] GET /identity/v3/groups/d7501b95d34b467aa2869b650b27574a => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:39.533419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b9a5c-8b8c-4442-bef0-0dce89ea88a0 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:39.570497 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:39.635624 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b9a5c-8b8c-4442-bef0-0dce89ea88a0 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:39.674291 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a43793b-7530-4b97-b11a-13614cca2bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:39.674902 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43793b-7530-4b97-b11a-13614cca2bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:39.675206 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43793b-7530-4b97-b11a-13614cca2bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:39.675476 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43793b-7530-4b97-b11a-13614cca2bb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:39.676544 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a43793b-7530-4b97-b11a-13614cca2bb0 None admin] RBAC: Adding query filter params (group.id=d7501b95d34b467aa2869b650b27574a, role.id=07ed857b2feb472f9fa9e7fe0b08582b, scope.project.id=05529a2e6f734315b4cede55fbcb5c2c) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:39.676857 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a43793b-7530-4b97-b11a-13614cca2bb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:39.678330 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a43793b-7530-4b97-b11a-13614cca2bb0 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:39.684340 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 225/455] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Aug 26 07:30:39 2022] GET /identity/v3/role_assignments?group.id=d7501b95d34b467aa2869b650b27574a&scope.project.id=05529a2e6f734315b4cede55fbcb5c2c&role.id=07ed857b2feb472f9fa9e7fe0b08582b => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:42.112080 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b60aaf-6b1d-4989-8576-186b4ca603ac None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:42.112080 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b60aaf-6b1d-4989-8576-186b4ca603ac None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:42.112080 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b60aaf-6b1d-4989-8576-186b4ca603ac None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:42.112080 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 231/456] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:30:42.128766 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529509b-5313-44b2-9a22-b57db69a6f3c None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:42.129235 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529509b-5313-44b2-9a22-b57db69a6f3c None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:42.129407 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529509b-5313-44b2-9a22-b57db69a6f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:42.156597 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-0529509b-5313-44b2-9a22-b57db69a6f3c None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:42.158051 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-0529509b-5313-44b2-9a22-b57db69a6f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:42.269817 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 226/457] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:30:42.523479 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9aa0e-155b-4ff4-9807-147684749950 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:42.523479 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9aa0e-155b-4ff4-9807-147684749950 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:42.523479 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9aa0e-155b-4ff4-9807-147684749950 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:42.524138 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 232/458] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:30:42.528678 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc28c51-4465-4768-b718-408096683aa5 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:42.529193 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc28c51-4465-4768-b718-408096683aa5 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:42.529636 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc28c51-4465-4768-b718-408096683aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:42.557743 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-2fc28c51-4465-4768-b718-408096683aa5 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:42.559316 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-2fc28c51-4465-4768-b718-408096683aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:42.588130 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9aa0e-155b-4ff4-9807-147684749950 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:42.605373 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:42.661332 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 227/459] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 07:30:42.671164 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77946f6-782d-4358-a5bf-4be9c406ef1b None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:42.671164 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77946f6-782d-4358-a5bf-4be9c406ef1b None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:42.671164 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77946f6-782d-4358-a5bf-4be9c406ef1b None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:42.671164 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 228/460] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:30:42.685744 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92368be-c08c-46f7-8d08-c23b37f0e17f None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:42.686374 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92368be-c08c-46f7-8d08-c23b37f0e17f None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:42.686844 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92368be-c08c-46f7-8d08-c23b37f0e17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:42.720391 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-d92368be-c08c-46f7-8d08-c23b37f0e17f None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:42.729101 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-d92368be-c08c-46f7-8d08-c23b37f0e17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:42.756248 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9aa0e-155b-4ff4-9807-147684749950 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:42.783885 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:42.863272 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b81f3-9719-4b51-8acf-0593eeb26e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:42.864236 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b81f3-9719-4b51-8acf-0593eeb26e49 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:42.864654 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b81f3-9719-4b51-8acf-0593eeb26e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:42.865151 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b81f3-9719-4b51-8acf-0593eeb26e49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:42.876144 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 229/461] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 07:30:42.877728 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf516a-14d3-40ac-9b35-62b2d7b9f791 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:42.880313 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf516a-14d3-40ac-9b35-62b2d7b9f791 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:42.882207 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf516a-14d3-40ac-9b35-62b2d7b9f791 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:42.883884 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 230/462] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:30:42.885046 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4b81f3-9719-4b51-8acf-0593eeb26e49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:42.886714 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4b81f3-9719-4b51-8acf-0593eeb26e49 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:42.894384 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e6a60-26ee-4f9f-afa7-fca4b1a360f6 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:42.895172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e6a60-26ee-4f9f-afa7-fca4b1a360f6 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:42.895588 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e6a60-26ee-4f9f-afa7-fca4b1a360f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:42.922237 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-ee4b81f3-9719-4b51-8acf-0593eeb26e49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:30:42.922237 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:42.922237 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:42.922237 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:42.922237 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:42.922237 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:42.922237 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:42.922237 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:42.922237 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:42.922237 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:42.922237 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:42.922237 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:42.922237 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:30:42.922237 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:30:42.922237 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:30:42.922237 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:30:42.923831 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:42.923831 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:42.923831 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:42.923831 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:42.923831 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:42.923831 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:42.923831 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:42.923831 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:42.923831 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:42.923831 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:42.923831 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:42.923831 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:42.923831 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:42.923831 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:42.923831 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:42.923831 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:42.923831 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:30:42.924673 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:30:42.924673 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:30:42.924673 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:30:42.932025 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 233/463] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:30:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:42.934780 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-ea0e6a60-26ee-4f9f-afa7-fca4b1a360f6 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:42.936703 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b81f3-9719-4b51-8acf-0593eeb26e49 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:42.941066 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-ea0e6a60-26ee-4f9f-afa7-fca4b1a360f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:43.048015 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 231/464] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 26 07:30:43.048990 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e6a60-26ee-4f9f-afa7-fca4b1a360f6 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:43.090856 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:43.102698 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b81f3-9719-4b51-8acf-0593eeb26e49 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:43.184497 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80058a8-23a4-43c5-9a51-4640a473f996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:43.188946 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80058a8-23a4-43c5-9a51-4640a473f996 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:43.189486 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80058a8-23a4-43c5-9a51-4640a473f996 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:43.189953 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80058a8-23a4-43c5-9a51-4640a473f996 None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:43.191102 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80058a8-23a4-43c5-9a51-4640a473f996 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:43.192256 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80058a8-23a4-43c5-9a51-4640a473f996 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:43.194381 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80058a8-23a4-43c5-9a51-4640a473f996 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:43.209748 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 234/465] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:30:43.210914 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80058a8-23a4-43c5-9a51-4640a473f996 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:43.234223 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e6a60-26ee-4f9f-afa7-fca4b1a360f6 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:43.255021 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:43.282684 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c6ab3-80a4-44a0-8344-f81cb31292b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:43.283824 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c6ab3-80a4-44a0-8344-f81cb31292b7 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:43.284250 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c6ab3-80a4-44a0-8344-f81cb31292b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:43.284750 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c6ab3-80a4-44a0-8344-f81cb31292b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:43.296560 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c6ab3-80a4-44a0-8344-f81cb31292b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:43.299202 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c6ab3-80a4-44a0-8344-f81cb31292b7 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:43.321946 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-405c6ab3-80a4-44a0-8344-f81cb31292b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:30:43.321946 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:43.321946 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:43.321946 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:43.321946 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:43.321946 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:43.321946 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:43.321946 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:43.321946 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:43.321946 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:43.321946 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:43.321946 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:43.321946 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:30:43.321946 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:30:43.321946 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:30:43.321946 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:30:43.323709 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:43.323709 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:43.323709 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:43.323709 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:43.323709 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:43.323709 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:43.323709 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:43.323709 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:43.323709 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:43.323709 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:43.323709 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:43.323709 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:43.323709 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:43.323709 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:43.323709 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:43.323709 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:43.323709 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:30:43.325450 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:30:43.325450 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:30:43.325450 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:30:43.330269 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 232/466] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:30:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:43.332594 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c6ab3-80a4-44a0-8344-f81cb31292b7 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:43.347359 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80058a8-23a4-43c5-9a51-4640a473f996 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:43.399304 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92737338-3dd4-4eb7-a66f-cd2de045f87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:43.400382 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92737338-3dd4-4eb7-a66f-cd2de045f87c None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:43.401015 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92737338-3dd4-4eb7-a66f-cd2de045f87c None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:43.401939 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92737338-3dd4-4eb7-a66f-cd2de045f87c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:43.419181 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92737338-3dd4-4eb7-a66f-cd2de045f87c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:43.421188 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92737338-3dd4-4eb7-a66f-cd2de045f87c None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:43.426222 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:43.440590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-92737338-3dd4-4eb7-a66f-cd2de045f87c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:30:43.440590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:43.440590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:43.440590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:43.440590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:43.440590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:43.440590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:43.440590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:43.440590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:43.440590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:43.440590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:43.440590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:43.440590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:30:43.440590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:30:43.440590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:30:43.440590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:30:43.441569 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:43.441569 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:43.441569 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:43.441569 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:43.441569 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:43.441569 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:43.441569 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:43.441569 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:43.441569 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:43.441569 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:43.441569 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:43.441569 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:43.441569 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:43.441569 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:43.441569 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:43.441569 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:43.441569 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:30:43.443243 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:30:43.443243 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:30:43.443243 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:30:43.443243 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 235/467] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:30:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:43.447611 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92737338-3dd4-4eb7-a66f-cd2de045f87c None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:43.464848 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c6ab3-80a4-44a0-8344-f81cb31292b7 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:43.504749 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913e8c94-b5b4-4e14-9084-8f6342bdb770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:43.505471 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e8c94-b5b4-4e14-9084-8f6342bdb770 None admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:43.505814 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e8c94-b5b4-4e14-9084-8f6342bdb770 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:43.506150 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e8c94-b5b4-4e14-9084-8f6342bdb770 None admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:43.506866 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913e8c94-b5b4-4e14-9084-8f6342bdb770 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:43.512335 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913e8c94-b5b4-4e14-9084-8f6342bdb770 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:43.541910 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:43.569488 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92737338-3dd4-4eb7-a66f-cd2de045f87c None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:43.604874 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f439b9a0-ecee-491b-b6bc-47d85134a7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:43.605484 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439b9a0-ecee-491b-b6bc-47d85134a7f8 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:43.605765 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439b9a0-ecee-491b-b6bc-47d85134a7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:43.606040 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439b9a0-ecee-491b-b6bc-47d85134a7f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:43.606696 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f439b9a0-ecee-491b-b6bc-47d85134a7f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:43.607032 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f439b9a0-ecee-491b-b6bc-47d85134a7f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:43.608436 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f439b9a0-ecee-491b-b6bc-47d85134a7f8 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:43.621727 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 233/468] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 26 07:30:43 2022] POST /identity/v3/users => generated 246 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:30:43.622409 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 236/469] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:30:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:43.623156 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913e8c94-b5b4-4e14-9084-8f6342bdb770 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:43.623261 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f439b9a0-ecee-491b-b6bc-47d85134a7f8 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:43.777324 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913e8c94-b5b4-4e14-9084-8f6342bdb770 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:43.784793 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f439b9a0-ecee-491b-b6bc-47d85134a7f8 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:43.810495 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:43.830190 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f654f-4edb-4409-9a2b-dc2a5f8a2336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:43.830190 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f654f-4edb-4409-9a2b-dc2a5f8a2336 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:43.830190 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f654f-4edb-4409-9a2b-dc2a5f8a2336 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:43.830190 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f654f-4edb-4409-9a2b-dc2a5f8a2336 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:43.840509 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f654f-4edb-4409-9a2b-dc2a5f8a2336 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:43.842078 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f654f-4edb-4409-9a2b-dc2a5f8a2336 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:43.846062 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac9535-4a7a-4c0a-8653-3789613f0abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:43.846695 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac9535-4a7a-4c0a-8653-3789613f0abb None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:43.846979 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac9535-4a7a-4c0a-8653-3789613f0abb None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:43.847279 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac9535-4a7a-4c0a-8653-3789613f0abb None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:43.847948 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfac9535-4a7a-4c0a-8653-3789613f0abb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:43.848254 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfac9535-4a7a-4c0a-8653-3789613f0abb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:43.849731 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfac9535-4a7a-4c0a-8653-3789613f0abb None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:43.853507 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:43.865011 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 237/470] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:30:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:43.867813 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac9535-4a7a-4c0a-8653-3789613f0abb None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:43.867912 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-d76f654f-4edb-4409-9a2b-dc2a5f8a2336 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:30:43.867912 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:43.867912 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:43.867912 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:43.867912 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:43.867912 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:43.867912 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:43.867912 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:43.867912 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:43.867912 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:43.867912 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:43.867912 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:43.867912 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:30:43.867912 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:30:43.867912 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:30:43.867912 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:30:43.868951 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:43.868951 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:43.868951 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:43.868951 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:43.868951 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:43.868951 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:43.868951 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:43.868951 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:43.868951 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:43.868951 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:43.868951 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:43.868951 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:43.868951 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:43.868951 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:43.868951 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:43.868951 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:43.868951 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:30:43.869785 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:30:43.869785 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:30:43.869785 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:30:43.869785 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 234/471] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:30:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:43.874541 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f654f-4edb-4409-9a2b-dc2a5f8a2336 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:43.996984 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f654f-4edb-4409-9a2b-dc2a5f8a2336 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:43.998714 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac9535-4a7a-4c0a-8653-3789613f0abb None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:44.036682 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f70341-a644-4047-9f61-2e283c1be8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:44.037306 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f70341-a644-4047-9f61-2e283c1be8ca None admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:44.037592 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f70341-a644-4047-9f61-2e283c1be8ca None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:44.037868 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f70341-a644-4047-9f61-2e283c1be8ca None admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:44.038531 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f70341-a644-4047-9f61-2e283c1be8ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:44.040018 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f70341-a644-4047-9f61-2e283c1be8ca None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:44.040249 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0063e170-df6d-48f5-8f72-e6c66e0d7d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:44.041074 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063e170-df6d-48f5-8f72-e6c66e0d7d96 None admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:44.041543 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063e170-df6d-48f5-8f72-e6c66e0d7d96 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:44.042005 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063e170-df6d-48f5-8f72-e6c66e0d7d96 None admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:44.042939 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0063e170-df6d-48f5-8f72-e6c66e0d7d96 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:44.044563 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0063e170-df6d-48f5-8f72-e6c66e0d7d96 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:44.154121 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 235/472] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 26 07:30:43 2022] POST /identity/v3/users => generated 248 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:30:44.155185 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f70341-a644-4047-9f61-2e283c1be8ca None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:44.175420 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 238/473] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 26 07:30:43 2022] POST /identity/v3/users => generated 248 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:30:44.178103 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8e492-9ef7-44cb-b446-5564efbb2d99 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:44.178815 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8e492-9ef7-44cb-b446-5564efbb2d99 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:44.179525 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8e492-9ef7-44cb-b446-5564efbb2d99 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:44.190087 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 239/474] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:44 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:30:44.197153 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28865876-c38a-41e3-ad55-cc71bb4285d0 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:44.198004 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28865876-c38a-41e3-ad55-cc71bb4285d0 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:44.198944 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28865876-c38a-41e3-ad55-cc71bb4285d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:44.202057 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:44.241505 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-28865876-c38a-41e3-ad55-cc71bb4285d0 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:44.244359 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-28865876-c38a-41e3-ad55-cc71bb4285d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:44.301172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f70341-a644-4047-9f61-2e283c1be8ca None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:44.354724 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:44.397103 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 240/475] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 07:30:44.419088 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741297c-7710-4124-8897-b73637ad0b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:44.419088 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741297c-7710-4124-8897-b73637ad0b58 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:44.419088 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741297c-7710-4124-8897-b73637ad0b58 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:44.419088 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741297c-7710-4124-8897-b73637ad0b58 None admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:44.419460 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741297c-7710-4124-8897-b73637ad0b58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:44.419460 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741297c-7710-4124-8897-b73637ad0b58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:44.423010 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741297c-7710-4124-8897-b73637ad0b58 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:44.454104 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 236/476] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:44.459983 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28865876-c38a-41e3-ad55-cc71bb4285d0 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:44.579038 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28865876-c38a-41e3-ad55-cc71bb4285d0 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:44.614428 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acaa786-880b-4030-af79-449d7c105c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:44.615029 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acaa786-880b-4030-af79-449d7c105c7e None admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:44.615316 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acaa786-880b-4030-af79-449d7c105c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:44.619024 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acaa786-880b-4030-af79-449d7c105c7e None admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:44.619024 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acaa786-880b-4030-af79-449d7c105c7e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:44.619024 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acaa786-880b-4030-af79-449d7c105c7e None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:44.692733 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741297c-7710-4124-8897-b73637ad0b58 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:44.725046 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 241/477] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 26 07:30:44 2022] POST /identity/v3/users => generated 249 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:30:44.876694 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:44.885805 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741297c-7710-4124-8897-b73637ad0b58 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:44.981545 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e8b79-640a-486d-82de-87df28bd9c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:44.982099 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e8b79-640a-486d-82de-87df28bd9c2e None admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:44.982384 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e8b79-640a-486d-82de-87df28bd9c2e None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:44.982660 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e8b79-640a-486d-82de-87df28bd9c2e None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:44.983381 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742e8b79-640a-486d-82de-87df28bd9c2e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:44.985315 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742e8b79-640a-486d-82de-87df28bd9c2e None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:45.018504 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.sql.core [None req-742e8b79-640a-486d-82de-87df28bd9c2e None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 26 07:30:45.018504 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 26 07:30:45.018504 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [parameters: {'id': '46a29657584f4e8db9c145a511cedef8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 26 07:30:45.018504 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81927) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 26 07:30:45.038244 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-742e8b79-640a-486d-82de-87df28bd9c2e None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 26 07:30:45.038244 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:45.038244 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 07:30:45.038244 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 07:30:45.038244 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 07:30:45.038244 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 07:30:45.038244 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 07:30:45.038244 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 07:30:45.038244 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 07:30:45.038244 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application conn.query(q) Aug 26 07:30:45.038244 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 07:30:45.038244 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 07:30:45.038244 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 07:30:45.038244 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application result.read() Aug 26 07:30:45.038244 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 07:30:45.039198 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 07:30:45.039198 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 07:30:45.039198 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 07:30:45.039198 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 07:30:45.039198 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 07:30:45.039198 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 07:30:45.039198 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 07:30:45.039198 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 26 07:30:45.039198 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:30:45.039198 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 26 07:30:45.039198 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:30:45.039198 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:45.039198 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 26 07:30:45.039198 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 26 07:30:45.039198 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 26 07:30:45.039198 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return ref.to_dict() Aug 26 07:30:45.039198 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 07:30:45.039198 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application next(self.gen) Aug 26 07:30:45.040116 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 26 07:30:45.040116 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application yield resource Aug 26 07:30:45.040116 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 07:30:45.040116 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application next(self.gen) Aug 26 07:30:45.040116 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 26 07:30:45.040116 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self.session.rollback() Aug 26 07:30:45.040116 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 26 07:30:45.040116 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self.force_reraise() Aug 26 07:30:45.040116 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 26 07:30:45.040116 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise self.value Aug 26 07:30:45.040116 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 26 07:30:45.040116 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 26 07:30:45.040116 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 26 07:30:45.040116 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application session.commit() Aug 26 07:30:45.040116 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 26 07:30:45.040116 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 26 07:30:45.040116 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 26 07:30:45.040959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self._prepare_impl() Aug 26 07:30:45.040959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 26 07:30:45.040959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self.session.flush() Aug 26 07:30:45.040959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 26 07:30:45.040959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self._flush(objects) Aug 26 07:30:45.040959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 26 07:30:45.040959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 26 07:30:45.040959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 26 07:30:45.040959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application compat.raise_( Aug 26 07:30:45.040959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 07:30:45.040959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception Aug 26 07:30:45.040959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 26 07:30:45.040959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application flush_context.execute() Aug 26 07:30:45.040959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 26 07:30:45.040959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rec.execute(self) Aug 26 07:30:45.040959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 26 07:30:45.040959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 26 07:30:45.041891 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 26 07:30:45.041891 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 26 07:30:45.041891 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 26 07:30:45.041891 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 26 07:30:45.041891 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 26 07:30:45.041891 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 26 07:30:45.041891 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 26 07:30:45.041891 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 26 07:30:45.041891 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 26 07:30:45.041891 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 26 07:30:45.041891 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 26 07:30:45.041891 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 26 07:30:45.041891 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 26 07:30:45.041891 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 26 07:30:45.041891 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 07:30:45.041891 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception Aug 26 07:30:45.044434 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 07:30:45.044434 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 07:30:45.044434 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 07:30:45.044434 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 07:30:45.044434 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 07:30:45.044434 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 07:30:45.044434 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 07:30:45.044434 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application conn.query(q) Aug 26 07:30:45.044434 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 07:30:45.044434 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 07:30:45.044434 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 07:30:45.044434 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application result.read() Aug 26 07:30:45.044434 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 07:30:45.044434 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 07:30:45.044434 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 07:30:45.044434 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 07:30:45.046376 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 07:30:45.046376 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 07:30:45.046376 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 07:30:45.046376 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 07:30:45.046376 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 26 07:30:45.046376 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 26 07:30:45.046376 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [parameters: {'id': '46a29657584f4e8db9c145a511cedef8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 26 07:30:45.046376 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 26 07:30:45.046376 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:30:45.046376 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 07:30:45.046376 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:30:45.046376 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:45.046376 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:45.046376 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:45.046376 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:45.046376 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:45.049335 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:45.049335 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:45.049335 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:45.049335 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:45.049335 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:45.049335 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:45.049335 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 26 07:30:45.049335 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 26 07:30:45.049335 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:45.049335 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:45.049335 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 26 07:30:45.049335 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 26 07:30:45.049335 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 26 07:30:45.049335 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 26 07:30:45.049335 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 26 07:30:45.049335 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:30:45.051389 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 237/478] 10.222.0.42 () {60 vars in 1131 bytes} [Fri Aug 26 07:30:44 2022] POST /identity/v3/roles => generated 144 bytes in 348 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:45.051528 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acaa786-880b-4030-af79-449d7c105c7e None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:45.119263 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:45.190463 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acaa786-880b-4030-af79-449d7c105c7e None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:45.230670 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03327232-f5fd-4ecd-92fd-d42bcd2e846c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:45.231353 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03327232-f5fd-4ecd-92fd-d42bcd2e846c None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:45.231740 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03327232-f5fd-4ecd-92fd-d42bcd2e846c None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:45.231898 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03327232-f5fd-4ecd-92fd-d42bcd2e846c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:45.245199 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03327232-f5fd-4ecd-92fd-d42bcd2e846c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:30:45.251602 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-03327232-f5fd-4ecd-92fd-d42bcd2e846c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 07:30:45.251602 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:45.251602 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:45.251602 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:45.251602 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:45.251602 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:45.251602 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:45.251602 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:45.251602 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:45.251602 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:45.251602 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:45.251602 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:45.251602 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:30:45.251602 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:30:45.251602 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:30:45.251602 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:30:45.253175 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:30:45.253175 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:30:45.253175 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:30:45.253175 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:30:45.253175 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:45.253175 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:45.253175 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:45.253175 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:45.253175 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:45.253175 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:45.253175 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:45.253175 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:45.253175 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:45.253175 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:45.253175 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:45.253175 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:45.254496 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:45.254496 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:45.254496 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:45.254496 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:45.254496 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:30:45.254496 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:30:45.254496 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:30:45.254496 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:30:45.254496 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:30:45.254496 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:30:45.254496 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 07:30:45.254496 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:30:45.254496 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 242/479] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 26 07:30:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:45.259188 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e8b79-640a-486d-82de-87df28bd9c2e None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:45.448573 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e8b79-640a-486d-82de-87df28bd9c2e None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:45.520545 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a38667-eae7-4bb6-9175-422baceb611a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:45.521112 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a38667-eae7-4bb6-9175-422baceb611a None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:45.521399 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a38667-eae7-4bb6-9175-422baceb611a None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:45.521676 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a38667-eae7-4bb6-9175-422baceb611a None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:45.522369 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a38667-eae7-4bb6-9175-422baceb611a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:45.522807 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a38667-eae7-4bb6-9175-422baceb611a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:45.524320 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a38667-eae7-4bb6-9175-422baceb611a None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:45.543967 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 238/480] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:30:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:46.187219 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42333718-d216-4001-bbd2-8090441e5cac None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:46.188494 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42333718-d216-4001-bbd2-8090441e5cac None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:46.189575 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42333718-d216-4001-bbd2-8090441e5cac None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:46.191527 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 243/481] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:30:46.198088 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924722d3-be12-46a8-bb65-f4a90fcb642a None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:46.198679 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924722d3-be12-46a8-bb65-f4a90fcb642a None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:46.199199 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924722d3-be12-46a8-bb65-f4a90fcb642a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:46.259844 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-924722d3-be12-46a8-bb65-f4a90fcb642a None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:46.261404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-924722d3-be12-46a8-bb65-f4a90fcb642a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:46.282459 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:46.351238 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 239/482] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:30:46.638491 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554ede0-1908-43d6-aed2-a5ca8dc663ba None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:46.639349 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554ede0-1908-43d6-aed2-a5ca8dc663ba None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:46.639834 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554ede0-1908-43d6-aed2-a5ca8dc663ba None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:46.641790 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 244/483] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:30:46.647209 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070b846-675d-4174-ba27-f7d345f1b4de None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:46.648222 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070b846-675d-4174-ba27-f7d345f1b4de None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:46.648713 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070b846-675d-4174-ba27-f7d345f1b4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:46.671952 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-7070b846-675d-4174-ba27-f7d345f1b4de None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:46.674031 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-7070b846-675d-4174-ba27-f7d345f1b4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:46.777315 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554ede0-1908-43d6-aed2-a5ca8dc663ba None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:46.812663 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 240/484] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:30:46.899474 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554ede0-1908-43d6-aed2-a5ca8dc663ba None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:46.911439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:46.936862 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1836b-c70f-4ae8-8e83-bb54c9d88715 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:46.936862 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1836b-c70f-4ae8-8e83-bb54c9d88715 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:46.936862 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1836b-c70f-4ae8-8e83-bb54c9d88715 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:46.936862 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 241/485] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:30:46.944469 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c544d8b-4c0f-4b68-baea-7a9a22a3a5d6 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:46.944752 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c544d8b-4c0f-4b68-baea-7a9a22a3a5d6 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:46.945029 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c544d8b-4c0f-4b68-baea-7a9a22a3a5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:46.952831 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1d5fb-1ab7-47de-a3cf-2763c1f293f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:46.954334 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1d5fb-1ab7-47de-a3cf-2763c1f293f7 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:46.954793 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1d5fb-1ab7-47de-a3cf-2763c1f293f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:46.955088 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1d5fb-1ab7-47de-a3cf-2763c1f293f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:46.979216 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf1d5fb-1ab7-47de-a3cf-2763c1f293f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:30:46.983981 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-fdf1d5fb-1ab7-47de-a3cf-2763c1f293f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 07:30:46.983981 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:46.983981 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:46.983981 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:46.983981 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:46.983981 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:46.983981 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:46.983981 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:46.983981 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:46.983981 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:46.983981 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:46.983981 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:46.983981 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:30:46.983981 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:30:46.983981 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:30:46.983981 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:30:46.984940 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:30:46.984940 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:30:46.984940 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:30:46.984940 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:30:46.984940 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:46.984940 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:46.984940 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:46.984940 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:46.984940 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:46.984940 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:46.984940 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:46.984940 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:46.984940 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:46.984940 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:46.984940 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:46.984940 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:46.985782 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:46.985782 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:46.985782 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:46.985782 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:46.985782 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:30:46.985782 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:30:46.985782 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:30:46.985782 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:30:46.985782 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:30:46.985782 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:30:46.985782 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 07:30:46.985782 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:30:46.985782 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 245/486] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 26 07:30:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:46.986526 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-1c544d8b-4c0f-4b68-baea-7a9a22a3a5d6 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:46.988455 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-1c544d8b-4c0f-4b68-baea-7a9a22a3a5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:46.999674 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1d5fb-1ab7-47de-a3cf-2763c1f293f7 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:47.132469 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1d5fb-1ab7-47de-a3cf-2763c1f293f7 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:47.173013 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 242/487] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:30:47.173764 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c544d8b-4c0f-4b68-baea-7a9a22a3a5d6 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:47.181510 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec64cb1-4877-4572-bf60-f4b06292c2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:47.182129 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec64cb1-4877-4572-bf60-f4b06292c2a6 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:47.182409 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec64cb1-4877-4572-bf60-f4b06292c2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:47.182677 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec64cb1-4877-4572-bf60-f4b06292c2a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:47.183385 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec64cb1-4877-4572-bf60-f4b06292c2a6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:47.183689 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec64cb1-4877-4572-bf60-f4b06292c2a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:47.185214 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec64cb1-4877-4572-bf60-f4b06292c2a6 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:47.195674 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 246/488] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 26 07:30:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:47.203405 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:47.206408 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec64cb1-4877-4572-bf60-f4b06292c2a6 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:47.257934 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:47.329102 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c544d8b-4c0f-4b68-baea-7a9a22a3a5d6 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:47.372911 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec64cb1-4877-4572-bf60-f4b06292c2a6 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:47.408003 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e308b-8e67-4793-9979-60e24f95efe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:47.408736 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e308b-8e67-4793-9979-60e24f95efe7 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:47.408988 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e308b-8e67-4793-9979-60e24f95efe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:47.409324 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e308b-8e67-4793-9979-60e24f95efe7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:47.428574 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e308b-8e67-4793-9979-60e24f95efe7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:30:47.429950 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3c5c8-5435-404a-9fd1-bf666a44698d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:47.430591 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3c5c8-5435-404a-9fd1-bf666a44698d None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:47.430864 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3c5c8-5435-404a-9fd1-bf666a44698d None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:47.431163 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3c5c8-5435-404a-9fd1-bf666a44698d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:47.436211 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-bd3e308b-8e67-4793-9979-60e24f95efe7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 07:30:47.436211 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:47.436211 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:47.436211 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:47.436211 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:47.436211 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:47.436211 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:47.436211 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:47.436211 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:47.436211 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:47.436211 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:47.436211 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:47.436211 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:30:47.436211 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:30:47.436211 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:30:47.436211 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:30:47.437176 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:30:47.437176 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:30:47.437176 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:30:47.437176 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:30:47.437176 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:47.437176 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:47.437176 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:47.437176 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:47.437176 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:47.437176 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:47.437176 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:47.437176 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:47.437176 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:47.437176 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:47.437176 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:47.437176 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:47.438607 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:47.438607 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:47.438607 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:47.438607 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:47.438607 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:30:47.438607 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:30:47.438607 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:30:47.438607 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:30:47.438607 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:30:47.438607 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:30:47.438607 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 07:30:47.438607 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:30:47.438607 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 243/489] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 26 07:30:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:47.448051 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e308b-8e67-4793-9979-60e24f95efe7 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:47.453549 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b3c5c8-5435-404a-9fd1-bf666a44698d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:47.457066 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b3c5c8-5435-404a-9fd1-bf666a44698d None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:47.488387 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-93b3c5c8-5435-404a-9fd1-bf666a44698d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:30:47.488387 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:47.488387 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:47.488387 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:47.488387 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:47.488387 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:47.488387 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:47.488387 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:47.488387 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:47.488387 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:47.488387 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:47.488387 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:47.488387 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:30:47.488387 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:30:47.488387 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:30:47.488387 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:30:47.489363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:47.489363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:47.489363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:47.489363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:47.489363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:47.489363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:47.489363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:47.489363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:47.489363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:47.489363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:47.489363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:47.489363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:47.489363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:47.489363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:47.489363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:47.489363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:47.489363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:30:47.490239 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:30:47.490239 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:30:47.490239 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:30:47.490239 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 247/490] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:30:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:47.490888 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3c5c8-5435-404a-9fd1-bf666a44698d None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:47.545832 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:47.584753 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e308b-8e67-4793-9979-60e24f95efe7 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:47.605992 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:47.624747 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dfe86e-306e-41f0-bd9e-9cef46a42e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:47.625852 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dfe86e-306e-41f0-bd9e-9cef46a42e68 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:47.625852 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dfe86e-306e-41f0-bd9e-9cef46a42e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:47.626065 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dfe86e-306e-41f0-bd9e-9cef46a42e68 None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:47.626770 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dfe86e-306e-41f0-bd9e-9cef46a42e68 None admin] RBAC: Adding query filter params (name=service) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:47.627124 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dfe86e-306e-41f0-bd9e-9cef46a42e68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:47.628616 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dfe86e-306e-41f0-bd9e-9cef46a42e68 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:47.637815 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 244/491] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 26 07:30:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:47.638869 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dfe86e-306e-41f0-bd9e-9cef46a42e68 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:47.646375 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3c5c8-5435-404a-9fd1-bf666a44698d None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:47.687080 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e882d2-227c-4f1b-8fb2-007c45e28ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:47.687719 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e882d2-227c-4f1b-8fb2-007c45e28ebf None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:47.688089 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e882d2-227c-4f1b-8fb2-007c45e28ebf None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:47.688434 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e882d2-227c-4f1b-8fb2-007c45e28ebf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:47.700305 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e882d2-227c-4f1b-8fb2-007c45e28ebf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:30:47.706157 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-04e882d2-227c-4f1b-8fb2-007c45e28ebf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 07:30:47.706157 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:47.706157 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:47.706157 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:47.706157 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:47.706157 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:47.706157 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:47.706157 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:47.706157 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:47.706157 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:47.706157 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:47.706157 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:47.706157 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:30:47.706157 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:30:47.706157 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:30:47.706157 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:30:47.707331 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:30:47.707331 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:30:47.707331 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:30:47.707331 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:30:47.707331 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:47.707331 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:47.707331 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:47.707331 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:47.707331 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:47.707331 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:47.707331 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:47.707331 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:47.707331 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:47.707331 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:47.707331 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:47.707331 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:47.708325 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:47.708325 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:47.708325 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:47.708325 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:47.708325 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:30:47.708325 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:30:47.708325 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:30:47.708325 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:30:47.708325 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:30:47.708325 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:30:47.708325 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 07:30:47.708325 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:30:47.709498 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 248/492] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 26 07:30:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:47.710306 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e882d2-227c-4f1b-8fb2-007c45e28ebf None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:47.777273 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dfe86e-306e-41f0-bd9e-9cef46a42e68 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:47.824284 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666134f-a9fb-47c7-a363-f8a46cc77245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:47.824993 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666134f-a9fb-47c7-a363-f8a46cc77245 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:47.825338 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666134f-a9fb-47c7-a363-f8a46cc77245 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:47.825679 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666134f-a9fb-47c7-a363-f8a46cc77245 None admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:47.826399 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666134f-a9fb-47c7-a363-f8a46cc77245 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:47.826769 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666134f-a9fb-47c7-a363-f8a46cc77245 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:47.828389 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666134f-a9fb-47c7-a363-f8a46cc77245 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:47.831037 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:47.842470 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 245/493] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:30:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:47.845259 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf7ed8-8c0e-4c9c-8181-eea513b4bf85 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:47.845259 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf7ed8-8c0e-4c9c-8181-eea513b4bf85 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:47.845259 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf7ed8-8c0e-4c9c-8181-eea513b4bf85 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:47.851215 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 246/494] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:30:47.851215 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf7ed8-8c0e-4c9c-8181-eea513b4bf85 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:47.855619 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e882d2-227c-4f1b-8fb2-007c45e28ebf None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:47.892651 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:47.899913 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027485c-901d-4149-8d5c-e03d8f22433e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:47.900572 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027485c-901d-4149-8d5c-e03d8f22433e None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:47.900838 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027485c-901d-4149-8d5c-e03d8f22433e None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:47.901121 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027485c-901d-4149-8d5c-e03d8f22433e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:47.920515 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027485c-901d-4149-8d5c-e03d8f22433e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:47.922030 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027485c-901d-4149-8d5c-e03d8f22433e None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:47.940457 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-f027485c-901d-4149-8d5c-e03d8f22433e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:30:47.940457 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:47.940457 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:47.940457 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:47.940457 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:47.940457 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:47.940457 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:47.940457 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:47.940457 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:47.940457 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:47.940457 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:47.940457 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:47.940457 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:30:47.940457 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:30:47.940457 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:30:47.940457 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:30:47.941398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:47.941398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:47.941398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:47.941398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:47.941398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:47.941398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:47.941398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:47.941398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:47.941398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:47.941398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:47.941398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:47.941398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:47.941398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:47.941398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:47.941398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:47.941398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:47.941398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:30:47.942231 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:30:47.942231 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:30:47.942231 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:30:47.946900 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 249/495] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:30:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:47.947684 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027485c-901d-4149-8d5c-e03d8f22433e None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:47.997841 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf7ed8-8c0e-4c9c-8181-eea513b4bf85 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:48.041130 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9373da1-0c64-4fd2-9fe2-72a8f572a039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:48.041759 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9373da1-0c64-4fd2-9fe2-72a8f572a039 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:48.042044 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9373da1-0c64-4fd2-9fe2-72a8f572a039 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:48.042317 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9373da1-0c64-4fd2-9fe2-72a8f572a039 None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:48.043012 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9373da1-0c64-4fd2-9fe2-72a8f572a039 None admin] RBAC: Adding query filter params (name=service) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:48.043347 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9373da1-0c64-4fd2-9fe2-72a8f572a039 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:48.044743 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9373da1-0c64-4fd2-9fe2-72a8f572a039 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:48.055344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 247/496] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 26 07:30:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:48.057180 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a13afe-ced7-4ee4-92bc-2cb562ebddd2 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:48.057492 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a13afe-ced7-4ee4-92bc-2cb562ebddd2 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:48.057772 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a13afe-ced7-4ee4-92bc-2cb562ebddd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:48.073614 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027485c-901d-4149-8d5c-e03d8f22433e None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:48.084251 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-b5a13afe-ced7-4ee4-92bc-2cb562ebddd2 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:48.085940 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-b5a13afe-ced7-4ee4-92bc-2cb562ebddd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:48.124228 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4c5a6-d8cb-47a6-b91c-b74a24d10f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:48.124877 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4c5a6-d8cb-47a6-b91c-b74a24d10f1f None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:48.125160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4c5a6-d8cb-47a6-b91c-b74a24d10f1f None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:48.125496 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4c5a6-d8cb-47a6-b91c-b74a24d10f1f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:48.134259 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4c5a6-d8cb-47a6-b91c-b74a24d10f1f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:48.135747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4c5a6-d8cb-47a6-b91c-b74a24d10f1f None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:48.150296 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:48.150485 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-73f4c5a6-d8cb-47a6-b91c-b74a24d10f1f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 07:30:48.150485 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:48.150485 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:48.150485 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:48.150485 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:48.150485 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:48.150485 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:48.150485 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:48.150485 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:48.150485 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:48.150485 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:48.150485 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:48.150485 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 07:30:48.150485 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 07:30:48.150485 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 07:30:48.150485 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 07:30:48.151397 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:48.151397 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:48.151397 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 07:30:48.151397 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:30:48.151397 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 07:30:48.151397 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:30:48.151397 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:48.151397 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:48.151397 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:48.151397 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:48.151397 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:48.151397 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:48.151397 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:48.151397 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:48.151397 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:48.151397 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:48.151397 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:48.151397 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:48.152284 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:48.152284 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:48.152284 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 07:30:48.152284 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 07:30:48.152284 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 07:30:48.152284 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 07:30:48.152284 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 07:30:48.152284 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 07:30:48.152284 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 07:30:48.152284 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:30:48.156246 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 250/497] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Aug 26 07:30:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:48.158395 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4c5a6-d8cb-47a6-b91c-b74a24d10f1f None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:48.168388 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 248/498] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:30:48.169312 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a13afe-ced7-4ee4-92bc-2cb562ebddd2 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:48.212298 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:48.298358 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4c5a6-d8cb-47a6-b91c-b74a24d10f1f None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:48.309002 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a13afe-ced7-4ee4-92bc-2cb562ebddd2 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:48.339683 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e123e01-61c8-4087-8fa8-3b977ec4b18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:48.340699 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e123e01-61c8-4087-8fa8-3b977ec4b18f None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:48.340980 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e123e01-61c8-4087-8fa8-3b977ec4b18f None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:48.341253 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e123e01-61c8-4087-8fa8-3b977ec4b18f None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:48.341907 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e123e01-61c8-4087-8fa8-3b977ec4b18f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:48.342209 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e123e01-61c8-4087-8fa8-3b977ec4b18f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:48.343929 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e123e01-61c8-4087-8fa8-3b977ec4b18f None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:48.359737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 251/499] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:48.360997 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e434d-d230-49a9-90ff-206430f4afe1 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:48.361283 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e434d-d230-49a9-90ff-206430f4afe1 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:48.361556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e434d-d230-49a9-90ff-206430f4afe1 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:48.365464 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 252/500] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:30:48.365464 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e434d-d230-49a9-90ff-206430f4afe1 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:48.371305 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35688e4-143b-4799-ac4a-d12baac2bf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:48.372062 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35688e4-143b-4799-ac4a-d12baac2bf59 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:48.372416 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35688e4-143b-4799-ac4a-d12baac2bf59 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:48.372758 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35688e4-143b-4799-ac4a-d12baac2bf59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:48.385159 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35688e4-143b-4799-ac4a-d12baac2bf59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:48.386764 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35688e4-143b-4799-ac4a-d12baac2bf59 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:48.408338 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-e35688e4-143b-4799-ac4a-d12baac2bf59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:30:48.408338 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:48.408338 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:48.408338 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:48.408338 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:48.408338 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:48.408338 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:48.408338 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:48.408338 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:48.408338 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:48.408338 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:48.408338 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:48.408338 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:30:48.408338 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:30:48.408338 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:30:48.408338 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:30:48.409509 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:48.409509 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:48.409509 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:48.409509 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:48.409509 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:48.409509 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:48.409509 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:48.409509 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:48.409509 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:48.409509 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:48.409509 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:48.409509 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:48.409509 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:48.409509 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:48.409509 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:48.409509 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:48.409509 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:30:48.410680 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:30:48.410680 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:30:48.410680 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:30:48.411155 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 249/501] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:30:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:48.412038 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35688e4-143b-4799-ac4a-d12baac2bf59 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:48.456667 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:48.499329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e434d-d230-49a9-90ff-206430f4afe1 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:48.501971 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:48.532880 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35688e4-143b-4799-ac4a-d12baac2bf59 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:48.536507 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f92e9b-d0c1-4ac3-a56f-209d466f0fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:48.537120 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f92e9b-d0c1-4ac3-a56f-209d466f0fc0 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:48.537395 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f92e9b-d0c1-4ac3-a56f-209d466f0fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:48.537663 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f92e9b-d0c1-4ac3-a56f-209d466f0fc0 None admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:48.538391 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f92e9b-d0c1-4ac3-a56f-209d466f0fc0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:48.538690 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f92e9b-d0c1-4ac3-a56f-209d466f0fc0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:48.540160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f92e9b-d0c1-4ac3-a56f-209d466f0fc0 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:48.578583 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5d14c-0205-4f96-bb6e-d14b6bd06b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:48.579522 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5d14c-0205-4f96-bb6e-d14b6bd06b93 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:48.579802 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5d14c-0205-4f96-bb6e-d14b6bd06b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:48.580046 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 253/502] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Aug 26 07:30:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:48.580203 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5d14c-0205-4f96-bb6e-d14b6bd06b93 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:48.581375 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a31a75-122d-47ed-a4d6-8bc92b3f8f1b None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:48.581659 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a31a75-122d-47ed-a4d6-8bc92b3f8f1b None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:48.581933 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a31a75-122d-47ed-a4d6-8bc92b3f8f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:48.588860 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5d14c-0205-4f96-bb6e-d14b6bd06b93 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:48.590332 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5d14c-0205-4f96-bb6e-d14b6bd06b93 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:48.607275 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-77a31a75-122d-47ed-a4d6-8bc92b3f8f1b None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:48.608361 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-16f5d14c-0205-4f96-bb6e-d14b6bd06b93 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 26 07:30:48.608361 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:48.608361 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:48.608361 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:48.608361 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:48.608361 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:48.608361 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:48.608361 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:48.608361 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:48.608361 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:48.608361 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:48.608361 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:48.608361 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 07:30:48.608361 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 07:30:48.608361 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 07:30:48.608361 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 07:30:48.609404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:48.609404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:48.609404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 07:30:48.609404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:30:48.609404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 07:30:48.609404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:30:48.609404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:48.609404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:48.609404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:48.609404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:48.609404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:48.609404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:48.609404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:48.609404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:48.609404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:48.609404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:48.609404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:48.609404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:48.610851 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:48.610851 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:48.610851 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 07:30:48.610851 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 07:30:48.610851 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 07:30:48.610851 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 07:30:48.610851 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 07:30:48.610851 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 07:30:48.610851 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 26 07:30:48.610851 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:30:48.611912 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-77a31a75-122d-47ed-a4d6-8bc92b3f8f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:48.612004 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 250/503] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:30:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:48.612004 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5d14c-0205-4f96-bb6e-d14b6bd06b93 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:48.688966 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 254/504] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:30:48.690108 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a31a75-122d-47ed-a4d6-8bc92b3f8f1b None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:48.741440 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:48.748757 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5d14c-0205-4f96-bb6e-d14b6bd06b93 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:48.799729 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9677d-21f6-40d8-820e-cde8d471e0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:48.800385 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9677d-21f6-40d8-820e-cde8d471e0c4 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:48.800609 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9677d-21f6-40d8-820e-cde8d471e0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:48.800877 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9677d-21f6-40d8-820e-cde8d471e0c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:48.801528 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a9677d-21f6-40d8-820e-cde8d471e0c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:48.801827 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a9677d-21f6-40d8-820e-cde8d471e0c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:48.803426 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a9677d-21f6-40d8-820e-cde8d471e0c4 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:48.810898 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:48.816295 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 251/505] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:48.819908 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9677d-21f6-40d8-820e-cde8d471e0c4 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:48.831747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a31a75-122d-47ed-a4d6-8bc92b3f8f1b None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:48.874054 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4d659-006d-4157-8eb0-28edcf8e88b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:48.874752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4d659-006d-4157-8eb0-28edcf8e88b3 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:48.875088 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4d659-006d-4157-8eb0-28edcf8e88b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:48.876326 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4d659-006d-4157-8eb0-28edcf8e88b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:48.887024 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c4d659-006d-4157-8eb0-28edcf8e88b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:30:48.892580 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-b8c4d659-006d-4157-8eb0-28edcf8e88b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 07:30:48.892580 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:48.892580 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:48.892580 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:48.892580 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:48.892580 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:48.892580 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:48.892580 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:48.892580 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:48.892580 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:48.892580 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:48.892580 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:48.892580 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:30:48.892580 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:30:48.892580 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:30:48.892580 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:30:48.893487 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:30:48.893487 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:30:48.893487 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:30:48.893487 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:30:48.893487 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:48.893487 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:48.893487 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:48.893487 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:48.893487 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:48.893487 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:48.893487 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:48.893487 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:48.893487 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:48.893487 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:48.893487 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:48.893487 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:48.894490 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:48.894490 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:48.894490 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:48.894490 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:48.894490 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:30:48.894490 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:30:48.894490 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:30:48.894490 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:30:48.894490 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:30:48.894490 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:30:48.894490 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 07:30:48.894490 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:30:48.894490 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 255/506] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 26 07:30:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:48.899222 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4d659-006d-4157-8eb0-28edcf8e88b3 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:48.953462 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9677d-21f6-40d8-820e-cde8d471e0c4 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:48.994316 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3762d9-605c-44b0-be02-7a7effb12f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:48.994933 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3762d9-605c-44b0-be02-7a7effb12f43 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:48.995245 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3762d9-605c-44b0-be02-7a7effb12f43 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:48.995517 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3762d9-605c-44b0-be02-7a7effb12f43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:49.023425 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4d659-006d-4157-8eb0-28edcf8e88b3 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:49.028730 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:49.072194 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80cd5cb-7a91-46d9-8987-fab99c989a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:49.072853 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cd5cb-7a91-46d9-8987-fab99c989a56 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:49.073099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cd5cb-7a91-46d9-8987-fab99c989a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:49.073673 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cd5cb-7a91-46d9-8987-fab99c989a56 None admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:49.074115 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80cd5cb-7a91-46d9-8987-fab99c989a56 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:49.074419 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80cd5cb-7a91-46d9-8987-fab99c989a56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:49.075898 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80cd5cb-7a91-46d9-8987-fab99c989a56 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:49.083233 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3762d9-605c-44b0-be02-7a7effb12f43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:49.084742 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3762d9-605c-44b0-be02-7a7effb12f43 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:49.095079 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 256/507] 10.222.0.42 () {56 vars in 1137 bytes} [Fri Aug 26 07:30:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:49.095913 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80cd5cb-7a91-46d9-8987-fab99c989a56 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:49.106514 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:49.193506 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 252/508] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:30:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 07:30:49.194374 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3762d9-605c-44b0-be02-7a7effb12f43 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:49.215041 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80cd5cb-7a91-46d9-8987-fab99c989a56 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:49.254270 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f17f39-3335-4232-add3-3522a40e5363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:49.254921 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f17f39-3335-4232-add3-3522a40e5363 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:49.255232 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f17f39-3335-4232-add3-3522a40e5363 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:49.255507 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f17f39-3335-4232-add3-3522a40e5363 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:49.259030 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:49.267683 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f17f39-3335-4232-add3-3522a40e5363 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:49.269185 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f17f39-3335-4232-add3-3522a40e5363 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:49.281964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-a9f17f39-3335-4232-add3-3522a40e5363 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 07:30:49.281964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:49.281964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:49.281964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:49.281964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:49.281964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:49.281964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:49.281964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:49.281964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:49.281964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:49.281964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:49.281964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:49.281964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 07:30:49.281964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 07:30:49.281964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 07:30:49.281964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 07:30:49.283106 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:49.283106 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:49.283106 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 07:30:49.283106 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:30:49.283106 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 07:30:49.283106 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:30:49.283106 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:49.283106 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:49.283106 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:49.283106 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:49.283106 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:49.283106 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:49.283106 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:49.283106 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:49.283106 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:49.283106 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:49.283106 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:49.283106 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:49.284258 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:49.284258 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:49.284258 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 07:30:49.284258 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 07:30:49.284258 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 07:30:49.284258 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 07:30:49.284258 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 07:30:49.284258 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 07:30:49.284258 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 07:30:49.284258 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:30:49.284258 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 257/509] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:30:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:49.284258 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f17f39-3335-4232-add3-3522a40e5363 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:49.311478 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3762d9-605c-44b0-be02-7a7effb12f43 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:49.360607 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:49.365452 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f22f5-3d07-4361-85d4-f515b7a5b4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:49.366576 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f22f5-3d07-4361-85d4-f515b7a5b4cb None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:49.366913 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f22f5-3d07-4361-85d4-f515b7a5b4cb None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:49.367414 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f22f5-3d07-4361-85d4-f515b7a5b4cb None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:49.368250 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f22f5-3d07-4361-85d4-f515b7a5b4cb None admin] RBAC: Adding query filter params (name=service) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:49.368750 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f22f5-3d07-4361-85d4-f515b7a5b4cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:49.371848 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f22f5-3d07-4361-85d4-f515b7a5b4cb None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:49.382547 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 253/510] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 26 07:30:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:49.386589 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f22f5-3d07-4361-85d4-f515b7a5b4cb None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:49.419444 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f17f39-3335-4232-add3-3522a40e5363 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:49.465193 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f7292-12a5-41c1-ac93-7cba789a7b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:49.465843 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f7292-12a5-41c1-ac93-7cba789a7b30 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:49.466120 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f7292-12a5-41c1-ac93-7cba789a7b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:49.466391 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f7292-12a5-41c1-ac93-7cba789a7b30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:49.480821 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f7292-12a5-41c1-ac93-7cba789a7b30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:49.482305 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f7292-12a5-41c1-ac93-7cba789a7b30 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:49.497832 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-d61f7292-12a5-41c1-ac93-7cba789a7b30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:30:49.497832 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:49.497832 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:49.497832 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:49.497832 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:49.497832 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:49.497832 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:49.497832 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:49.497832 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:49.497832 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:49.497832 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:49.497832 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:49.497832 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:30:49.497832 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:30:49.497832 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:30:49.497832 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:30:49.499139 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:49.499139 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:49.499139 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:49.499139 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:49.499139 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:49.499139 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:49.499139 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:49.499139 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:49.499139 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:49.499139 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:49.499139 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:49.499139 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:49.499139 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:49.499139 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:49.499139 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:49.499139 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:49.499139 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:30:49.500273 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:30:49.500273 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:30:49.500273 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:30:49.500273 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 258/511] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:30:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:49.501773 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f7292-12a5-41c1-ac93-7cba789a7b30 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:49.542061 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f22f5-3d07-4361-85d4-f515b7a5b4cb None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:49.577364 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:49.596170 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595bc5a-f973-4601-b956-fa6acdfdb1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:49.596927 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595bc5a-f973-4601-b956-fa6acdfdb1c8 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:49.597364 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595bc5a-f973-4601-b956-fa6acdfdb1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:49.597791 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595bc5a-f973-4601-b956-fa6acdfdb1c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:49.637443 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f7292-12a5-41c1-ac93-7cba789a7b30 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:49.669659 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:49.691569 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9595bc5a-f973-4601-b956-fa6acdfdb1c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:49.693390 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9595bc5a-f973-4601-b956-fa6acdfdb1c8 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:49.697114 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bbdda5-d09c-44ba-9455-36c3372801a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:49.697769 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bbdda5-d09c-44ba-9455-36c3372801a1 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:49.698054 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bbdda5-d09c-44ba-9455-36c3372801a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:49.698317 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bbdda5-d09c-44ba-9455-36c3372801a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:49.712145 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bbdda5-d09c-44ba-9455-36c3372801a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:49.713905 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bbdda5-d09c-44ba-9455-36c3372801a1 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:49.730765 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-50bbdda5-d09c-44ba-9455-36c3372801a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:30:49.730765 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:49.730765 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:49.730765 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:49.730765 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:49.730765 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:49.730765 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:49.730765 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:49.730765 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:49.730765 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:49.730765 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:49.730765 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:49.730765 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:30:49.730765 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:30:49.730765 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:30:49.730765 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:30:49.731752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:49.731752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:49.731752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:49.731752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:49.731752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:49.731752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:49.731752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:49.731752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:49.731752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:49.731752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:49.731752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:49.731752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:49.731752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:49.731752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:49.731752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:49.731752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:49.731752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:30:49.732583 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:30:49.732583 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:30:49.732583 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:30:49.732583 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 259/512] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:30:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:49.733226 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bbdda5-d09c-44ba-9455-36c3372801a1 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:49.829914 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 254/513] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:30:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 07:30:49.830941 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595bc5a-f973-4601-b956-fa6acdfdb1c8 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:49.855624 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bbdda5-d09c-44ba-9455-36c3372801a1 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:49.856552 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:49.893564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41f89c-544f-4eb9-ab74-648ba51b44fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:49.894193 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41f89c-544f-4eb9-ab74-648ba51b44fb None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:49.894475 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41f89c-544f-4eb9-ab74-648ba51b44fb None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:49.894753 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41f89c-544f-4eb9-ab74-648ba51b44fb None admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:49.895929 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d41f89c-544f-4eb9-ab74-648ba51b44fb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:49.896244 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d41f89c-544f-4eb9-ab74-648ba51b44fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:49.897693 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d41f89c-544f-4eb9-ab74-648ba51b44fb None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:49.917415 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 260/514] 10.222.0.42 () {56 vars in 1137 bytes} [Fri Aug 26 07:30:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:49.918268 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41f89c-544f-4eb9-ab74-648ba51b44fb None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:49.949522 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595bc5a-f973-4601-b956-fa6acdfdb1c8 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:49.953025 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:49.990734 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d9b330-5709-4ce8-a98f-037ad069d838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:49.991411 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9b330-5709-4ce8-a98f-037ad069d838 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:49.991699 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9b330-5709-4ce8-a98f-037ad069d838 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:49.991968 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9b330-5709-4ce8-a98f-037ad069d838 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:50.004281 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d9b330-5709-4ce8-a98f-037ad069d838 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:50.005768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d9b330-5709-4ce8-a98f-037ad069d838 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:50.022340 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-a2d9b330-5709-4ce8-a98f-037ad069d838 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:30:50.022340 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:50.022340 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:50.022340 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:50.022340 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:50.022340 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:50.022340 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:50.022340 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:50.022340 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:50.022340 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:50.022340 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:50.022340 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:50.022340 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:30:50.022340 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:30:50.022340 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:30:50.022340 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:30:50.023470 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:50.023470 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:50.023470 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:50.023470 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:50.023470 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:50.023470 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:50.023470 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:50.023470 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:50.023470 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:50.023470 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:50.023470 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:50.023470 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:50.023470 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:50.023470 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:50.023470 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:50.023470 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:50.023470 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:30:50.024355 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:30:50.024355 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:30:50.024355 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:30:50.024355 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 255/515] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:30:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:50.024355 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d9b330-5709-4ce8-a98f-037ad069d838 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:50.053061 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41f89c-544f-4eb9-ab74-648ba51b44fb None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:50.103252 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e03ac-98fc-4e17-873f-9471bcf47b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:50.103876 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e03ac-98fc-4e17-873f-9471bcf47b95 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:50.104218 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e03ac-98fc-4e17-873f-9471bcf47b95 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:50.104559 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e03ac-98fc-4e17-873f-9471bcf47b95 None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:50.105272 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e03ac-98fc-4e17-873f-9471bcf47b95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:50.105635 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e03ac-98fc-4e17-873f-9471bcf47b95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:50.107268 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e03ac-98fc-4e17-873f-9471bcf47b95 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:50.119446 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 261/516] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:30:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:50.124996 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e03ac-98fc-4e17-873f-9471bcf47b95 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:50.136095 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:50.176899 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d9b330-5709-4ce8-a98f-037ad069d838 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:50.221685 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be22a5-8ed4-4aa3-85aa-94278c1115dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:50.222314 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be22a5-8ed4-4aa3-85aa-94278c1115dc None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:50.222600 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be22a5-8ed4-4aa3-85aa-94278c1115dc None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:50.222909 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be22a5-8ed4-4aa3-85aa-94278c1115dc None admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:50.223592 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7be22a5-8ed4-4aa3-85aa-94278c1115dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:50.223889 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7be22a5-8ed4-4aa3-85aa-94278c1115dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:50.225311 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7be22a5-8ed4-4aa3-85aa-94278c1115dc None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:50.233429 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:50.244321 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 256/517] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:30:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:50.244321 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be22a5-8ed4-4aa3-85aa-94278c1115dc None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:50.244604 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e03ac-98fc-4e17-873f-9471bcf47b95 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:50.288296 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47af8f-5a79-40bf-953c-4ecda33d24c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:50.289160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47af8f-5a79-40bf-953c-4ecda33d24c0 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:50.289448 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47af8f-5a79-40bf-953c-4ecda33d24c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:50.289785 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47af8f-5a79-40bf-953c-4ecda33d24c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:50.304054 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb47af8f-5a79-40bf-953c-4ecda33d24c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:50.305546 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb47af8f-5a79-40bf-953c-4ecda33d24c0 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:50.326638 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-bb47af8f-5a79-40bf-953c-4ecda33d24c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:30:50.326638 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:50.326638 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:50.326638 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:50.326638 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:50.326638 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:50.326638 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:50.326638 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:50.326638 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:50.326638 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:50.326638 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:50.326638 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:50.326638 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:30:50.326638 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:30:50.326638 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:30:50.326638 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:30:50.327632 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:50.327632 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:50.327632 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:50.327632 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:50.327632 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:50.327632 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:50.327632 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:50.327632 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:50.327632 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:50.327632 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:50.327632 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:50.327632 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:50.327632 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:50.327632 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:50.327632 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:50.327632 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:50.327632 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:30:50.329156 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:30:50.329156 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:30:50.329156 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:30:50.329156 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 262/518] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:30:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:50.332324 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47af8f-5a79-40bf-953c-4ecda33d24c0 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:50.386923 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be22a5-8ed4-4aa3-85aa-94278c1115dc None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:50.422134 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:50.430182 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7161be-b344-41e4-b389-7f46cfb43b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:50.430182 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7161be-b344-41e4-b389-7f46cfb43b70 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:50.430182 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7161be-b344-41e4-b389-7f46cfb43b70 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:50.430182 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7161be-b344-41e4-b389-7f46cfb43b70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:50.463806 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47af8f-5a79-40bf-953c-4ecda33d24c0 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:50.502499 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf93f0-5342-4994-a920-e8513c4133be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:50.503445 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf93f0-5342-4994-a920-e8513c4133be None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:50.504055 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf93f0-5342-4994-a920-e8513c4133be None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:50.504330 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf93f0-5342-4994-a920-e8513c4133be None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:50.504995 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf93f0-5342-4994-a920-e8513c4133be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:50.505299 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf93f0-5342-4994-a920-e8513c4133be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:50.506692 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf93f0-5342-4994-a920-e8513c4133be None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:50.511721 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7161be-b344-41e4-b389-7f46cfb43b70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:50.513260 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7161be-b344-41e4-b389-7f46cfb43b70 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:50.524072 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 263/519] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:30:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:50.524945 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf93f0-5342-4994-a920-e8513c4133be None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:50.530061 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:50.632772 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 257/520] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:30:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 07:30:50.633645 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7161be-b344-41e4-b389-7f46cfb43b70 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:50.648845 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf93f0-5342-4994-a920-e8513c4133be None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:50.667733 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:50.685194 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605c0e3-74c8-4a23-81b5-6e37e7c52504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:50.685886 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605c0e3-74c8-4a23-81b5-6e37e7c52504 None admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:50.686228 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605c0e3-74c8-4a23-81b5-6e37e7c52504 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:50.686417 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605c0e3-74c8-4a23-81b5-6e37e7c52504 None admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:50.687164 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605c0e3-74c8-4a23-81b5-6e37e7c52504 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:50.689149 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605c0e3-74c8-4a23-81b5-6e37e7c52504 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:50.749498 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7161be-b344-41e4-b389-7f46cfb43b70 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:50.787806 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e9b03-c54c-4a8b-97cf-a557bfd8d98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:50.788453 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e9b03-c54c-4a8b-97cf-a557bfd8d98b None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:50.788736 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e9b03-c54c-4a8b-97cf-a557bfd8d98b None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:50.789017 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e9b03-c54c-4a8b-97cf-a557bfd8d98b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:50.796246 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e9b03-c54c-4a8b-97cf-a557bfd8d98b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:50.798275 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e9b03-c54c-4a8b-97cf-a557bfd8d98b None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:50.815361 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 264/521] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 26 07:30:50 2022] POST /identity/v3/users => generated 247 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:30:50.815719 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-9d0e9b03-c54c-4a8b-97cf-a557bfd8d98b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:30:50.815719 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:50.815719 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:50.815719 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:50.815719 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:50.815719 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:50.815719 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:50.815719 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:50.815719 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:50.815719 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:50.815719 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:50.815719 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:50.815719 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 07:30:50.815719 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 07:30:50.815719 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 07:30:50.816696 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 07:30:50.816696 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:50.816696 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:50.816696 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:50.816696 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:50.816696 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:50.816696 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:50.816696 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:50.816696 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:50.816696 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:50.816696 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:50.816696 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:50.816696 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:50.816696 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:50.816696 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:50.816696 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:50.816696 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:50.817755 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 07:30:50.817755 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 07:30:50.817755 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 07:30:50.817755 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 07:30:50.817755 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 07:30:50.817755 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 07:30:50.817755 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:30:50.817755 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:30:50.818564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605c0e3-74c8-4a23-81b5-6e37e7c52504 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:50.818649 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 258/522] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:30:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:50.818649 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e9b03-c54c-4a8b-97cf-a557bfd8d98b None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:50.902592 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:50.945322 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:50.957331 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e9b03-c54c-4a8b-97cf-a557bfd8d98b None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:50.965545 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605c0e3-74c8-4a23-81b5-6e37e7c52504 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:51.013133 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c783fd-7b20-48e5-8d28-e82b296691e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:51.013448 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c783fd-7b20-48e5-8d28-e82b296691e5 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:51.013731 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c783fd-7b20-48e5-8d28-e82b296691e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:51.014001 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c783fd-7b20-48e5-8d28-e82b296691e5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:51.027874 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c783fd-7b20-48e5-8d28-e82b296691e5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:51.029359 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c783fd-7b20-48e5-8d28-e82b296691e5 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:51.029911 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb4d6a-4a27-41eb-ba04-e0bc2a324408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:51.031258 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb4d6a-4a27-41eb-ba04-e0bc2a324408 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:51.032850 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb4d6a-4a27-41eb-ba04-e0bc2a324408 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:51.033279 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb4d6a-4a27-41eb-ba04-e0bc2a324408 None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:51.033970 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acb4d6a-4a27-41eb-ba04-e0bc2a324408 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:51.035868 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acb4d6a-4a27-41eb-ba04-e0bc2a324408 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:51.035868 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acb4d6a-4a27-41eb-ba04-e0bc2a324408 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:51.046354 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-93c783fd-7b20-48e5-8d28-e82b296691e5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 07:30:51.046354 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:51.046354 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:51.046354 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:51.046354 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:51.046354 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:51.046354 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:51.046354 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:51.046354 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:51.046354 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:51.046354 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:51.046354 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:51.046354 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 07:30:51.046354 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 07:30:51.046354 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 07:30:51.046354 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 07:30:51.047614 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:51.047614 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:51.047614 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 07:30:51.047614 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:30:51.047614 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 07:30:51.047614 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:30:51.047614 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:51.047614 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:51.047614 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:51.047614 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:51.047614 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:51.047614 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:51.047614 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:51.047614 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:51.047614 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:51.047614 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:51.047614 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:51.047614 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:51.048500 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:51.048500 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:51.048500 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 07:30:51.048500 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 07:30:51.048500 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 07:30:51.048500 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 07:30:51.048500 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 07:30:51.048500 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 07:30:51.048500 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 07:30:51.048500 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:30:51.048500 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 259/523] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 26 07:30:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:51.048500 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c783fd-7b20-48e5-8d28-e82b296691e5 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:51.063028 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 265/524] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:30:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:51.067018 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb4d6a-4a27-41eb-ba04-e0bc2a324408 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:51.193620 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c783fd-7b20-48e5-8d28-e82b296691e5 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:51.193796 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb4d6a-4a27-41eb-ba04-e0bc2a324408 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:51.222214 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:51.241223 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c11816-879b-432e-98db-dbca034f030c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:51.242530 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c11816-879b-432e-98db-dbca034f030c None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:51.243017 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c11816-879b-432e-98db-dbca034f030c None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:51.243849 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c11816-879b-432e-98db-dbca034f030c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:51.251981 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0df16-9a83-4dab-b9d7-7ab2f83ecd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:51.254099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0df16-9a83-4dab-b9d7-7ab2f83ecd76 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:51.254740 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0df16-9a83-4dab-b9d7-7ab2f83ecd76 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:51.255372 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0df16-9a83-4dab-b9d7-7ab2f83ecd76 None admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:51.257770 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db0df16-9a83-4dab-b9d7-7ab2f83ecd76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:51.259357 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db0df16-9a83-4dab-b9d7-7ab2f83ecd76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:51.261283 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c11816-879b-432e-98db-dbca034f030c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:51.262775 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db0df16-9a83-4dab-b9d7-7ab2f83ecd76 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:51.263259 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c11816-879b-432e-98db-dbca034f030c None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:51.281841 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-13c11816-879b-432e-98db-dbca034f030c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:30:51.281841 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:51.281841 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:51.281841 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:51.281841 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:51.281841 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:51.281841 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:51.281841 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:51.281841 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:51.281841 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:51.281841 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:51.281841 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:51.281841 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:30:51.281841 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:30:51.281841 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:30:51.281841 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:30:51.283084 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:51.283084 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:51.283084 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:51.283084 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:51.283084 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:51.283084 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:51.283084 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:51.283084 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:51.283084 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:51.283084 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:51.283084 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:51.283084 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:51.283084 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:51.283084 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:51.283084 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:51.283084 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:51.283084 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:30:51.283957 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:30:51.283957 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:30:51.283957 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:30:51.283957 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 260/525] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:30:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:51.285080 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c11816-879b-432e-98db-dbca034f030c None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:51.291943 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:51.306021 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 266/526] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 26 07:30:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:51.306021 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0df16-9a83-4dab-b9d7-7ab2f83ecd76 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:51.465042 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c11816-879b-432e-98db-dbca034f030c None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:51.469827 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0df16-9a83-4dab-b9d7-7ab2f83ecd76 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:51.509307 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d872dc-5551-4c4e-af28-cd5dfb0a5c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:51.509923 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d872dc-5551-4c4e-af28-cd5dfb0a5c4c None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:51.510263 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d872dc-5551-4c4e-af28-cd5dfb0a5c4c None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:51.510654 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d872dc-5551-4c4e-af28-cd5dfb0a5c4c None admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:51.511680 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d872dc-5551-4c4e-af28-cd5dfb0a5c4c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:51.511995 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d872dc-5551-4c4e-af28-cd5dfb0a5c4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:51.513420 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d872dc-5551-4c4e-af28-cd5dfb0a5c4c None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:51.518876 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46251617-36c4-48b1-b0be-a5dfc4e700d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:51.520569 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46251617-36c4-48b1-b0be-a5dfc4e700d1 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:51.520856 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46251617-36c4-48b1-b0be-a5dfc4e700d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:51.521135 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46251617-36c4-48b1-b0be-a5dfc4e700d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:51.529176 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46251617-36c4-48b1-b0be-a5dfc4e700d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:51.530664 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46251617-36c4-48b1-b0be-a5dfc4e700d1 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:51.548639 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-46251617-36c4-48b1-b0be-a5dfc4e700d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:30:51.548639 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:51.548639 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:51.548639 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:51.548639 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:51.548639 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:51.548639 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:51.548639 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:51.548639 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:51.548639 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:51.548639 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:51.548639 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:51.548639 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 07:30:51.548639 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 07:30:51.548639 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 07:30:51.549541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 07:30:51.549541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:51.549541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:51.549541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:51.549541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:51.549541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:51.549541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:51.549541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:51.549541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:51.549541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:51.549541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:51.549541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:51.549541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:51.549541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:51.549541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:51.549541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:51.549541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:51.550385 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 07:30:51.550385 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 07:30:51.550385 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 07:30:51.550385 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 07:30:51.550385 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 07:30:51.550385 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 07:30:51.550385 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:30:51.550385 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:30:51.550385 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 267/527] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:30:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:51.550843 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46251617-36c4-48b1-b0be-a5dfc4e700d1 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:51.567659 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 261/528] 10.222.0.42 () {56 vars in 1139 bytes} [Fri Aug 26 07:30:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:51.569267 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d872dc-5551-4c4e-af28-cd5dfb0a5c4c None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:51.611899 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:51.658000 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:51.687123 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46251617-36c4-48b1-b0be-a5dfc4e700d1 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:51.711395 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d872dc-5551-4c4e-af28-cd5dfb0a5c4c None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:51.739271 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805feca-83ab-4ee5-8c7f-76180e2f1eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:51.739829 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805feca-83ab-4ee5-8c7f-76180e2f1eaa None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:51.740409 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805feca-83ab-4ee5-8c7f-76180e2f1eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:51.740691 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805feca-83ab-4ee5-8c7f-76180e2f1eaa None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:51.741382 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b805feca-83ab-4ee5-8c7f-76180e2f1eaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:51.741909 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b805feca-83ab-4ee5-8c7f-76180e2f1eaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:51.743211 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b805feca-83ab-4ee5-8c7f-76180e2f1eaa None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:51.757051 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad983a26-6586-4f7c-95a0-d77f7e58d8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:51.757891 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad983a26-6586-4f7c-95a0-d77f7e58d8d6 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:51.758175 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad983a26-6586-4f7c-95a0-d77f7e58d8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:51.758450 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad983a26-6586-4f7c-95a0-d77f7e58d8d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:51.759895 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 268/529] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:30:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:51.761012 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805feca-83ab-4ee5-8c7f-76180e2f1eaa None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:51.767513 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad983a26-6586-4f7c-95a0-d77f7e58d8d6 None admin] RBAC: Adding query filter params (role.id=aad163eaa5c8447ca5d5a7d5d861395a, scope.project.id=becbf57e91454d499dec313ff9eadfae, user.id=bc92c0a0a2cc4722868e6877bac93ada) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:51.767908 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad983a26-6586-4f7c-95a0-d77f7e58d8d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:51.769957 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad983a26-6586-4f7c-95a0-d77f7e58d8d6 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:51.776113 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 262/530] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:30:51 2022] GET /identity/v3/role_assignments?user.id=bc92c0a0a2cc4722868e6877bac93ada&scope.project.id=becbf57e91454d499dec313ff9eadfae&role.id=aad163eaa5c8447ca5d5a7d5d861395a => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:51.776969 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad983a26-6586-4f7c-95a0-d77f7e58d8d6 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:51.934144 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:51.940706 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805feca-83ab-4ee5-8c7f-76180e2f1eaa None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:51.991915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad983a26-6586-4f7c-95a0-d77f7e58d8d6 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:52.006609 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a938fc-1670-4f9c-87cf-aae44aa40da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:52.006609 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a938fc-1670-4f9c-87cf-aae44aa40da8 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:52.006907 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a938fc-1670-4f9c-87cf-aae44aa40da8 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:52.007160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a938fc-1670-4f9c-87cf-aae44aa40da8 None admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:52.007800 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a938fc-1670-4f9c-87cf-aae44aa40da8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:52.009482 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a938fc-1670-4f9c-87cf-aae44aa40da8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:52.009642 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a938fc-1670-4f9c-87cf-aae44aa40da8 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:52.030772 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 269/531] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 26 07:30:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:52.032742 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a938fc-1670-4f9c-87cf-aae44aa40da8 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:52.053428 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:52.068913 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d76342-151d-452e-9035-d42cba3c5a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:52.069533 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d76342-151d-452e-9035-d42cba3c5a8b None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:52.069994 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d76342-151d-452e-9035-d42cba3c5a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:52.070087 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d76342-151d-452e-9035-d42cba3c5a8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:52.176643 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d76342-151d-452e-9035-d42cba3c5a8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:52.179186 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d76342-151d-452e-9035-d42cba3c5a8b None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:52.210541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a938fc-1670-4f9c-87cf-aae44aa40da8 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:52.272622 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc531cb-829f-4839-bdbc-6c3e8044513c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:52.274263 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc531cb-829f-4839-bdbc-6c3e8044513c None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:52.274745 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc531cb-829f-4839-bdbc-6c3e8044513c None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:52.275301 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc531cb-829f-4839-bdbc-6c3e8044513c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:52.285441 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc531cb-829f-4839-bdbc-6c3e8044513c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:52.290556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc531cb-829f-4839-bdbc-6c3e8044513c None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:52.307964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-edc531cb-829f-4839-bdbc-6c3e8044513c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:30:52.307964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:52.307964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:52.307964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:52.307964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:52.307964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:52.307964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:52.307964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:52.307964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:52.307964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:52.307964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:52.307964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:52.307964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 07:30:52.307964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 07:30:52.307964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 07:30:52.308889 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 07:30:52.308889 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:52.308889 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:52.308889 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:52.308889 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:52.308889 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:52.308889 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:52.308889 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:52.308889 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:52.308889 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:52.308889 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:52.308889 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:52.308889 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:52.308889 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:52.308889 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:52.308889 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:52.308889 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:52.309742 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 07:30:52.309742 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 07:30:52.309742 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 07:30:52.309742 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 07:30:52.309742 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 07:30:52.309742 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 07:30:52.309742 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:30:52.309742 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:30:52.312897 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 270/532] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:30:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:52.313927 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc531cb-829f-4839-bdbc-6c3e8044513c None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:52.338423 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:52.398238 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 263/533] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:30:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 07:30:52.398238 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d76342-151d-452e-9035-d42cba3c5a8b None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:52.435798 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:52.458641 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc531cb-829f-4839-bdbc-6c3e8044513c None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:52.503546 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b996ab-94d3-4338-94b9-e322329efed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:52.504532 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b996ab-94d3-4338-94b9-e322329efed9 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:52.505062 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b996ab-94d3-4338-94b9-e322329efed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:52.505554 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b996ab-94d3-4338-94b9-e322329efed9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:52.506610 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b996ab-94d3-4338-94b9-e322329efed9 None admin] RBAC: Adding query filter params (role.id=aad163eaa5c8447ca5d5a7d5d861395a, scope.project.id=becbf57e91454d499dec313ff9eadfae, user.id=2df7725203304d8fbe3a768656cabf23) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:52.507217 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b996ab-94d3-4338-94b9-e322329efed9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:52.508986 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b996ab-94d3-4338-94b9-e322329efed9 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:52.519371 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 271/534] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:30:52 2022] GET /identity/v3/role_assignments?user.id=2df7725203304d8fbe3a768656cabf23&scope.project.id=becbf57e91454d499dec313ff9eadfae&role.id=aad163eaa5c8447ca5d5a7d5d861395a => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:52.520669 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b996ab-94d3-4338-94b9-e322329efed9 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:52.558747 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d76342-151d-452e-9035-d42cba3c5a8b None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:52.627782 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7849b73-f8dd-4b30-bdd8-a9dadf58613e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:52.628604 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7849b73-f8dd-4b30-bdd8-a9dadf58613e None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:52.628983 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7849b73-f8dd-4b30-bdd8-a9dadf58613e None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:52.629355 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7849b73-f8dd-4b30-bdd8-a9dadf58613e None admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:52.630168 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7849b73-f8dd-4b30-bdd8-a9dadf58613e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:52.630600 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7849b73-f8dd-4b30-bdd8-a9dadf58613e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:52.632288 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7849b73-f8dd-4b30-bdd8-a9dadf58613e None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:52.656258 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 264/535] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 26 07:30:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:52.668515 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7849b73-f8dd-4b30-bdd8-a9dadf58613e None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:52.693724 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:52.739218 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b996ab-94d3-4338-94b9-e322329efed9 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:52.812496 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29cb4d-e12e-43ce-9c74-89da01def58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:52.813129 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29cb4d-e12e-43ce-9c74-89da01def58a None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:52.813409 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29cb4d-e12e-43ce-9c74-89da01def58a None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:52.813681 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29cb4d-e12e-43ce-9c74-89da01def58a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:52.833691 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:52.837692 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c29cb4d-e12e-43ce-9c74-89da01def58a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:52.851379 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c29cb4d-e12e-43ce-9c74-89da01def58a None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:52.856911 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7849b73-f8dd-4b30-bdd8-a9dadf58613e None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:52.883490 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-7c29cb4d-e12e-43ce-9c74-89da01def58a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:30:52.883490 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:52.883490 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:52.883490 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:52.883490 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:52.883490 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:52.883490 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:52.883490 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:52.883490 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:52.883490 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:52.883490 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:52.883490 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:52.883490 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:30:52.883490 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:30:52.883490 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:30:52.883490 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:30:52.885159 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:52.885159 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:52.885159 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:52.885159 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:52.885159 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:52.885159 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:52.885159 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:52.885159 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:52.885159 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:52.885159 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:52.885159 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:52.885159 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:52.885159 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:52.885159 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:52.885159 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:52.885159 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:52.885159 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:30:52.885997 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:30:52.885997 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:30:52.885997 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:30:52.885997 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 272/536] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:30:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:52.896073 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29cb4d-e12e-43ce-9c74-89da01def58a None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:52.927039 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa5561-738a-4f79-bd4c-dc9870ff1dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:52.927039 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa5561-738a-4f79-bd4c-dc9870ff1dec None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:52.927039 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa5561-738a-4f79-bd4c-dc9870ff1dec None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:52.927039 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa5561-738a-4f79-bd4c-dc9870ff1dec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:52.927465 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aa5561-738a-4f79-bd4c-dc9870ff1dec None admin] RBAC: Adding query filter params (role.id=aad163eaa5c8447ca5d5a7d5d861395a, scope.project.id=becbf57e91454d499dec313ff9eadfae, user.id=f23fe4069f39499c9ed8e27566eddc77) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:52.927465 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aa5561-738a-4f79-bd4c-dc9870ff1dec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:52.932430 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aa5561-738a-4f79-bd4c-dc9870ff1dec None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:52.955022 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 265/537] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:30:52 2022] GET /identity/v3/role_assignments?user.id=f23fe4069f39499c9ed8e27566eddc77&scope.project.id=becbf57e91454d499dec313ff9eadfae&role.id=aad163eaa5c8447ca5d5a7d5d861395a => generated 259 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:30:53.026871 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa308800-032f-4733-b12b-475abae5a505 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:53.027630 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa308800-032f-4733-b12b-475abae5a505 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:53.027630 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa308800-032f-4733-b12b-475abae5a505 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:53.031045 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 266/538] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 07:30:53.037924 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74930abf-e38d-4925-ab54-d8bd142b49d2 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:53.038247 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74930abf-e38d-4925-ab54-d8bd142b49d2 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:53.039438 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74930abf-e38d-4925-ab54-d8bd142b49d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:53.098036 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-74930abf-e38d-4925-ab54-d8bd142b49d2 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:53.107631 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-74930abf-e38d-4925-ab54-d8bd142b49d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:53.113703 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29cb4d-e12e-43ce-9c74-89da01def58a None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:53.157427 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e076111-b378-40ef-a72b-2ca71fb91331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:53.158465 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e076111-b378-40ef-a72b-2ca71fb91331 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:53.158941 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e076111-b378-40ef-a72b-2ca71fb91331 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:53.159445 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e076111-b378-40ef-a72b-2ca71fb91331 None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:53.160444 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e076111-b378-40ef-a72b-2ca71fb91331 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:53.160940 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e076111-b378-40ef-a72b-2ca71fb91331 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:53.162521 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e076111-b378-40ef-a72b-2ca71fb91331 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:53.171732 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:53.181520 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 273/539] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:53.200103 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e076111-b378-40ef-a72b-2ca71fb91331 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:53.268751 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 267/540] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 07:30:53.488234 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e076111-b378-40ef-a72b-2ca71fb91331 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:53.554800 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ede51-5d9d-4f8c-b25f-e1a1c2930066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:53.555477 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ede51-5d9d-4f8c-b25f-e1a1c2930066 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:53.555754 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ede51-5d9d-4f8c-b25f-e1a1c2930066 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:53.556019 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ede51-5d9d-4f8c-b25f-e1a1c2930066 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:53.572184 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ede51-5d9d-4f8c-b25f-e1a1c2930066 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:53.573643 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ede51-5d9d-4f8c-b25f-e1a1c2930066 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:53.595145 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-cf2ede51-5d9d-4f8c-b25f-e1a1c2930066 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:30:53.595145 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:53.595145 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:53.595145 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:53.595145 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:53.595145 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:53.595145 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:53.595145 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:53.595145 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:53.595145 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:53.595145 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:53.595145 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:53.595145 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 07:30:53.595145 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 07:30:53.595145 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 07:30:53.596048 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 07:30:53.596048 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:53.596048 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:53.596048 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:53.596048 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:53.596048 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:53.596048 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:53.596048 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:53.596048 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:53.596048 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:53.596048 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:53.596048 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:53.596048 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:53.596048 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:53.596048 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:53.596048 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:53.596048 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:53.596944 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 07:30:53.596944 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 07:30:53.596944 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 07:30:53.596944 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 07:30:53.596944 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 07:30:53.596944 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 07:30:53.596944 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:30:53.596944 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:30:53.599102 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 274/541] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:30:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:53.608127 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74930abf-e38d-4925-ab54-d8bd142b49d2 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:53.657657 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ede51-5d9d-4f8c-b25f-e1a1c2930066 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:53.772640 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:53.803569 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:53.851728 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74930abf-e38d-4925-ab54-d8bd142b49d2 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:53.900012 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ede51-5d9d-4f8c-b25f-e1a1c2930066 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:53.936762 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add567f-f21c-4512-8ac4-b1e4e34841c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:53.941045 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add567f-f21c-4512-8ac4-b1e4e34841c7 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:53.941045 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add567f-f21c-4512-8ac4-b1e4e34841c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:53.941045 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add567f-f21c-4512-8ac4-b1e4e34841c7 None admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:53.941045 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add567f-f21c-4512-8ac4-b1e4e34841c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:53.941045 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add567f-f21c-4512-8ac4-b1e4e34841c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:53.941655 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add567f-f21c-4512-8ac4-b1e4e34841c7 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:53.975577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 268/542] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 26 07:30:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:53.977712 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add567f-f21c-4512-8ac4-b1e4e34841c7 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:54.005763 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae57daa-38b8-4d2d-b23f-1f03e33e3994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:54.006414 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae57daa-38b8-4d2d-b23f-1f03e33e3994 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:54.006692 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae57daa-38b8-4d2d-b23f-1f03e33e3994 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:54.006965 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae57daa-38b8-4d2d-b23f-1f03e33e3994 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:54.029488 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae57daa-38b8-4d2d-b23f-1f03e33e3994 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:30:54.035519 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-5ae57daa-38b8-4d2d-b23f-1f03e33e3994 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 07:30:54.035519 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:54.035519 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:54.035519 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:54.035519 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:54.035519 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:54.035519 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:54.035519 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:54.035519 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:54.035519 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:54.035519 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:54.035519 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:54.035519 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:30:54.035519 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:30:54.035519 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:30:54.035519 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:30:54.036425 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:30:54.036425 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:30:54.036425 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:30:54.036425 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:30:54.036425 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:54.036425 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:54.036425 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:54.036425 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:54.036425 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:54.036425 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:54.036425 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:54.036425 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:54.036425 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:54.036425 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:54.036425 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:54.036425 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:54.037195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:54.037195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:54.037195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:54.037195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:54.037195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:30:54.037195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:30:54.037195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:30:54.037195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:30:54.037195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:30:54.037195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:30:54.037195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 07:30:54.037195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:30:54.046584 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 275/543] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 26 07:30:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:54.054438 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae57daa-38b8-4d2d-b23f-1f03e33e3994 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:54.229938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add567f-f21c-4512-8ac4-b1e4e34841c7 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:54.265162 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae57daa-38b8-4d2d-b23f-1f03e33e3994 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:54.280808 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:54.316287 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08689f2-357c-4dcc-835b-6c765a65e6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:54.317404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08689f2-357c-4dcc-835b-6c765a65e6de None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:54.318551 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08689f2-357c-4dcc-835b-6c765a65e6de None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:54.319897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08689f2-357c-4dcc-835b-6c765a65e6de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:54.320794 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08689f2-357c-4dcc-835b-6c765a65e6de None admin] RBAC: Adding query filter params (role.id=aad163eaa5c8447ca5d5a7d5d861395a, scope.project.id=becbf57e91454d499dec313ff9eadfae, user.id=a5ea9916c82647f3a645f1a4258f558b) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:54.321765 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08689f2-357c-4dcc-835b-6c765a65e6de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:54.322554 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a689f1-d392-465d-b56a-fe689f77271c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:54.324179 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a689f1-d392-465d-b56a-fe689f77271c None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:54.324628 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a689f1-d392-465d-b56a-fe689f77271c None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:54.325575 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08689f2-357c-4dcc-835b-6c765a65e6de None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:54.326030 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a689f1-d392-465d-b56a-fe689f77271c None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:54.330254 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a689f1-d392-465d-b56a-fe689f77271c None admin] RBAC: Adding query filter params (name=service) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:54.330793 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a689f1-d392-465d-b56a-fe689f77271c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:54.332496 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a689f1-d392-465d-b56a-fe689f77271c None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:54.341324 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 269/544] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:30:53 2022] GET /identity/v3/role_assignments?user.id=a5ea9916c82647f3a645f1a4258f558b&scope.project.id=becbf57e91454d499dec313ff9eadfae&role.id=aad163eaa5c8447ca5d5a7d5d861395a => generated 259 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:54.346529 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec48fa-6758-4dd2-b361-67982bd9b5c6 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:54.347507 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec48fa-6758-4dd2-b361-67982bd9b5c6 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:54.351325 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec48fa-6758-4dd2-b361-67982bd9b5c6 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:54.353300 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 276/545] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 26 07:30:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:30:54.353726 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 270/546] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:54 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:30:54.358608 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a689f1-d392-465d-b56a-fe689f77271c None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:54.361673 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c236af-6557-4903-9b5a-807a63fd4db0 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:54.362660 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c236af-6557-4903-9b5a-807a63fd4db0 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:54.367513 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c236af-6557-4903-9b5a-807a63fd4db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:54.396355 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:54.427372 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-57c236af-6557-4903-9b5a-807a63fd4db0 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:54.428673 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-57c236af-6557-4903-9b5a-807a63fd4db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:54.547369 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a689f1-d392-465d-b56a-fe689f77271c None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:54.610538 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 271/547] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:30:54.629583 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344540b0-050e-4fe1-89e4-44898730d834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:54.630608 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344540b0-050e-4fe1-89e4-44898730d834 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:54.631156 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344540b0-050e-4fe1-89e4-44898730d834 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:54.631667 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344540b0-050e-4fe1-89e4-44898730d834 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:54.648908 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344540b0-050e-4fe1-89e4-44898730d834 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:54.651186 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344540b0-050e-4fe1-89e4-44898730d834 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:54.668968 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-344540b0-050e-4fe1-89e4-44898730d834 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:30:54.668968 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:54.668968 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:54.668968 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:54.668968 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:54.668968 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:54.668968 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:54.668968 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:54.668968 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:54.668968 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:54.668968 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:54.668968 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:54.668968 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:30:54.668968 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:30:54.668968 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:30:54.668968 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:30:54.669921 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:54.669921 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:54.669921 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:54.669921 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:54.669921 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:54.669921 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:54.669921 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:54.669921 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:54.669921 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:54.669921 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:54.669921 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:54.669921 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:54.669921 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:54.669921 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:54.669921 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:54.669921 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:54.669921 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:30:54.672510 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:30:54.672510 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:30:54.672510 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:30:54.675851 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 277/548] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:30:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:54.684526 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c236af-6557-4903-9b5a-807a63fd4db0 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:54.958539 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344540b0-050e-4fe1-89e4-44898730d834 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:54.987016 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c236af-6557-4903-9b5a-807a63fd4db0 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:55.024786 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709cf8a-ec88-4bd9-af4c-f5edea34b740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:55.025425 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709cf8a-ec88-4bd9-af4c-f5edea34b740 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:55.025699 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709cf8a-ec88-4bd9-af4c-f5edea34b740 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:55.025971 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709cf8a-ec88-4bd9-af4c-f5edea34b740 None admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:55.026629 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5709cf8a-ec88-4bd9-af4c-f5edea34b740 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:55.026931 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5709cf8a-ec88-4bd9-af4c-f5edea34b740 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:55.039024 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5709cf8a-ec88-4bd9-af4c-f5edea34b740 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:55.039024 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:55.054338 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 272/549] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:30:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:55.060130 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709cf8a-ec88-4bd9-af4c-f5edea34b740 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:55.061715 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:55.189355 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709cf8a-ec88-4bd9-af4c-f5edea34b740 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:55.291180 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344540b0-050e-4fe1-89e4-44898730d834 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:55.304083 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421524c0-09f4-472e-be3c-d496a6179681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:55.304083 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421524c0-09f4-472e-be3c-d496a6179681 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:55.304083 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421524c0-09f4-472e-be3c-d496a6179681 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:55.304083 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421524c0-09f4-472e-be3c-d496a6179681 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:55.316673 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421524c0-09f4-472e-be3c-d496a6179681 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:55.320253 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421524c0-09f4-472e-be3c-d496a6179681 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:55.341852 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-421524c0-09f4-472e-be3c-d496a6179681 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 26 07:30:55.341852 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:55.341852 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:55.341852 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:55.341852 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:55.341852 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:55.341852 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:55.341852 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:55.341852 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:55.341852 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:55.341852 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:55.341852 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:55.341852 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 07:30:55.341852 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 07:30:55.341852 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 07:30:55.341852 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 07:30:55.342818 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:55.342818 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:55.342818 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 07:30:55.342818 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:30:55.342818 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 07:30:55.342818 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:30:55.342818 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:55.342818 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:55.342818 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:55.342818 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:55.342818 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:55.342818 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:55.342818 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:55.342818 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:55.342818 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:55.342818 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:55.342818 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:55.342818 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:55.344024 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:55.344024 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:55.344024 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 07:30:55.344024 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 07:30:55.344024 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 07:30:55.344024 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 07:30:55.344024 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 07:30:55.344024 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 07:30:55.344024 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 26 07:30:55.344024 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:30:55.352408 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 273/550] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 26 07:30:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 07:30:55.353987 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceee6f5-c600-440f-91b6-9935a5d116fd None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:55.354511 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceee6f5-c600-440f-91b6-9935a5d116fd None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:55.355015 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceee6f5-c600-440f-91b6-9935a5d116fd None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:55.357148 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 274/551] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:30:55.361991 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391877c-2c69-4bf2-9368-eaa82d66f128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:55.362941 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391877c-2c69-4bf2-9368-eaa82d66f128 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:55.363462 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391877c-2c69-4bf2-9368-eaa82d66f128 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:55.363929 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391877c-2c69-4bf2-9368-eaa82d66f128 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:55.365566 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceee6f5-c600-440f-91b6-9935a5d116fd None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:55.389132 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f391877c-2c69-4bf2-9368-eaa82d66f128 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:30:55.397861 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-f391877c-2c69-4bf2-9368-eaa82d66f128 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 07:30:55.397861 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:55.397861 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:55.397861 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:55.397861 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:55.397861 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:55.397861 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:55.397861 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:55.397861 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:55.397861 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:55.397861 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:55.397861 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:55.397861 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:30:55.397861 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:30:55.397861 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:30:55.397861 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:30:55.398836 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:30:55.398836 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:30:55.398836 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:30:55.398836 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:30:55.398836 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:55.398836 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:55.398836 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:55.398836 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:55.398836 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:55.398836 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:55.398836 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:55.398836 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:55.398836 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:55.398836 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:55.398836 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:55.398836 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:55.399702 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:55.399702 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:55.399702 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:55.399702 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:55.399702 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:30:55.399702 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:30:55.399702 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:30:55.399702 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:30:55.399702 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:30:55.399702 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:30:55.399702 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 07:30:55.399702 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:30:55.410657 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 278/552] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 26 07:30:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 452 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:55.413582 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b17cb-2e38-4cc9-88e2-c804abd54994 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:55.414300 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b17cb-2e38-4cc9-88e2-c804abd54994 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:55.417134 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b17cb-2e38-4cc9-88e2-c804abd54994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:55.449346 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-b75b17cb-2e38-4cc9-88e2-c804abd54994 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:55.451182 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-b75b17cb-2e38-4cc9-88e2-c804abd54994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:55.485282 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:55.551093 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 279/553] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:30:55.551093 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b17cb-2e38-4cc9-88e2-c804abd54994 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:55.575013 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:55.596625 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceee6f5-c600-440f-91b6-9935a5d116fd None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:55.643988 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1c4db-3582-464b-a792-5b27e0e7c739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:55.644762 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1c4db-3582-464b-a792-5b27e0e7c739 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:55.645381 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1c4db-3582-464b-a792-5b27e0e7c739 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:55.645729 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1c4db-3582-464b-a792-5b27e0e7c739 None admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:55.647017 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e1c4db-3582-464b-a792-5b27e0e7c739 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:55.647017 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e1c4db-3582-464b-a792-5b27e0e7c739 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:55.651009 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e1c4db-3582-464b-a792-5b27e0e7c739 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:55.688579 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 275/554] 10.222.0.42 () {56 vars in 1135 bytes} [Fri Aug 26 07:30:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:55.691495 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1f350-5fb9-4896-ac86-62e3e9fe383b None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:55.691827 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1f350-5fb9-4896-ac86-62e3e9fe383b None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:55.692110 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1f350-5fb9-4896-ac86-62e3e9fe383b None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:55.698604 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 276/555] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:30:55.702494 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290b505-e58a-4914-9abd-68053368a05d None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:55.707010 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290b505-e58a-4914-9abd-68053368a05d None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:55.707010 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290b505-e58a-4914-9abd-68053368a05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:55.731018 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b17cb-2e38-4cc9-88e2-c804abd54994 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:55.763019 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-e290b505-e58a-4914-9abd-68053368a05d None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:55.763019 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-e290b505-e58a-4914-9abd-68053368a05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:55.777332 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b253cc-83fb-45d5-b12a-c7fb2f7e4de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:55.778341 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b253cc-83fb-45d5-b12a-c7fb2f7e4de1 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:55.778821 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b253cc-83fb-45d5-b12a-c7fb2f7e4de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:55.779366 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b253cc-83fb-45d5-b12a-c7fb2f7e4de1 None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:55.780343 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b253cc-83fb-45d5-b12a-c7fb2f7e4de1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:55.782678 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b253cc-83fb-45d5-b12a-c7fb2f7e4de1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:55.784428 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b253cc-83fb-45d5-b12a-c7fb2f7e4de1 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:55.795047 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 280/556] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 26 07:30:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:55.796309 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b253cc-83fb-45d5-b12a-c7fb2f7e4de1 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:55.877507 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 277/557] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:30:55.878687 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290b505-e58a-4914-9abd-68053368a05d None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:55.935363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:55.972811 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:55.975476 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b253cc-83fb-45d5-b12a-c7fb2f7e4de1 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:56.030130 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfb666-0ea5-418f-a01a-a66d8fa0d0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:56.031403 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfb666-0ea5-418f-a01a-a66d8fa0d0d6 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:56.036436 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfb666-0ea5-418f-a01a-a66d8fa0d0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:56.036966 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfb666-0ea5-418f-a01a-a66d8fa0d0d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:56.100167 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290b505-e58a-4914-9abd-68053368a05d None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:56.166394 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df22fd2-b206-41ae-95c2-59c9a757e3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:56.166394 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df22fd2-b206-41ae-95c2-59c9a757e3fb None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:56.166394 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df22fd2-b206-41ae-95c2-59c9a757e3fb None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:56.166721 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df22fd2-b206-41ae-95c2-59c9a757e3fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:56.179121 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cfb666-0ea5-418f-a01a-a66d8fa0d0d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:56.180133 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df22fd2-b206-41ae-95c2-59c9a757e3fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:56.180827 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cfb666-0ea5-418f-a01a-a66d8fa0d0d6 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:56.181662 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df22fd2-b206-41ae-95c2-59c9a757e3fb None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:56.200544 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-7df22fd2-b206-41ae-95c2-59c9a757e3fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:30:56.200544 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:56.200544 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:56.200544 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:56.200544 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:56.200544 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:56.200544 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:56.200544 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:56.200544 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:56.200544 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:56.200544 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:56.200544 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:56.200544 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:30:56.200544 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:30:56.200544 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:30:56.200544 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:30:56.201531 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:56.201531 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:56.201531 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:56.201531 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:56.201531 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:56.201531 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:56.201531 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:56.201531 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:56.201531 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:56.201531 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:56.201531 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:56.201531 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:56.201531 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:56.201531 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:56.201531 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:56.201531 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:56.201531 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:30:56.202404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:30:56.202404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:30:56.202404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:30:56.202404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 278/558] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:30:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:56.202630 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df22fd2-b206-41ae-95c2-59c9a757e3fb None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:56.292537 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:56.319151 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 281/559] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:30:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 07:30:56.319151 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfb666-0ea5-418f-a01a-a66d8fa0d0d6 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:56.320736 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:56.334107 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df22fd2-b206-41ae-95c2-59c9a757e3fb None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:56.383398 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbfecee-f2cd-47e2-8936-54c896db5992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:56.385574 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfecee-f2cd-47e2-8936-54c896db5992 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:56.386285 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfecee-f2cd-47e2-8936-54c896db5992 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:56.386750 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfecee-f2cd-47e2-8936-54c896db5992 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:56.408179 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbfecee-f2cd-47e2-8936-54c896db5992 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:30:56.413128 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-2dbfecee-f2cd-47e2-8936-54c896db5992 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 07:30:56.413128 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:56.413128 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:56.413128 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:56.413128 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:56.413128 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:56.413128 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:56.413128 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:56.413128 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:56.413128 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:56.413128 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:56.413128 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:56.413128 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:30:56.413128 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:30:56.413128 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:30:56.413128 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:30:56.414095 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:30:56.414095 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:30:56.414095 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:30:56.414095 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:30:56.414095 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:56.414095 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:56.414095 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:56.414095 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:56.414095 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:56.414095 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:56.414095 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:56.414095 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:56.414095 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:56.414095 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:56.414095 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:56.414095 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:56.414945 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:56.414945 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:56.414945 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:56.414945 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:56.414945 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:30:56.414945 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:30:56.414945 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:30:56.414945 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:30:56.414945 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:30:56.414945 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:30:56.414945 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 07:30:56.414945 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:30:56.414945 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 279/560] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 26 07:30:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:56.417344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbfecee-f2cd-47e2-8936-54c896db5992 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:56.469686 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfb666-0ea5-418f-a01a-a66d8fa0d0d6 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:56.513001 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396eec35-1572-4bec-afc9-972de45a88d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:56.513984 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396eec35-1572-4bec-afc9-972de45a88d9 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:56.514723 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396eec35-1572-4bec-afc9-972de45a88d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:56.515040 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396eec35-1572-4bec-afc9-972de45a88d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:56.534294 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396eec35-1572-4bec-afc9-972de45a88d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:30:56.540517 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-396eec35-1572-4bec-afc9-972de45a88d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 07:30:56.540517 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:56.540517 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:56.540517 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:56.540517 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:56.540517 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:56.540517 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:56.540517 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:56.540517 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:56.540517 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:56.540517 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:56.540517 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:56.540517 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:30:56.540517 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:30:56.540517 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:30:56.540517 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:30:56.541481 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:30:56.541481 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:30:56.541481 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:30:56.541481 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:30:56.541481 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:56.541481 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:56.541481 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:56.541481 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:56.541481 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:56.541481 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:56.541481 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:56.541481 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:56.541481 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:56.541481 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:56.541481 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:56.541481 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:56.542328 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:56.542328 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:56.542328 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:56.542328 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:56.542328 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:30:56.542328 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:30:56.542328 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:30:56.542328 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:30:56.542328 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:30:56.542328 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:30:56.542328 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 07:30:56.542328 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:30:56.546633 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 282/561] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 26 07:30:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:56.547678 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396eec35-1572-4bec-afc9-972de45a88d9 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:56.556933 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbfecee-f2cd-47e2-8936-54c896db5992 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:56.600829 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed192f-c230-4def-a66a-14f11d05e35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:56.601848 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed192f-c230-4def-a66a-14f11d05e35e None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:56.602195 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed192f-c230-4def-a66a-14f11d05e35e None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:56.602474 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed192f-c230-4def-a66a-14f11d05e35e None admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:56.603236 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed192f-c230-4def-a66a-14f11d05e35e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:56.603547 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed192f-c230-4def-a66a-14f11d05e35e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:56.604986 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed192f-c230-4def-a66a-14f11d05e35e None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:56.607378 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:56.619518 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 280/562] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:56.620577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed192f-c230-4def-a66a-14f11d05e35e None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:56.651017 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:56.698114 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396eec35-1572-4bec-afc9-972de45a88d9 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:56.745715 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f1718-a3d1-4ffc-b780-d54a27f18c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:56.746363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f1718-a3d1-4ffc-b780-d54a27f18c7e None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:56.746640 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f1718-a3d1-4ffc-b780-d54a27f18c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:56.746910 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f1718-a3d1-4ffc-b780-d54a27f18c7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:56.762501 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f1718-a3d1-4ffc-b780-d54a27f18c7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:56.762693 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed192f-c230-4def-a66a-14f11d05e35e None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:56.764284 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f1718-a3d1-4ffc-b780-d54a27f18c7e None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:56.781995 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-f74f1718-a3d1-4ffc-b780-d54a27f18c7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:30:56.781995 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:56.781995 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:56.781995 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:56.781995 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:56.781995 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:56.781995 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:56.781995 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:56.781995 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:56.781995 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:56.781995 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:56.781995 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:56.781995 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:30:56.781995 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:30:56.781995 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:30:56.781995 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:30:56.782975 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:56.782975 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:56.782975 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:56.782975 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:56.782975 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:56.782975 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:56.782975 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:56.782975 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:56.782975 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:56.782975 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:56.782975 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:56.782975 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:56.782975 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:56.782975 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:56.782975 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:56.782975 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:56.782975 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:30:56.783964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:30:56.783964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:30:56.783964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:30:56.787176 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 283/563] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:30:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:56.787996 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f1718-a3d1-4ffc-b780-d54a27f18c7e None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:56.807129 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b9385-3d74-46ce-9e71-c72760015729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:56.807742 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b9385-3d74-46ce-9e71-c72760015729 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:56.808016 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b9385-3d74-46ce-9e71-c72760015729 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:56.808282 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b9385-3d74-46ce-9e71-c72760015729 None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:56.808945 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b9385-3d74-46ce-9e71-c72760015729 None admin] RBAC: Adding query filter params (name=service) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:56.809245 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b9385-3d74-46ce-9e71-c72760015729 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:56.810621 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b9385-3d74-46ce-9e71-c72760015729 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:56.821637 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 281/564] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 26 07:30:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:56.822469 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b9385-3d74-46ce-9e71-c72760015729 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:56.912350 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:56.913732 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:56.922926 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f1718-a3d1-4ffc-b780-d54a27f18c7e None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:56.938683 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b9385-3d74-46ce-9e71-c72760015729 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:56.962250 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a78fa-24d0-4a1f-b862-0e8133bd9ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:56.962800 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a78fa-24d0-4a1f-b862-0e8133bd9ec1 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:56.963134 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a78fa-24d0-4a1f-b862-0e8133bd9ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:56.963689 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a78fa-24d0-4a1f-b862-0e8133bd9ec1 None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:56.964498 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a78fa-24d0-4a1f-b862-0e8133bd9ec1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:56.964802 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a78fa-24d0-4a1f-b862-0e8133bd9ec1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:56.966218 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a78fa-24d0-4a1f-b862-0e8133bd9ec1 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:56.978421 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 284/565] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 26 07:30:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:56.983058 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee3ca2-682c-4f21-be30-df01bd273e64 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:56.983058 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee3ca2-682c-4f21-be30-df01bd273e64 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:56.983058 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee3ca2-682c-4f21-be30-df01bd273e64 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:56.983058 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 285/566] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:30:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:30:56.983058 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee3ca2-682c-4f21-be30-df01bd273e64 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:56.983793 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73210ded-ac32-48db-b79f-30edfb3a86a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:56.985010 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73210ded-ac32-48db-b79f-30edfb3a86a4 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:56.985279 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73210ded-ac32-48db-b79f-30edfb3a86a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:56.985727 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73210ded-ac32-48db-b79f-30edfb3a86a4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:56.995091 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73210ded-ac32-48db-b79f-30edfb3a86a4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:56.996554 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73210ded-ac32-48db-b79f-30edfb3a86a4 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:57.009723 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-73210ded-ac32-48db-b79f-30edfb3a86a4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 07:30:57.009723 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:57.009723 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:57.009723 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:57.009723 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:57.009723 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:57.009723 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:57.009723 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:57.009723 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:57.009723 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:57.009723 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:57.009723 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:57.009723 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 07:30:57.009723 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 07:30:57.009723 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 07:30:57.009723 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 07:30:57.010739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:57.010739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:57.010739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 07:30:57.010739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:30:57.010739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 07:30:57.010739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:30:57.010739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:57.010739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:57.010739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:57.010739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:57.010739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:57.010739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:57.010739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:57.010739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:57.010739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:57.010739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:57.010739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:57.010739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:57.011816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:57.011816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:57.011816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 07:30:57.011816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 07:30:57.011816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 07:30:57.011816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 07:30:57.011816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 07:30:57.011816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 07:30:57.011816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 07:30:57.011816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:30:57.011816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 282/567] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Aug 26 07:30:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:57.011816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73210ded-ac32-48db-b79f-30edfb3a86a4 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:57.121003 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee3ca2-682c-4f21-be30-df01bd273e64 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:57.131753 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73210ded-ac32-48db-b79f-30edfb3a86a4 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:57.171132 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5bc2c2-802d-4d1e-a585-8b299ba8358f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:57.171747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5bc2c2-802d-4d1e-a585-8b299ba8358f None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:57.172581 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5bc2c2-802d-4d1e-a585-8b299ba8358f None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:57.172854 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5bc2c2-802d-4d1e-a585-8b299ba8358f None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:57.173549 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5bc2c2-802d-4d1e-a585-8b299ba8358f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:57.173852 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5bc2c2-802d-4d1e-a585-8b299ba8358f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:57.175972 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5bc2c2-802d-4d1e-a585-8b299ba8358f None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:57.182053 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4bff2b-9362-43ca-9198-04c9638a9374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:57.182962 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bff2b-9362-43ca-9198-04c9638a9374 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:57.183313 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bff2b-9362-43ca-9198-04c9638a9374 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:57.183753 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bff2b-9362-43ca-9198-04c9638a9374 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:57.187279 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:57.193743 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 286/568] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:57.193743 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5bc2c2-802d-4d1e-a585-8b299ba8358f None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:57.202353 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4bff2b-9362-43ca-9198-04c9638a9374 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:57.204346 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4bff2b-9362-43ca-9198-04c9638a9374 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:57.214246 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:57.221117 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-cc4bff2b-9362-43ca-9198-04c9638a9374 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:30:57.221117 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:57.221117 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:57.221117 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:57.221117 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:57.221117 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:57.221117 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:57.221117 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:57.221117 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:57.221117 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:57.221117 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:57.221117 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:57.221117 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:30:57.221117 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:30:57.221117 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:30:57.221117 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:30:57.222874 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:57.222874 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:57.222874 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:57.222874 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:57.222874 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:57.222874 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:57.222874 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:57.222874 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:57.222874 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:57.222874 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:57.222874 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:57.222874 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:57.222874 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:57.222874 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:57.222874 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:57.222874 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:57.222874 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:30:57.224624 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:30:57.224624 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:30:57.224624 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:30:57.224624 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 283/569] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:30:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:57.224624 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e2e4e-f07c-4743-a224-15308f59445f None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:57.224624 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e2e4e-f07c-4743-a224-15308f59445f None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:57.224624 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e2e4e-f07c-4743-a224-15308f59445f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:57.247599 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-dd3e2e4e-f07c-4743-a224-15308f59445f None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:30:57.251189 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-dd3e2e4e-f07c-4743-a224-15308f59445f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:30:57.324454 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5bc2c2-802d-4d1e-a585-8b299ba8358f None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:57.327599 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 284/570] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:30:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:30:57.328347 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e2e4e-f07c-4743-a224-15308f59445f None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:57.370302 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a56ce0-5cbc-46d2-bc7c-bf4fb5df6f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:57.370950 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a56ce0-5cbc-46d2-bc7c-bf4fb5df6f8f None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:57.371267 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a56ce0-5cbc-46d2-bc7c-bf4fb5df6f8f None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:57.371545 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a56ce0-5cbc-46d2-bc7c-bf4fb5df6f8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:57.382912 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a56ce0-5cbc-46d2-bc7c-bf4fb5df6f8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:57.384425 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a56ce0-5cbc-46d2-bc7c-bf4fb5df6f8f None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:57.401801 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-65a56ce0-5cbc-46d2-bc7c-bf4fb5df6f8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:30:57.401801 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:57.401801 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:57.401801 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:57.401801 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:57.401801 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:57.401801 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:57.401801 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:57.401801 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:57.401801 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:57.401801 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:57.401801 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:57.401801 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:30:57.401801 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:30:57.401801 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:30:57.401801 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:30:57.402869 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:57.402869 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:57.402869 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:57.402869 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:57.402869 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:57.402869 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:57.402869 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:57.402869 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:57.402869 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:57.402869 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:57.402869 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:57.402869 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:57.402869 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:57.402869 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:57.402869 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:57.402869 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:57.402869 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:30:57.403803 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:30:57.403803 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:30:57.403803 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:30:57.405010 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 287/571] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:30:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:57.406191 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a56ce0-5cbc-46d2-bc7c-bf4fb5df6f8f None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:57.472408 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e2e4e-f07c-4743-a224-15308f59445f None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:57.480572 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:57.496626 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:57.516131 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61310d9e-3d12-4aa8-9c8b-f25a431a0e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:57.516772 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61310d9e-3d12-4aa8-9c8b-f25a431a0e7b None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:57.517473 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61310d9e-3d12-4aa8-9c8b-f25a431a0e7b None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:57.517761 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61310d9e-3d12-4aa8-9c8b-f25a431a0e7b None admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:57.519184 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61310d9e-3d12-4aa8-9c8b-f25a431a0e7b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:57.519184 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61310d9e-3d12-4aa8-9c8b-f25a431a0e7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:57.520627 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61310d9e-3d12-4aa8-9c8b-f25a431a0e7b None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:57.523813 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a56ce0-5cbc-46d2-bc7c-bf4fb5df6f8f None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:57.542883 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 285/572] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Aug 26 07:30:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:57.543857 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61310d9e-3d12-4aa8-9c8b-f25a431a0e7b None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:57.575497 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4b7ec-7b5b-4d07-9618-717d3219b7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:57.576767 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4b7ec-7b5b-4d07-9618-717d3219b7d3 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:57.577578 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4b7ec-7b5b-4d07-9618-717d3219b7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:57.578850 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4b7ec-7b5b-4d07-9618-717d3219b7d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:57.588873 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a4b7ec-7b5b-4d07-9618-717d3219b7d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:57.590651 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a4b7ec-7b5b-4d07-9618-717d3219b7d3 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:57.605576 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-28a4b7ec-7b5b-4d07-9618-717d3219b7d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:30:57.605576 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:57.605576 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:57.605576 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:57.605576 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:57.605576 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:57.605576 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:57.605576 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:57.605576 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:57.605576 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:57.605576 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:57.605576 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:57.605576 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 07:30:57.605576 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 07:30:57.605576 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 07:30:57.606556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 07:30:57.606556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:57.606556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:57.606556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:57.606556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:57.606556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:57.606556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:57.606556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:57.606556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:57.606556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:57.606556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:57.606556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:57.606556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:57.606556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:57.606556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:57.606556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:57.606556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:57.608001 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 07:30:57.608001 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 07:30:57.608001 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 07:30:57.608001 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 07:30:57.608001 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 07:30:57.608001 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 07:30:57.608001 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:30:57.608001 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:30:57.608001 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 288/573] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:30:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:57.609023 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4b7ec-7b5b-4d07-9618-717d3219b7d3 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:57.690672 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61310d9e-3d12-4aa8-9c8b-f25a431a0e7b None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:57.736978 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4b7ec-7b5b-4d07-9618-717d3219b7d3 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:57.737969 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d06913-7156-44c1-b6cd-aafa8e225a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:57.738602 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d06913-7156-44c1-b6cd-aafa8e225a4c None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:57.738884 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d06913-7156-44c1-b6cd-aafa8e225a4c None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:57.739188 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d06913-7156-44c1-b6cd-aafa8e225a4c None admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:57.740330 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d06913-7156-44c1-b6cd-aafa8e225a4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:57.740330 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d06913-7156-44c1-b6cd-aafa8e225a4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:57.741529 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d06913-7156-44c1-b6cd-aafa8e225a4c None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:57.759327 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 286/574] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:57.759327 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d06913-7156-44c1-b6cd-aafa8e225a4c None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:57.770135 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:57.778769 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d74a15c-3cdc-4298-8055-1f88c7d04faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:57.779579 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74a15c-3cdc-4298-8055-1f88c7d04faa None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:57.779869 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74a15c-3cdc-4298-8055-1f88c7d04faa None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:57.780139 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74a15c-3cdc-4298-8055-1f88c7d04faa None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:57.784779 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d74a15c-3cdc-4298-8055-1f88c7d04faa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:57.784779 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d74a15c-3cdc-4298-8055-1f88c7d04faa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:57.784779 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d74a15c-3cdc-4298-8055-1f88c7d04faa None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:57.801276 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 289/575] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:57.801276 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d74a15c-3cdc-4298-8055-1f88c7d04faa None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:57.802575 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:57.885112 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d06913-7156-44c1-b6cd-aafa8e225a4c None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:57.925054 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d74a15c-3cdc-4298-8055-1f88c7d04faa None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:57.925381 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e737759-91e5-4380-b1e4-d817c3d56090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:57.926094 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e737759-91e5-4380-b1e4-d817c3d56090 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:57.926449 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e737759-91e5-4380-b1e4-d817c3d56090 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:57.926784 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e737759-91e5-4380-b1e4-d817c3d56090 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:57.938916 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e737759-91e5-4380-b1e4-d817c3d56090 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:57.940544 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e737759-91e5-4380-b1e4-d817c3d56090 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:57.958360 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-8e737759-91e5-4380-b1e4-d817c3d56090 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:30:57.958360 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:57.958360 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:57.958360 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:57.958360 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:57.958360 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:57.958360 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:57.958360 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:57.958360 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:57.958360 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:57.958360 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:57.958360 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:57.958360 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:30:57.958360 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:30:57.958360 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:30:57.958360 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:30:57.959407 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:57.959407 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:57.959407 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:57.959407 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:57.959407 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:57.959407 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:57.959407 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:57.959407 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:57.959407 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:57.959407 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:57.959407 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:57.959407 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:57.959407 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:57.959407 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:57.959407 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:57.959407 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:57.959407 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:30:57.960350 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:30:57.960350 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:30:57.960350 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:30:57.961161 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 287/576] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:30:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:57.962044 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e737759-91e5-4380-b1e4-d817c3d56090 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:57.964447 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d217e26-4df5-4fc9-b736-521c645598e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:57.965062 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d217e26-4df5-4fc9-b736-521c645598e5 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:57.965344 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d217e26-4df5-4fc9-b736-521c645598e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:57.965618 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d217e26-4df5-4fc9-b736-521c645598e5 None admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:57.967023 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d217e26-4df5-4fc9-b736-521c645598e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:57.967023 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d217e26-4df5-4fc9-b736-521c645598e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:57.968075 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d217e26-4df5-4fc9-b736-521c645598e5 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:57.981251 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 290/577] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 26 07:30:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:57.982102 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d217e26-4df5-4fc9-b736-521c645598e5 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:58.039628 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:58.071759 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:58.086051 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e737759-91e5-4380-b1e4-d817c3d56090 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:58.102418 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d217e26-4df5-4fc9-b736-521c645598e5 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:58.131506 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9c58c-c2ac-42ed-938f-780d120c1dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:58.132253 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9c58c-c2ac-42ed-938f-780d120c1dcd None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:58.132610 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9c58c-c2ac-42ed-938f-780d120c1dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:58.132956 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9c58c-c2ac-42ed-938f-780d120c1dcd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:58.145675 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75147b-8bd9-4519-ad21-e1e68a83e0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:58.147468 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75147b-8bd9-4519-ad21-e1e68a83e0ae None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:58.147468 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75147b-8bd9-4519-ad21-e1e68a83e0ae None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:58.147631 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b9c58c-c2ac-42ed-938f-780d120c1dcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:30:58.147715 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75147b-8bd9-4519-ad21-e1e68a83e0ae None admin] PATH_INFO: `/v3/users/glance` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:58.151832 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-39b9c58c-c2ac-42ed-938f-780d120c1dcd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 07:30:58.151832 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:58.151832 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:58.151832 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:58.151832 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:58.151832 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:58.151832 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:58.151832 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:58.151832 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:58.151832 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:58.151832 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:58.151832 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:58.151832 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:30:58.151832 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:30:58.151832 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:30:58.151832 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:30:58.152773 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:30:58.152773 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:30:58.152773 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:30:58.152773 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:30:58.152773 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:58.152773 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:58.152773 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:58.152773 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:58.152773 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:58.152773 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:58.152773 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:58.152773 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:58.152773 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:58.152773 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:58.152773 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:58.152773 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:58.153598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:58.153598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:58.153598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:58.153598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:58.153598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:30:58.153598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:30:58.153598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:30:58.153598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:30:58.153598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:30:58.153598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:30:58.153598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 07:30:58.153598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:30:58.153598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 288/578] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 26 07:30:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:58.154771 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9c58c-c2ac-42ed-938f-780d120c1dcd None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:58.155643 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b75147b-8bd9-4519-ad21-e1e68a83e0ae None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:58.157649 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b75147b-8bd9-4519-ad21-e1e68a83e0ae None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:58.170910 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-0b75147b-8bd9-4519-ad21-e1e68a83e0ae None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 26 07:30:58.170910 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:58.170910 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:58.170910 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:58.170910 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:58.170910 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:58.170910 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:58.170910 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:58.170910 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:58.170910 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:58.170910 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:58.170910 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:58.170910 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 07:30:58.170910 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 07:30:58.170910 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 07:30:58.170910 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 07:30:58.172009 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:58.172009 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:58.172009 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 07:30:58.172009 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:30:58.172009 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 07:30:58.172009 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:30:58.172009 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:58.172009 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:58.172009 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:58.172009 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:58.172009 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:58.172009 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:58.172009 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:58.172009 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:58.172009 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:58.172009 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:58.172009 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:58.172009 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:58.172971 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:58.172971 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:58.172971 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 07:30:58.172971 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 07:30:58.172971 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 07:30:58.172971 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 07:30:58.172971 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 07:30:58.172971 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 07:30:58.172971 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 26 07:30:58.172971 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:30:58.172971 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 291/579] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:30:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:58.173613 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75147b-8bd9-4519-ad21-e1e68a83e0ae None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:58.287875 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9c58c-c2ac-42ed-938f-780d120c1dcd None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:58.328535 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1441b-9b3f-4c05-8eac-3cc16b69e1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:58.329159 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1441b-9b3f-4c05-8eac-3cc16b69e1c8 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:58.329387 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1441b-9b3f-4c05-8eac-3cc16b69e1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:58.329709 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1441b-9b3f-4c05-8eac-3cc16b69e1c8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:58.338104 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d1441b-9b3f-4c05-8eac-3cc16b69e1c8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:58.339616 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d1441b-9b3f-4c05-8eac-3cc16b69e1c8 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:58.352724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-a1d1441b-9b3f-4c05-8eac-3cc16b69e1c8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 07:30:58.352724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:58.352724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:58.352724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:58.352724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:58.352724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:58.352724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:58.352724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:58.352724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:58.352724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:58.352724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:58.352724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:58.352724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 07:30:58.352724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 07:30:58.352724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 07:30:58.352724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 07:30:58.354468 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:58.354468 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:58.354468 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 07:30:58.354468 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:30:58.354468 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 07:30:58.354468 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:30:58.354468 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:58.354468 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:58.354468 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:58.354468 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:58.354468 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:58.354468 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:58.354468 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:58.354468 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:58.354468 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:58.354468 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:58.354468 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:58.354468 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:58.356349 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:58.356349 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:58.356349 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 07:30:58.356349 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 07:30:58.356349 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 07:30:58.356349 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 07:30:58.356349 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 07:30:58.356349 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 07:30:58.356349 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 07:30:58.356349 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:30:58.356349 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 289/580] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:30:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:58.356349 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1441b-9b3f-4c05-8eac-3cc16b69e1c8 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:58.363170 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75147b-8bd9-4519-ad21-e1e68a83e0ae None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:58.371296 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:58.374628 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:58.403747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a83d3-d769-442b-9df5-3f51c419c5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:58.404428 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a83d3-d769-442b-9df5-3f51c419c5ff None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:58.404712 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a83d3-d769-442b-9df5-3f51c419c5ff None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:58.404993 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a83d3-d769-442b-9df5-3f51c419c5ff None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:58.405653 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a83d3-d769-442b-9df5-3f51c419c5ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:58.405962 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a83d3-d769-442b-9df5-3f51c419c5ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:58.407429 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a83d3-d769-442b-9df5-3f51c419c5ff None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:58.420963 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 292/581] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:58.421703 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a83d3-d769-442b-9df5-3f51c419c5ff None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:58.488823 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1441b-9b3f-4c05-8eac-3cc16b69e1c8 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:58.534522 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b96ae48-5314-4f3c-ab73-f2e41cd8713a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:58.535290 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96ae48-5314-4f3c-ab73-f2e41cd8713a None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:58.535577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96ae48-5314-4f3c-ab73-f2e41cd8713a None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:58.535845 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96ae48-5314-4f3c-ab73-f2e41cd8713a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:58.536582 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b96ae48-5314-4f3c-ab73-f2e41cd8713a None admin] RBAC: Adding query filter params (role.id=aad163eaa5c8447ca5d5a7d5d861395a, scope.project.id=becbf57e91454d499dec313ff9eadfae, user.id=3142255c263e44a189db82c621f87e7d) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:58.536891 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b96ae48-5314-4f3c-ab73-f2e41cd8713a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:58.538342 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b96ae48-5314-4f3c-ab73-f2e41cd8713a None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:58.555043 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 290/582] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:30:58 2022] GET /identity/v3/role_assignments?user.id=3142255c263e44a189db82c621f87e7d&scope.project.id=becbf57e91454d499dec313ff9eadfae&role.id=aad163eaa5c8447ca5d5a7d5d861395a => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:58.555043 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b96ae48-5314-4f3c-ab73-f2e41cd8713a None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:58.555352 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a83d3-d769-442b-9df5-3f51c419c5ff None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:58.608954 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6349210-fa46-4acb-869a-b1f872c46b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:58.611166 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6349210-fa46-4acb-869a-b1f872c46b49 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:58.611166 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6349210-fa46-4acb-869a-b1f872c46b49 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:58.611542 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6349210-fa46-4acb-869a-b1f872c46b49 None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:58.612671 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6349210-fa46-4acb-869a-b1f872c46b49 None admin] RBAC: Adding query filter params (name=service) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:58.612792 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6349210-fa46-4acb-869a-b1f872c46b49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:58.614316 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6349210-fa46-4acb-869a-b1f872c46b49 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:58.624519 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 293/583] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 26 07:30:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:58.626198 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6349210-fa46-4acb-869a-b1f872c46b49 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:58.648305 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:58.673153 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:58.691734 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b96ae48-5314-4f3c-ab73-f2e41cd8713a None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:58.743870 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71cdbb8-9334-45c7-8f0f-db8aad814857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:58.744880 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cdbb8-9334-45c7-8f0f-db8aad814857 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:58.745384 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cdbb8-9334-45c7-8f0f-db8aad814857 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:58.745737 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cdbb8-9334-45c7-8f0f-db8aad814857 None admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:58.746916 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71cdbb8-9334-45c7-8f0f-db8aad814857 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:58.750074 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71cdbb8-9334-45c7-8f0f-db8aad814857 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:58.752134 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71cdbb8-9334-45c7-8f0f-db8aad814857 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:58.780218 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 291/584] 10.222.0.42 () {56 vars in 1137 bytes} [Fri Aug 26 07:30:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:58.780874 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71cdbb8-9334-45c7-8f0f-db8aad814857 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:58.786603 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6349210-fa46-4acb-869a-b1f872c46b49 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:58.845054 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9fadb-099b-490e-abce-ddd2c2e15be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:58.845784 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9fadb-099b-490e-abce-ddd2c2e15be1 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:58.846072 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9fadb-099b-490e-abce-ddd2c2e15be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:58.846344 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9fadb-099b-490e-abce-ddd2c2e15be1 None admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:58.847246 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c9fadb-099b-490e-abce-ddd2c2e15be1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:58.847554 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c9fadb-099b-490e-abce-ddd2c2e15be1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:58.848990 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c9fadb-099b-490e-abce-ddd2c2e15be1 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:58.871028 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 294/585] 10.222.0.42 () {56 vars in 1137 bytes} [Fri Aug 26 07:30:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:58.872384 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9fadb-099b-490e-abce-ddd2c2e15be1 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:58.940514 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71cdbb8-9334-45c7-8f0f-db8aad814857 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:58.978369 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:58.987406 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f57dcff-8045-474d-bbb9-0c9c9ef68e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:58.997182 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57dcff-8045-474d-bbb9-0c9c9ef68e49 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:58.997182 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57dcff-8045-474d-bbb9-0c9c9ef68e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:58.997182 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57dcff-8045-474d-bbb9-0c9c9ef68e49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:58.998910 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f57dcff-8045-474d-bbb9-0c9c9ef68e49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:59.001204 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f57dcff-8045-474d-bbb9-0c9c9ef68e49 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:59.015383 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:59.016382 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-5f57dcff-8045-474d-bbb9-0c9c9ef68e49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:30:59.016382 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:59.016382 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:59.016382 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:59.016382 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:59.016382 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:59.016382 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:59.016382 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:59.016382 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:59.016382 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:59.016382 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:59.016382 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:59.016382 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 07:30:59.016382 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 07:30:59.016382 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 07:30:59.017270 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 07:30:59.017270 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:59.017270 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:59.017270 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:59.017270 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:59.017270 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:59.017270 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:59.017270 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:59.017270 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:59.017270 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:59.017270 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:59.017270 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:59.017270 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:59.017270 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:59.017270 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:59.017270 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:59.017270 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:59.018147 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 07:30:59.018147 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 07:30:59.018147 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 07:30:59.018147 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 07:30:59.018147 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 07:30:59.018147 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 07:30:59.018147 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:30:59.018147 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:30:59.018147 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 292/586] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:30:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:59.019922 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f57dcff-8045-474d-bbb9-0c9c9ef68e49 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:59.039597 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9fadb-099b-490e-abce-ddd2c2e15be1 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:59.096554 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab415f93-2b3c-46fe-9ba4-a94c16ea1e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:59.097216 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab415f93-2b3c-46fe-9ba4-a94c16ea1e90 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:59.097497 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab415f93-2b3c-46fe-9ba4-a94c16ea1e90 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:59.097901 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab415f93-2b3c-46fe-9ba4-a94c16ea1e90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:59.116083 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab415f93-2b3c-46fe-9ba4-a94c16ea1e90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:59.117575 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab415f93-2b3c-46fe-9ba4-a94c16ea1e90 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:59.137132 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-ab415f93-2b3c-46fe-9ba4-a94c16ea1e90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:30:59.137132 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:59.137132 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:59.137132 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:59.137132 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:59.137132 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:59.137132 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:59.137132 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:59.137132 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:59.137132 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:59.137132 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:59.137132 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:59.137132 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:30:59.137132 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:30:59.137132 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:30:59.137132 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:30:59.138268 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:59.138268 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:59.138268 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:59.138268 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:59.138268 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:59.138268 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:59.138268 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:59.138268 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:59.138268 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:59.138268 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:59.138268 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:59.138268 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:59.138268 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:59.138268 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:59.138268 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:59.138268 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:59.138268 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:30:59.139199 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:30:59.139199 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:30:59.139199 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:30:59.139199 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 295/587] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:30:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:59.139199 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab415f93-2b3c-46fe-9ba4-a94c16ea1e90 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:59.173332 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f57dcff-8045-474d-bbb9-0c9c9ef68e49 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:59.220661 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c084fa3-1aea-4580-b7bb-147ae344187c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:59.221604 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c084fa3-1aea-4580-b7bb-147ae344187c None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:59.222033 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c084fa3-1aea-4580-b7bb-147ae344187c None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:59.222476 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c084fa3-1aea-4580-b7bb-147ae344187c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:59.244063 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c084fa3-1aea-4580-b7bb-147ae344187c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:59.245541 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c084fa3-1aea-4580-b7bb-147ae344187c None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:59.266021 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-0c084fa3-1aea-4580-b7bb-147ae344187c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:30:59.266021 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:59.266021 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:59.266021 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:59.266021 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:59.266021 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:59.266021 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:59.266021 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:59.266021 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:59.266021 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:59.266021 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:59.266021 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:59.266021 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:30:59.266021 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:30:59.266021 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:30:59.266021 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:30:59.267193 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:59.267193 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:59.267193 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:59.267193 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:59.267193 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:59.267193 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:59.267193 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:59.267193 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:59.267193 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:59.267193 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:59.267193 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:59.267193 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:59.267193 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:59.267193 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:59.267193 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:59.267193 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:59.267193 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:30:59.268108 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:30:59.268108 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:30:59.268108 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:30:59.272277 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 293/588] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:30:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:59.273393 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c084fa3-1aea-4580-b7bb-147ae344187c None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:59.285363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab415f93-2b3c-46fe-9ba4-a94c16ea1e90 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:59.331839 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:59.334573 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988c454-88c7-4465-980f-1d03ca162ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:59.335233 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988c454-88c7-4465-980f-1d03ca162ed5 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:59.335512 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988c454-88c7-4465-980f-1d03ca162ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:59.335782 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988c454-88c7-4465-980f-1d03ca162ed5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:59.344649 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:59.351147 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c988c454-88c7-4465-980f-1d03ca162ed5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:59.352639 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c988c454-88c7-4465-980f-1d03ca162ed5 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:59.369678 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-c988c454-88c7-4465-980f-1d03ca162ed5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:30:59.369678 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:30:59.369678 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:30:59.369678 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:30:59.369678 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:30:59.369678 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:30:59.369678 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:30:59.369678 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:30:59.369678 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:30:59.369678 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:30:59.369678 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:30:59.369678 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:30:59.369678 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:30:59.369678 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:30:59.369678 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:30:59.369678 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:30:59.370946 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:30:59.370946 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:30:59.370946 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:30:59.370946 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:30:59.370946 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:30:59.370946 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:30:59.370946 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:30:59.370946 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:30:59.370946 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:30:59.370946 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:30:59.370946 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:30:59.370946 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:30:59.370946 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:30:59.370946 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:30:59.370946 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:30:59.370946 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:30:59.370946 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:30:59.372080 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:30:59.372080 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:30:59.372080 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:30:59.377827 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 296/589] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:30:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:30:59.377827 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988c454-88c7-4465-980f-1d03ca162ed5 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:59.426684 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c084fa3-1aea-4580-b7bb-147ae344187c None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:59.480757 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5b329-29b5-43a9-8b56-adc4764dd7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:59.481717 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5b329-29b5-43a9-8b56-adc4764dd7eb None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:59.482196 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5b329-29b5-43a9-8b56-adc4764dd7eb None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:59.482656 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5b329-29b5-43a9-8b56-adc4764dd7eb None admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:59.483566 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5b329-29b5-43a9-8b56-adc4764dd7eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:59.484248 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5b329-29b5-43a9-8b56-adc4764dd7eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:59.488568 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5b329-29b5-43a9-8b56-adc4764dd7eb None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:59.505051 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 294/590] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 26 07:30:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:59.507691 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5b329-29b5-43a9-8b56-adc4764dd7eb None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:59.538913 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988c454-88c7-4465-980f-1d03ca162ed5 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:59.584832 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5aa895-c9b7-4b14-bb43-d55bf2ff4c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:59.585611 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5aa895-c9b7-4b14-bb43-d55bf2ff4c72 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:59.586096 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5aa895-c9b7-4b14-bb43-d55bf2ff4c72 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:59.586205 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5aa895-c9b7-4b14-bb43-d55bf2ff4c72 None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:59.587628 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5aa895-c9b7-4b14-bb43-d55bf2ff4c72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:59.587628 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5aa895-c9b7-4b14-bb43-d55bf2ff4c72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:59.588837 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5aa895-c9b7-4b14-bb43-d55bf2ff4c72 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:59.610760 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 297/591] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:59.616932 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5aa895-c9b7-4b14-bb43-d55bf2ff4c72 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:59.654624 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5b329-29b5-43a9-8b56-adc4764dd7eb None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:59.656721 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:59.681647 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:30:59.699615 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f07a68-e301-4e39-bd24-36c591bd79d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:59.700523 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f07a68-e301-4e39-bd24-36c591bd79d7 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:59.700803 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f07a68-e301-4e39-bd24-36c591bd79d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:59.701073 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f07a68-e301-4e39-bd24-36c591bd79d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:59.701723 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f07a68-e301-4e39-bd24-36c591bd79d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:59.704709 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f07a68-e301-4e39-bd24-36c591bd79d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:59.706152 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f07a68-e301-4e39-bd24-36c591bd79d7 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:59.721167 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 295/592] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:59.721167 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f07a68-e301-4e39-bd24-36c591bd79d7 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:59.755338 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5aa895-c9b7-4b14-bb43-d55bf2ff4c72 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:59.811624 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e9c26-4a17-421b-bddc-588a2c8487af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:59.813347 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e9c26-4a17-421b-bddc-588a2c8487af None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:59.813771 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e9c26-4a17-421b-bddc-588a2c8487af None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:59.814184 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e9c26-4a17-421b-bddc-588a2c8487af None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:59.815133 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e9c26-4a17-421b-bddc-588a2c8487af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:30:59.815437 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e9c26-4a17-421b-bddc-588a2c8487af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:59.816824 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e9c26-4a17-421b-bddc-588a2c8487af None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:59.838498 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 298/593] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:30:59.838498 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e9c26-4a17-421b-bddc-588a2c8487af None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:30:59.866688 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f07a68-e301-4e39-bd24-36c591bd79d7 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:59.913891 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7452034-edea-4d9e-8bbe-12cb10102b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:30:59.914922 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7452034-edea-4d9e-8bbe-12cb10102b5e None admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:30:59.915340 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7452034-edea-4d9e-8bbe-12cb10102b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:30:59.916185 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7452034-edea-4d9e-8bbe-12cb10102b5e None admin] PATH_INFO: `/v3/projects/becbf57e91454d499dec313ff9eadfae/users/bc92c0a0a2cc4722868e6877bac93ada/roles/aad163eaa5c8447ca5d5a7d5d861395a` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:30:59.937094 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7452034-edea-4d9e-8bbe-12cb10102b5e None admin] RBAC: Authorizing `identity:create_grant(project_id=becbf57e91454d499dec313ff9eadfae, user_id=bc92c0a0a2cc4722868e6877bac93ada, role_id=aad163eaa5c8447ca5d5a7d5d861395a)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:30:59.940179 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7452034-edea-4d9e-8bbe-12cb10102b5e None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:30:59.976471 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e9c26-4a17-421b-bddc-588a2c8487af None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:30:59.992268 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:00.021161 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27855da-ed7e-4e25-9c7d-42dac17e68aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:00.021966 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27855da-ed7e-4e25-9c7d-42dac17e68aa None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:00.022344 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27855da-ed7e-4e25-9c7d-42dac17e68aa None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:00.022722 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27855da-ed7e-4e25-9c7d-42dac17e68aa None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:00.031779 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27855da-ed7e-4e25-9c7d-42dac17e68aa None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:00.033573 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27855da-ed7e-4e25-9c7d-42dac17e68aa None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:00.047342 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 296/594] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 26 07:30:59 2022] PUT /identity/v3/projects/becbf57e91454d499dec313ff9eadfae/users/bc92c0a0a2cc4722868e6877bac93ada/roles/aad163eaa5c8447ca5d5a7d5d861395a => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:31:00.047342 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7452034-edea-4d9e-8bbe-12cb10102b5e None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:00.047645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-c27855da-ed7e-4e25-9c7d-42dac17e68aa None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 07:31:00.047645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:00.047645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:00.047645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:00.047645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:00.047645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:00.047645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:00.047645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:00.047645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:00.047645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:00.047645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:00.047645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:00.047645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 07:31:00.047645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 07:31:00.047645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 07:31:00.047645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 07:31:00.048673 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:00.048673 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:00.048673 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 07:31:00.048673 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:31:00.048673 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 07:31:00.048673 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:31:00.048673 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:00.048673 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:00.048673 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:00.048673 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:00.048673 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:00.048673 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:00.048673 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:00.048673 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:00.048673 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:00.048673 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:00.048673 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:00.048673 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:00.050412 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:00.050412 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:00.050412 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 07:31:00.050412 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 07:31:00.050412 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 07:31:00.050412 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 07:31:00.050412 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 07:31:00.050412 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 07:31:00.050412 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 07:31:00.050412 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:00.055051 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 299/595] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 26 07:30:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:00.055051 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27855da-ed7e-4e25-9c7d-42dac17e68aa None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:00.091395 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:00.272326 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7452034-edea-4d9e-8bbe-12cb10102b5e None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:00.315819 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27855da-ed7e-4e25-9c7d-42dac17e68aa None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:00.317218 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa98e2-b3a4-41ad-9d45-f92e2efc721c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:00.318605 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa98e2-b3a4-41ad-9d45-f92e2efc721c None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:00.320037 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa98e2-b3a4-41ad-9d45-f92e2efc721c None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:00.320520 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa98e2-b3a4-41ad-9d45-f92e2efc721c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:00.329055 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa98e2-b3a4-41ad-9d45-f92e2efc721c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:00.331794 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa98e2-b3a4-41ad-9d45-f92e2efc721c None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:00.348175 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-b9aa98e2-b3a4-41ad-9d45-f92e2efc721c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:31:00.348175 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:00.348175 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:00.348175 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:00.348175 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:00.348175 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:00.348175 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:00.348175 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:00.348175 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:00.348175 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:00.348175 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:00.348175 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:00.348175 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 07:31:00.348175 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 07:31:00.348175 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 07:31:00.349792 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 07:31:00.349792 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:00.349792 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:00.349792 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:00.349792 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:00.349792 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:00.349792 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:00.349792 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:00.349792 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:00.349792 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:00.349792 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:00.349792 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:00.349792 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:00.349792 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:00.349792 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:00.349792 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:00.349792 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:00.350911 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 07:31:00.350911 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 07:31:00.350911 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 07:31:00.350911 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 07:31:00.350911 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 07:31:00.350911 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 07:31:00.350911 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:31:00.350911 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:00.353557 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 297/596] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:31:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:00.354525 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa98e2-b3a4-41ad-9d45-f92e2efc721c None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:00.372071 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6d201-f5f6-41c6-9706-01971482633c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:00.373376 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6d201-f5f6-41c6-9706-01971482633c None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:00.373486 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6d201-f5f6-41c6-9706-01971482633c None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:00.373909 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6d201-f5f6-41c6-9706-01971482633c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:00.384302 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b6d201-f5f6-41c6-9706-01971482633c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:00.385961 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b6d201-f5f6-41c6-9706-01971482633c None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:00.405639 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-20b6d201-f5f6-41c6-9706-01971482633c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:31:00.405639 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:00.405639 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:00.405639 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:00.405639 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:00.405639 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:00.405639 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:00.405639 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:00.405639 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:00.405639 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:00.405639 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:00.405639 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:00.405639 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 07:31:00.405639 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 07:31:00.405639 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 07:31:00.407129 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 07:31:00.407129 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:00.407129 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:00.407129 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:00.407129 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:00.407129 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:00.407129 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:00.407129 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:00.407129 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:00.407129 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:00.407129 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:00.407129 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:00.407129 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:00.407129 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:00.407129 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:00.407129 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:00.407129 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:00.408313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 07:31:00.408313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 07:31:00.408313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 07:31:00.408313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 07:31:00.408313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 07:31:00.408313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 07:31:00.408313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:31:00.408313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:00.414875 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 300/597] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:31:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:00.414875 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6d201-f5f6-41c6-9706-01971482633c None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:00.499261 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:00.568912 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:00.618264 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa98e2-b3a4-41ad-9d45-f92e2efc721c None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:00.650778 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6d201-f5f6-41c6-9706-01971482633c None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:00.673779 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dce70f-ce95-4148-a1c3-74beb0a78556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:00.674486 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dce70f-ce95-4148-a1c3-74beb0a78556 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:00.674762 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dce70f-ce95-4148-a1c3-74beb0a78556 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:00.675310 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dce70f-ce95-4148-a1c3-74beb0a78556 None admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:00.675993 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dce70f-ce95-4148-a1c3-74beb0a78556 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:00.676312 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dce70f-ce95-4148-a1c3-74beb0a78556 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:00.677800 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dce70f-ce95-4148-a1c3-74beb0a78556 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:00.699827 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca0e0a-c60e-4919-aa74-a23dd91bf4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:00.700457 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca0e0a-c60e-4919-aa74-a23dd91bf4fb None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:00.700734 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca0e0a-c60e-4919-aa74-a23dd91bf4fb None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:00.701008 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca0e0a-c60e-4919-aa74-a23dd91bf4fb None admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:00.701724 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebca0e0a-c60e-4919-aa74-a23dd91bf4fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:00.702033 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebca0e0a-c60e-4919-aa74-a23dd91bf4fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:00.704293 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 298/598] 10.222.0.42 () {56 vars in 1139 bytes} [Fri Aug 26 07:31:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:00.704505 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebca0e0a-c60e-4919-aa74-a23dd91bf4fb None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:00.705768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dce70f-ce95-4148-a1c3-74beb0a78556 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:00.737793 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 301/599] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 26 07:31:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:00.737793 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707cd75-ef3a-467d-b465-4910a68f5e69 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:00.737793 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707cd75-ef3a-467d-b465-4910a68f5e69 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:00.737793 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707cd75-ef3a-467d-b465-4910a68f5e69 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:00.737793 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 302/600] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:31:00.737793 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707cd75-ef3a-467d-b465-4910a68f5e69 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:00.869747 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dce70f-ce95-4148-a1c3-74beb0a78556 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:00.874092 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:00.891882 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707cd75-ef3a-467d-b465-4910a68f5e69 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:00.910117 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:00.917541 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650013df-2da7-43c3-bc6a-b53113c0c6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:00.918224 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650013df-2da7-43c3-bc6a-b53113c0c6a0 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:00.918582 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650013df-2da7-43c3-bc6a-b53113c0c6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:00.918799 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650013df-2da7-43c3-bc6a-b53113c0c6a0 None admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:00.919523 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650013df-2da7-43c3-bc6a-b53113c0c6a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:00.919832 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650013df-2da7-43c3-bc6a-b53113c0c6a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:00.921346 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650013df-2da7-43c3-bc6a-b53113c0c6a0 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:00.938958 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 299/601] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 26 07:31:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:00.939881 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650013df-2da7-43c3-bc6a-b53113c0c6a0 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:00.948043 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728b734-88d6-4a54-96de-c37e907d4e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:00.949829 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728b734-88d6-4a54-96de-c37e907d4e42 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:00.950315 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728b734-88d6-4a54-96de-c37e907d4e42 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:00.950816 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728b734-88d6-4a54-96de-c37e907d4e42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:00.962941 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c728b734-88d6-4a54-96de-c37e907d4e42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:00.964861 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c728b734-88d6-4a54-96de-c37e907d4e42 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:00.985845 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-c728b734-88d6-4a54-96de-c37e907d4e42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:00.985845 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:00.985845 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:00.985845 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:00.985845 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:00.985845 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:00.985845 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:00.985845 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:00.985845 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:00.985845 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:00.985845 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:00.985845 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:00.985845 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:31:00.985845 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:31:00.985845 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:31:00.985845 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:31:00.987703 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:00.987703 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:00.987703 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:00.987703 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:00.987703 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:00.987703 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:00.987703 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:00.987703 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:00.987703 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:00.987703 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:00.987703 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:00.987703 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:00.987703 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:00.987703 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:00.987703 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:00.987703 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:00.987703 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:31:00.989407 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:31:00.989407 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:00.989407 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:00.991885 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 303/602] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:31:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:00.993238 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485af9cb-7b2c-4d88-9b96-7d70f2659821 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:00.993584 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485af9cb-7b2c-4d88-9b96-7d70f2659821 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:00.993926 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485af9cb-7b2c-4d88-9b96-7d70f2659821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:01.014578 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-485af9cb-7b2c-4d88-9b96-7d70f2659821 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:01.015974 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-485af9cb-7b2c-4d88-9b96-7d70f2659821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:01.094470 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650013df-2da7-43c3-bc6a-b53113c0c6a0 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:01.138310 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad926ec-d5eb-4087-bd8d-67f2e2ef15a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:01.138310 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad926ec-d5eb-4087-bd8d-67f2e2ef15a6 None admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:01.138310 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad926ec-d5eb-4087-bd8d-67f2e2ef15a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:01.138646 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad926ec-d5eb-4087-bd8d-67f2e2ef15a6 None admin] PATH_INFO: `/v3/projects/becbf57e91454d499dec313ff9eadfae/users/2df7725203304d8fbe3a768656cabf23/roles/aad163eaa5c8447ca5d5a7d5d861395a` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:01.139264 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 304/603] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:31:01.140419 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485af9cb-7b2c-4d88-9b96-7d70f2659821 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:01.157382 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad926ec-d5eb-4087-bd8d-67f2e2ef15a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=becbf57e91454d499dec313ff9eadfae, user_id=2df7725203304d8fbe3a768656cabf23, role_id=aad163eaa5c8447ca5d5a7d5d861395a)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:01.158972 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad926ec-d5eb-4087-bd8d-67f2e2ef15a6 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:01.243625 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:01.271386 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 300/604] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 26 07:31:00 2022] PUT /identity/v3/projects/becbf57e91454d499dec313ff9eadfae/users/2df7725203304d8fbe3a768656cabf23/roles/aad163eaa5c8447ca5d5a7d5d861395a => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:31:01.275727 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad926ec-d5eb-4087-bd8d-67f2e2ef15a6 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:01.286508 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485af9cb-7b2c-4d88-9b96-7d70f2659821 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:01.417442 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386d2b3-820a-40a8-bebd-95a7b5fee8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:01.418577 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386d2b3-820a-40a8-bebd-95a7b5fee8be None admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:01.419118 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386d2b3-820a-40a8-bebd-95a7b5fee8be None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:01.419600 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386d2b3-820a-40a8-bebd-95a7b5fee8be None admin] PATH_INFO: `/v3/projects/becbf57e91454d499dec313ff9eadfae/users/f23fe4069f39499c9ed8e27566eddc77/roles/aad163eaa5c8447ca5d5a7d5d861395a` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:01.428212 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:01.461955 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386d2b3-820a-40a8-bebd-95a7b5fee8be None admin] RBAC: Authorizing `identity:create_grant(project_id=becbf57e91454d499dec313ff9eadfae, user_id=f23fe4069f39499c9ed8e27566eddc77, role_id=aad163eaa5c8447ca5d5a7d5d861395a)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:01.463876 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386d2b3-820a-40a8-bebd-95a7b5fee8be None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:01.547246 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad926ec-d5eb-4087-bd8d-67f2e2ef15a6 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:01.572201 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 305/605] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 26 07:31:01 2022] PUT /identity/v3/projects/becbf57e91454d499dec313ff9eadfae/users/f23fe4069f39499c9ed8e27566eddc77/roles/aad163eaa5c8447ca5d5a7d5d861395a => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:31:01.585363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386d2b3-820a-40a8-bebd-95a7b5fee8be None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:01.634701 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57661136-3b14-47f5-8b42-037f7bc7b628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:01.639010 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57661136-3b14-47f5-8b42-037f7bc7b628 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:01.639010 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57661136-3b14-47f5-8b42-037f7bc7b628 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:01.639010 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57661136-3b14-47f5-8b42-037f7bc7b628 None admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:01.639010 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57661136-3b14-47f5-8b42-037f7bc7b628 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:01.639010 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57661136-3b14-47f5-8b42-037f7bc7b628 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:01.639010 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57661136-3b14-47f5-8b42-037f7bc7b628 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:01.675141 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 301/606] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:31:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:01.676126 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57661136-3b14-47f5-8b42-037f7bc7b628 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:01.828163 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386d2b3-820a-40a8-bebd-95a7b5fee8be None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:01.860796 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:01.862729 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:01.863974 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57661136-3b14-47f5-8b42-037f7bc7b628 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:01.879423 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883df68e-34a5-4f1d-be44-cf193b310177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:01.880424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883df68e-34a5-4f1d-be44-cf193b310177 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:01.880925 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883df68e-34a5-4f1d-be44-cf193b310177 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:01.881464 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883df68e-34a5-4f1d-be44-cf193b310177 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:01.901248 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883df68e-34a5-4f1d-be44-cf193b310177 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:31:01.907737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-883df68e-34a5-4f1d-be44-cf193b310177 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 07:31:01.907737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:01.907737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:01.907737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:01.907737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:01.907737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:01.907737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:01.907737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:01.907737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:01.907737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:01.907737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:01.907737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:01.907737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:31:01.907737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:31:01.907737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:31:01.907737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:31:01.908758 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:31:01.908758 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:31:01.908758 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:31:01.908758 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:31:01.908758 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:01.908758 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:01.908758 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:01.908758 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:01.908758 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:01.908758 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:01.908758 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:01.908758 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:01.908758 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:01.908758 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:01.908758 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:01.908758 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:01.909648 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:01.909648 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:01.909648 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:01.909648 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:01.909648 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:31:01.909648 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:31:01.909648 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:31:01.909648 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:31:01.909648 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:31:01.909648 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:31:01.909648 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 07:31:01.909648 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:01.912702 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 306/607] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 26 07:31:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:01.918586 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883df68e-34a5-4f1d-be44-cf193b310177 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:02.021495 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411f17e-8ec4-4a63-b780-61efc3fbaa34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:02.021495 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411f17e-8ec4-4a63-b780-61efc3fbaa34 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:02.021495 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411f17e-8ec4-4a63-b780-61efc3fbaa34 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:02.021495 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411f17e-8ec4-4a63-b780-61efc3fbaa34 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:02.056293 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c411f17e-8ec4-4a63-b780-61efc3fbaa34 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:02.057354 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c411f17e-8ec4-4a63-b780-61efc3fbaa34 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:02.104915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-c411f17e-8ec4-4a63-b780-61efc3fbaa34 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:31:02.104915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:02.104915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:02.104915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:02.104915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:02.104915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:02.104915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:02.104915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:02.104915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:02.104915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:02.104915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:02.104915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:02.104915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 07:31:02.104915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 07:31:02.104915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 07:31:02.105887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 07:31:02.105887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:02.105887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:02.105887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:02.105887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:02.105887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:02.105887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:02.105887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:02.105887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:02.105887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:02.105887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:02.105887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:02.105887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:02.105887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:02.105887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:02.105887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:02.105887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:02.106839 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 07:31:02.106839 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 07:31:02.106839 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 07:31:02.106839 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 07:31:02.106839 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 07:31:02.106839 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 07:31:02.106839 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:31:02.106839 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:02.106839 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 302/608] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:31:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 431 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:02.112963 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411f17e-8ec4-4a63-b780-61efc3fbaa34 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:02.339098 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883df68e-34a5-4f1d-be44-cf193b310177 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:02.407031 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df1916-b01b-4776-afb6-56a69216c383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:02.410638 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df1916-b01b-4776-afb6-56a69216c383 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:02.411743 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df1916-b01b-4776-afb6-56a69216c383 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:02.415020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df1916-b01b-4776-afb6-56a69216c383 None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:02.419016 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55df1916-b01b-4776-afb6-56a69216c383 None admin] RBAC: Adding query filter params (name=service) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:02.420969 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55df1916-b01b-4776-afb6-56a69216c383 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:02.427343 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55df1916-b01b-4776-afb6-56a69216c383 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:02.451019 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 307/609] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 26 07:31:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 531 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:02.451019 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ac3eb-2e40-4eb2-ac7f-3c7aecaccdd6 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:02.451019 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ac3eb-2e40-4eb2-ac7f-3c7aecaccdd6 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:02.451366 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ac3eb-2e40-4eb2-ac7f-3c7aecaccdd6 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:02.456723 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 308/610] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:31:02.456723 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ac3eb-2e40-4eb2-ac7f-3c7aecaccdd6 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:02.476591 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411f17e-8ec4-4a63-b780-61efc3fbaa34 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:02.524034 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:02.529493 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870145e3-f1e5-4842-b2f2-282421b48040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:02.536037 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870145e3-f1e5-4842-b2f2-282421b48040 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:02.536037 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870145e3-f1e5-4842-b2f2-282421b48040 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:02.536037 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870145e3-f1e5-4842-b2f2-282421b48040 None admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:02.536037 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870145e3-f1e5-4842-b2f2-282421b48040 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:02.536037 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870145e3-f1e5-4842-b2f2-282421b48040 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:02.536037 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870145e3-f1e5-4842-b2f2-282421b48040 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:02.550965 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 303/611] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 26 07:31:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 439 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:31:02.552720 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa206e0e-1e03-4d04-b2cf-d3ff434f938a None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:02.553193 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa206e0e-1e03-4d04-b2cf-d3ff434f938a None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:02.553650 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa206e0e-1e03-4d04-b2cf-d3ff434f938a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:02.583528 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-aa206e0e-1e03-4d04-b2cf-d3ff434f938a None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:02.585169 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-aa206e0e-1e03-4d04-b2cf-d3ff434f938a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:02.601100 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ac3eb-2e40-4eb2-ac7f-3c7aecaccdd6 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:02.604796 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:02.662878 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c83d7d-8845-4040-9a0f-103c9d3f1ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:02.663575 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c83d7d-8845-4040-9a0f-103c9d3f1ce3 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:02.663856 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c83d7d-8845-4040-9a0f-103c9d3f1ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:02.664136 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c83d7d-8845-4040-9a0f-103c9d3f1ce3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:02.678221 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c83d7d-8845-4040-9a0f-103c9d3f1ce3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:02.682310 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c83d7d-8845-4040-9a0f-103c9d3f1ce3 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:02.691451 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 304/612] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:31:02.694161 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa206e0e-1e03-4d04-b2cf-d3ff434f938a None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:02.707492 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-81c83d7d-8845-4040-9a0f-103c9d3f1ce3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:02.707492 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:02.707492 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:02.707492 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:02.707492 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:02.707492 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:02.707492 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:02.707492 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:02.707492 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:02.707492 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:02.707492 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:02.707492 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:02.707492 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:31:02.707492 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:31:02.707492 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:31:02.707492 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:31:02.708519 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:02.708519 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:02.708519 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:02.708519 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:02.708519 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:02.708519 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:02.708519 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:02.708519 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:02.708519 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:02.708519 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:02.708519 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:02.708519 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:02.708519 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:02.708519 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:02.708519 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:02.708519 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:02.708519 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:31:02.709436 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:31:02.709436 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:02.709436 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:02.709436 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 309/613] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:31:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:02.717901 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c83d7d-8845-4040-9a0f-103c9d3f1ce3 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:02.856332 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:02.863807 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c83d7d-8845-4040-9a0f-103c9d3f1ce3 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:02.914269 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6defab5c-f26b-4935-8a32-bb55fed35c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:02.914863 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defab5c-f26b-4935-8a32-bb55fed35c9a None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:02.915187 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defab5c-f26b-4935-8a32-bb55fed35c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:02.915467 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defab5c-f26b-4935-8a32-bb55fed35c9a None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:02.916139 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6defab5c-f26b-4935-8a32-bb55fed35c9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:02.916451 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6defab5c-f26b-4935-8a32-bb55fed35c9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:02.917971 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6defab5c-f26b-4935-8a32-bb55fed35c9a None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:02.932685 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 310/614] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:02.941628 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6defab5c-f26b-4935-8a32-bb55fed35c9a None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:02.979237 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa206e0e-1e03-4d04-b2cf-d3ff434f938a None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:03.022473 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd14e7-5180-4446-aea7-5eb195520751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:03.023382 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd14e7-5180-4446-aea7-5eb195520751 None admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:03.023875 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd14e7-5180-4446-aea7-5eb195520751 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:03.024366 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd14e7-5180-4446-aea7-5eb195520751 None admin] PATH_INFO: `/v3/projects/becbf57e91454d499dec313ff9eadfae/users/a5ea9916c82647f3a645f1a4258f558b/roles/aad163eaa5c8447ca5d5a7d5d861395a` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:03.042670 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd14e7-5180-4446-aea7-5eb195520751 None admin] RBAC: Authorizing `identity:create_grant(project_id=becbf57e91454d499dec313ff9eadfae, user_id=a5ea9916c82647f3a645f1a4258f558b, role_id=aad163eaa5c8447ca5d5a7d5d861395a)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:03.044176 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd14e7-5180-4446-aea7-5eb195520751 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:03.121448 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6defab5c-f26b-4935-8a32-bb55fed35c9a None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:03.125343 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:03.136493 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 305/615] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 26 07:31:02 2022] PUT /identity/v3/projects/becbf57e91454d499dec313ff9eadfae/users/a5ea9916c82647f3a645f1a4258f558b/roles/aad163eaa5c8447ca5d5a7d5d861395a => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:31:03.145085 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd14e7-5180-4446-aea7-5eb195520751 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:03.202682 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5c311-a587-4813-a058-e52ee999a154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:03.203863 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5c311-a587-4813-a058-e52ee999a154 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:03.204162 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5c311-a587-4813-a058-e52ee999a154 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:03.204411 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5c311-a587-4813-a058-e52ee999a154 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:03.226703 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c5c311-a587-4813-a058-e52ee999a154 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:03.232509 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c5c311-a587-4813-a058-e52ee999a154 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:03.257065 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-a4c5c311-a587-4813-a058-e52ee999a154 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 26 07:31:03.257065 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:03.257065 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:03.257065 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:03.257065 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:03.257065 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:03.257065 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:03.257065 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:03.257065 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:03.257065 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:03.257065 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:03.257065 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:03.257065 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 07:31:03.257065 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 07:31:03.257065 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 07:31:03.257065 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 07:31:03.258313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:03.258313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:03.258313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 07:31:03.258313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:31:03.258313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 07:31:03.258313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:31:03.258313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:03.258313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:03.258313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:03.258313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:03.258313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:03.258313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:03.258313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:03.258313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:03.258313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:03.258313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:03.258313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:03.258313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:03.259319 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:03.259319 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:03.259319 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 07:31:03.259319 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 07:31:03.259319 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 07:31:03.259319 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 07:31:03.259319 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 07:31:03.259319 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 07:31:03.259319 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 26 07:31:03.259319 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:03.260373 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 311/616] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 26 07:31:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 07:31:03.268156 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5c311-a587-4813-a058-e52ee999a154 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:03.311534 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:03.373187 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd14e7-5180-4446-aea7-5eb195520751 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:03.420866 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2dbe70-8185-4cb4-b1f9-4ed7e874b5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:03.421907 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dbe70-8185-4cb4-b1f9-4ed7e874b5b2 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:03.422633 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dbe70-8185-4cb4-b1f9-4ed7e874b5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:03.423336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dbe70-8185-4cb4-b1f9-4ed7e874b5b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:03.441285 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2dbe70-8185-4cb4-b1f9-4ed7e874b5b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:31:03.447157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-ef2dbe70-8185-4cb4-b1f9-4ed7e874b5b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 07:31:03.447157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:03.447157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:03.447157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:03.447157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:03.447157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:03.447157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:03.447157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:03.447157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:03.447157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:03.447157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:03.447157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:03.447157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:31:03.447157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:31:03.447157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:31:03.447157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:31:03.448141 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:31:03.448141 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:31:03.448141 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:31:03.448141 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:31:03.448141 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:03.448141 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:03.448141 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:03.448141 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:03.448141 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:03.448141 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:03.448141 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:03.448141 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:03.448141 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:03.448141 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:03.448141 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:03.448141 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:03.449160 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:03.449160 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:03.449160 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:03.449160 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:03.449160 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:31:03.449160 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:31:03.449160 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:31:03.449160 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:31:03.449160 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:31:03.449160 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:31:03.449160 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 07:31:03.449160 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:03.452162 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 306/617] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 26 07:31:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:03.459790 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2dbe70-8185-4cb4-b1f9-4ed7e874b5b2 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:03.489878 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5c311-a587-4813-a058-e52ee999a154 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:03.558813 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:03.563876 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec0513-cd20-44d3-9aa3-fd19aa4a717a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:03.564940 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec0513-cd20-44d3-9aa3-fd19aa4a717a None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:03.565403 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec0513-cd20-44d3-9aa3-fd19aa4a717a None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:03.565820 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec0513-cd20-44d3-9aa3-fd19aa4a717a None admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:03.566735 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cec0513-cd20-44d3-9aa3-fd19aa4a717a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:03.567211 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cec0513-cd20-44d3-9aa3-fd19aa4a717a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:03.569239 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cec0513-cd20-44d3-9aa3-fd19aa4a717a None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:03.615609 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 312/618] 10.222.0.42 () {56 vars in 1135 bytes} [Fri Aug 26 07:31:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:03.628156 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec0513-cd20-44d3-9aa3-fd19aa4a717a None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:03.632054 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2dbe70-8185-4cb4-b1f9-4ed7e874b5b2 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:03.717312 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cec860-fadd-4163-a962-559a0b5c0def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:03.718193 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cec860-fadd-4163-a962-559a0b5c0def None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:03.718621 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cec860-fadd-4163-a962-559a0b5c0def None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:03.718912 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cec860-fadd-4163-a962-559a0b5c0def None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:03.719818 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cec860-fadd-4163-a962-559a0b5c0def None admin] RBAC: Adding query filter params (name=service) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:03.726471 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cec860-fadd-4163-a962-559a0b5c0def None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:03.728099 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cec860-fadd-4163-a962-559a0b5c0def None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:03.746232 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 307/619] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 26 07:31:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:03.752003 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cec860-fadd-4163-a962-559a0b5c0def None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:03.822893 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:03.869940 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec0513-cd20-44d3-9aa3-fd19aa4a717a None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:03.930286 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f022053-e067-4932-9936-df85bd2bee6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:03.930874 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f022053-e067-4932-9936-df85bd2bee6e None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:03.931199 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f022053-e067-4932-9936-df85bd2bee6e None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:03.931477 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f022053-e067-4932-9936-df85bd2bee6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:03.949093 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f022053-e067-4932-9936-df85bd2bee6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:03.952588 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f022053-e067-4932-9936-df85bd2bee6e None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:03.985958 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cec860-fadd-4163-a962-559a0b5c0def None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:03.986824 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-1f022053-e067-4932-9936-df85bd2bee6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:03.986824 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:03.986824 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:03.986824 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:03.986824 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:03.986824 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:03.986824 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:03.986824 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:03.986824 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:03.986824 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:03.986824 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:03.986824 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:03.986824 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:31:03.986824 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:31:03.986824 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:31:03.986824 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:31:03.987897 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:03.987897 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:03.987897 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:03.987897 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:03.987897 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:03.987897 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:03.987897 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:03.987897 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:03.987897 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:03.987897 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:03.987897 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:03.987897 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:03.987897 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:03.987897 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:03.987897 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:03.987897 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:03.987897 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:31:03.988781 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:31:03.988781 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:03.988781 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:03.989540 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 313/620] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:31:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:03.991466 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27978106-1336-4fe6-89a6-c4992d799694 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:03.991764 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27978106-1336-4fe6-89a6-c4992d799694 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:03.992038 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27978106-1336-4fe6-89a6-c4992d799694 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:03.993712 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 314/621] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:31:04.001607 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f5840-2b3a-445d-b900-935d3c79af3f None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:04.002014 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f5840-2b3a-445d-b900-935d3c79af3f None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:04.002197 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f5840-2b3a-445d-b900-935d3c79af3f None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:04.004689 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 315/622] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:03 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:31:04.005488 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f5840-2b3a-445d-b900-935d3c79af3f None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:04.029286 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:04.054789 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d532fb-5c43-4189-b507-58bafae082bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:04.055465 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d532fb-5c43-4189-b507-58bafae082bd None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:04.055747 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d532fb-5c43-4189-b507-58bafae082bd None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:04.056018 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d532fb-5c43-4189-b507-58bafae082bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:04.073315 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d532fb-5c43-4189-b507-58bafae082bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:04.075191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d532fb-5c43-4189-b507-58bafae082bd None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:04.091900 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-78d532fb-5c43-4189-b507-58bafae082bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:04.091900 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:04.091900 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:04.091900 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:04.091900 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:04.091900 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:04.091900 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:04.091900 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:04.091900 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:04.091900 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:04.091900 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:04.091900 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:04.091900 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:31:04.091900 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:31:04.091900 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:31:04.091900 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:31:04.093029 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:04.093029 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:04.093029 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:04.093029 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:04.093029 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:04.093029 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:04.093029 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:04.093029 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:04.093029 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:04.093029 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:04.093029 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:04.093029 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:04.093029 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:04.093029 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:04.093029 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:04.093029 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:04.093029 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:31:04.094875 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:31:04.094875 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:04.094875 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:04.094875 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 308/623] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:31:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:04.095456 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6392f-9a5a-4d16-8b16-370a6398e61a None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:04.095887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6392f-9a5a-4d16-8b16-370a6398e61a None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:04.096200 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6392f-9a5a-4d16-8b16-370a6398e61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:04.118899 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-bff6392f-9a5a-4d16-8b16-370a6398e61a None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:04.122390 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-bff6392f-9a5a-4d16-8b16-370a6398e61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:04.149137 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f5840-2b3a-445d-b900-935d3c79af3f None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:04.179075 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:04.190002 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08671a26-8813-4f5c-8147-32f3a8c9c1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:04.190540 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08671a26-8813-4f5c-8147-32f3a8c9c1b1 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:04.190819 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08671a26-8813-4f5c-8147-32f3a8c9c1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:04.191118 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08671a26-8813-4f5c-8147-32f3a8c9c1b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:04.191771 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08671a26-8813-4f5c-8147-32f3a8c9c1b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:04.192073 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08671a26-8813-4f5c-8147-32f3a8c9c1b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:04.193704 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08671a26-8813-4f5c-8147-32f3a8c9c1b1 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:04.199775 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 309/624] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:31:04.210446 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 316/625] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:31:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:04.210618 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782faf1-ae60-4e05-a83c-0eec40ca6c3c None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:04.210618 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782faf1-ae60-4e05-a83c-0eec40ca6c3c None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:04.210618 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782faf1-ae60-4e05-a83c-0eec40ca6c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:04.210846 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08671a26-8813-4f5c-8147-32f3a8c9c1b1 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:04.240535 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-4782faf1-ae60-4e05-a83c-0eec40ca6c3c None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:04.242509 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-4782faf1-ae60-4e05-a83c-0eec40ca6c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:04.328961 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08671a26-8813-4f5c-8147-32f3a8c9c1b1 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:04.343548 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 310/626] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:31:04.345293 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782faf1-ae60-4e05-a83c-0eec40ca6c3c None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:04.402783 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05505a-7fc3-4489-b9fc-24836dcb11b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:04.404368 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05505a-7fc3-4489-b9fc-24836dcb11b4 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:04.404655 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05505a-7fc3-4489-b9fc-24836dcb11b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:04.404931 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05505a-7fc3-4489-b9fc-24836dcb11b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:04.405805 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05505a-7fc3-4489-b9fc-24836dcb11b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:04.406756 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05505a-7fc3-4489-b9fc-24836dcb11b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:04.409498 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05505a-7fc3-4489-b9fc-24836dcb11b4 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:04.415579 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:04.435509 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 317/627] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:31:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:04.444495 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05505a-7fc3-4489-b9fc-24836dcb11b4 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:04.507968 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782faf1-ae60-4e05-a83c-0eec40ca6c3c None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:04.539361 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:04.549390 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda909d-4268-4e43-a890-39831c263339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:04.550042 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda909d-4268-4e43-a890-39831c263339 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:04.554152 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda909d-4268-4e43-a890-39831c263339 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:04.554152 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda909d-4268-4e43-a890-39831c263339 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:04.558125 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda909d-4268-4e43-a890-39831c263339 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:04.559622 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda909d-4268-4e43-a890-39831c263339 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:04.572915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-7dda909d-4268-4e43-a890-39831c263339 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:31:04.572915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:04.572915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:04.572915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:04.572915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:04.572915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:04.572915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:04.572915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:04.572915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:04.572915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:04.572915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:04.572915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:04.572915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 07:31:04.572915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 07:31:04.572915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 07:31:04.573981 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 07:31:04.573981 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:04.573981 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:04.573981 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:04.573981 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:04.573981 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:04.573981 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:04.573981 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:04.573981 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:04.573981 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:04.573981 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:04.573981 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:04.573981 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:04.573981 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:04.573981 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:04.573981 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:04.573981 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:04.574873 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 07:31:04.574873 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 07:31:04.574873 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 07:31:04.574873 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 07:31:04.574873 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 07:31:04.574873 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 07:31:04.574873 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:31:04.574873 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:04.574873 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 311/628] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:31:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:04.575842 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda909d-4268-4e43-a890-39831c263339 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:04.600142 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05505a-7fc3-4489-b9fc-24836dcb11b4 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:04.638386 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d9b3a-a41e-4765-8932-ecdc45f04a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:04.639131 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d9b3a-a41e-4765-8932-ecdc45f04a7c None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:04.639466 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d9b3a-a41e-4765-8932-ecdc45f04a7c None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:04.639746 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d9b3a-a41e-4765-8932-ecdc45f04a7c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:04.648744 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d9b3a-a41e-4765-8932-ecdc45f04a7c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:04.650287 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d9b3a-a41e-4765-8932-ecdc45f04a7c None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:04.663160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-fd8d9b3a-a41e-4765-8932-ecdc45f04a7c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 07:31:04.663160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:04.663160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:04.663160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:04.663160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:04.663160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:04.663160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:04.663160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:04.663160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:04.663160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:04.663160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:04.663160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:04.663160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 07:31:04.663160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 07:31:04.663160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 07:31:04.663160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 07:31:04.670202 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:04.670202 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:04.670202 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 07:31:04.670202 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:31:04.670202 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 07:31:04.670202 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:31:04.670202 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:04.670202 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:04.670202 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:04.670202 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:04.670202 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:04.670202 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:04.670202 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:04.670202 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:04.670202 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:04.670202 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:04.670202 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:04.670202 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:04.671295 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:04.671295 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:04.671295 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 07:31:04.671295 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 07:31:04.671295 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 07:31:04.671295 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 07:31:04.671295 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 07:31:04.671295 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 07:31:04.671295 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 07:31:04.671295 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:04.671295 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 318/629] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Aug 26 07:31:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:04.671295 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d9b3a-a41e-4765-8932-ecdc45f04a7c None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:04.688962 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:04.699969 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda909d-4268-4e43-a890-39831c263339 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:04.744115 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e64b9e-43ad-47c9-a4a2-18229a332ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:04.745099 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e64b9e-43ad-47c9-a4a2-18229a332ab4 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:04.745558 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e64b9e-43ad-47c9-a4a2-18229a332ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:04.746013 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e64b9e-43ad-47c9-a4a2-18229a332ab4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:04.758651 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e64b9e-43ad-47c9-a4a2-18229a332ab4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:31:04.767814 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-42e64b9e-43ad-47c9-a4a2-18229a332ab4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 07:31:04.767814 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:04.767814 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:04.767814 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:04.767814 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:04.767814 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:04.767814 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:04.767814 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:04.767814 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:04.767814 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:04.767814 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:04.767814 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:04.767814 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:31:04.767814 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:31:04.767814 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:31:04.767814 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:31:04.768751 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:31:04.768751 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:31:04.768751 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:31:04.768751 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:31:04.768751 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:04.768751 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:04.768751 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:04.768751 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:04.768751 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:04.768751 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:04.768751 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:04.768751 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:04.768751 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:04.768751 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:04.768751 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:04.768751 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:04.769607 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:04.769607 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:04.769607 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:04.769607 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:04.769607 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:31:04.769607 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:31:04.769607 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:31:04.769607 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:31:04.769607 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:31:04.769607 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:31:04.769607 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 07:31:04.769607 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:04.769607 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 312/630] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 26 07:31:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:04.770294 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e64b9e-43ad-47c9-a4a2-18229a332ab4 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:04.793657 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d9b3a-a41e-4765-8932-ecdc45f04a7c None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:04.801006 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:04.830474 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ac57f-9e15-4597-ae28-6120fa7b68e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:04.831512 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ac57f-9e15-4597-ae28-6120fa7b68e2 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:04.832178 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ac57f-9e15-4597-ae28-6120fa7b68e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:04.832522 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ac57f-9e15-4597-ae28-6120fa7b68e2 None admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:04.833784 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479ac57f-9e15-4597-ae28-6120fa7b68e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:04.834782 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479ac57f-9e15-4597-ae28-6120fa7b68e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:04.836262 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479ac57f-9e15-4597-ae28-6120fa7b68e2 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:04.858565 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 319/631] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 26 07:31:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:04.858565 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ac57f-9e15-4597-ae28-6120fa7b68e2 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:04.887926 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e64b9e-43ad-47c9-a4a2-18229a332ab4 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:04.929513 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78d2ea-ceb0-4f48-a1b2-f3ad51c33ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:04.930252 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78d2ea-ceb0-4f48-a1b2-f3ad51c33ea1 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:04.930528 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78d2ea-ceb0-4f48-a1b2-f3ad51c33ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:04.930795 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78d2ea-ceb0-4f48-a1b2-f3ad51c33ea1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:04.943496 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a78d2ea-ceb0-4f48-a1b2-f3ad51c33ea1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:31:04.949857 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-4a78d2ea-ceb0-4f48-a1b2-f3ad51c33ea1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 07:31:04.949857 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:04.949857 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:04.949857 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:04.949857 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:04.949857 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:04.949857 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:04.949857 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:04.949857 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:04.949857 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:04.949857 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:04.949857 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:04.949857 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:31:04.949857 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:31:04.949857 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:31:04.949857 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:31:04.952333 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:31:04.952333 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:31:04.952333 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:31:04.952333 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:31:04.952333 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:04.952333 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:04.952333 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:04.952333 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:04.952333 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:04.952333 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:04.952333 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:04.952333 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:04.952333 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:04.952333 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:04.952333 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:04.952333 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:04.955805 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:04.955805 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:04.955805 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:04.955805 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:04.955805 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:31:04.955805 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:31:04.955805 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:31:04.955805 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:31:04.955805 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:31:04.955805 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:31:04.955805 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 07:31:04.955805 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:04.955805 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 313/632] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 26 07:31:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:04.955805 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78d2ea-ceb0-4f48-a1b2-f3ad51c33ea1 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:04.973599 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:04.980075 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ac57f-9e15-4597-ae28-6120fa7b68e2 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:05.024529 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68faf82c-c2ee-4910-9d44-ec9dc88d14f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:05.025260 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68faf82c-c2ee-4910-9d44-ec9dc88d14f3 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:05.025535 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68faf82c-c2ee-4910-9d44-ec9dc88d14f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:05.025801 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68faf82c-c2ee-4910-9d44-ec9dc88d14f3 None admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:05.026540 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68faf82c-c2ee-4910-9d44-ec9dc88d14f3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:05.026841 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68faf82c-c2ee-4910-9d44-ec9dc88d14f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:05.028552 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68faf82c-c2ee-4910-9d44-ec9dc88d14f3 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:05.047493 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 320/633] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Aug 26 07:31:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:05.048088 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68faf82c-c2ee-4910-9d44-ec9dc88d14f3 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:05.078015 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:05.097900 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78d2ea-ceb0-4f48-a1b2-f3ad51c33ea1 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:05.139622 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a454b91-2515-4d4b-acf2-1d31908712b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:05.140586 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a454b91-2515-4d4b-acf2-1d31908712b1 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:05.141860 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a454b91-2515-4d4b-acf2-1d31908712b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:05.141860 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a454b91-2515-4d4b-acf2-1d31908712b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:05.142577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a454b91-2515-4d4b-acf2-1d31908712b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:05.143094 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a454b91-2515-4d4b-acf2-1d31908712b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:05.145595 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a454b91-2515-4d4b-acf2-1d31908712b1 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:05.157767 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 314/634] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 26 07:31:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:05.158589 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a454b91-2515-4d4b-acf2-1d31908712b1 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:05.179557 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68faf82c-c2ee-4910-9d44-ec9dc88d14f3 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:05.220411 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48814a-9918-422a-b5af-ef82966c919d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:05.221013 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48814a-9918-422a-b5af-ef82966c919d None admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:05.221281 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48814a-9918-422a-b5af-ef82966c919d None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:05.221553 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48814a-9918-422a-b5af-ef82966c919d None admin] PATH_INFO: `/v3/projects/becbf57e91454d499dec313ff9eadfae/users/3142255c263e44a189db82c621f87e7d/roles/aad163eaa5c8447ca5d5a7d5d861395a` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:05.237792 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d48814a-9918-422a-b5af-ef82966c919d None admin] RBAC: Authorizing `identity:create_grant(project_id=becbf57e91454d499dec313ff9eadfae, user_id=3142255c263e44a189db82c621f87e7d, role_id=aad163eaa5c8447ca5d5a7d5d861395a)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:05.239291 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d48814a-9918-422a-b5af-ef82966c919d None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:05.254286 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:05.277137 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a454b91-2515-4d4b-acf2-1d31908712b1 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:05.311893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8316d94-742d-420e-af95-6ff69efbe81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:05.313078 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8316d94-742d-420e-af95-6ff69efbe81c None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:05.313374 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8316d94-742d-420e-af95-6ff69efbe81c None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:05.313658 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8316d94-742d-420e-af95-6ff69efbe81c None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:05.314398 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8316d94-742d-420e-af95-6ff69efbe81c None admin] RBAC: Adding query filter params (name=service) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:05.314709 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8316d94-742d-420e-af95-6ff69efbe81c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:05.316124 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8316d94-742d-420e-af95-6ff69efbe81c None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:05.320892 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 321/635] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 26 07:31:05 2022] PUT /identity/v3/projects/becbf57e91454d499dec313ff9eadfae/users/3142255c263e44a189db82c621f87e7d/roles/aad163eaa5c8447ca5d5a7d5d861395a => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:31:05.321994 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48814a-9918-422a-b5af-ef82966c919d None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:05.344618 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 315/636] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 26 07:31:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:05.344618 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8316d94-742d-420e-af95-6ff69efbe81c None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:05.442386 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:05.475436 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48814a-9918-422a-b5af-ef82966c919d None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:05.513340 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8316d94-742d-420e-af95-6ff69efbe81c None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:05.522528 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c21ad-dbad-4050-96e4-29d81d93b61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:05.523257 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c21ad-dbad-4050-96e4-29d81d93b61e None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:05.523688 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c21ad-dbad-4050-96e4-29d81d93b61e None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:05.523914 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c21ad-dbad-4050-96e4-29d81d93b61e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:05.557099 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98025d0d-1a5d-426f-82fc-9fc98e399208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:05.557742 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98025d0d-1a5d-426f-82fc-9fc98e399208 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:05.558020 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98025d0d-1a5d-426f-82fc-9fc98e399208 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:05.558289 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98025d0d-1a5d-426f-82fc-9fc98e399208 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:05.566648 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:05.572275 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98025d0d-1a5d-426f-82fc-9fc98e399208 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:05.573912 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98025d0d-1a5d-426f-82fc-9fc98e399208 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:05.591391 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-98025d0d-1a5d-426f-82fc-9fc98e399208 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:05.591391 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:05.591391 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:05.591391 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:05.591391 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:05.591391 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:05.591391 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:05.591391 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:05.591391 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:05.591391 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:05.591391 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:05.591391 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:05.591391 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:31:05.591391 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:31:05.591391 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:31:05.591391 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:31:05.592442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:05.592442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:05.592442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:05.592442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:05.592442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:05.592442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:05.592442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:05.592442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:05.592442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:05.592442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:05.592442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:05.592442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:05.592442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:05.592442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:05.592442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:05.592442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:05.592442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:31:05.594596 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:31:05.594596 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:05.594596 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:05.594596 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 316/637] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:31:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:05.594596 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98025d0d-1a5d-426f-82fc-9fc98e399208 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:05.627366 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c21ad-dbad-4050-96e4-29d81d93b61e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:05.628823 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c21ad-dbad-4050-96e4-29d81d93b61e None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:05.724704 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98025d0d-1a5d-426f-82fc-9fc98e399208 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:05.729664 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:05.770738 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 322/638] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:31:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 07:31:05.771706 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad36f5-5e92-414a-b7c8-2da6dbac5810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:05.772559 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad36f5-5e92-414a-b7c8-2da6dbac5810 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:05.773031 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad36f5-5e92-414a-b7c8-2da6dbac5810 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:05.773479 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad36f5-5e92-414a-b7c8-2da6dbac5810 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:05.773983 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835825d-dfc8-42ba-b0cb-fb3f5d4f0ffc None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:05.774537 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835825d-dfc8-42ba-b0cb-fb3f5d4f0ffc None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:05.775206 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835825d-dfc8-42ba-b0cb-fb3f5d4f0ffc None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:05.783351 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 323/639] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:05 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:31:05.784275 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3835825d-dfc8-42ba-b0cb-fb3f5d4f0ffc None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:05.789539 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad36f5-5e92-414a-b7c8-2da6dbac5810 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:05.791911 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad36f5-5e92-414a-b7c8-2da6dbac5810 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:05.813274 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-28ad36f5-5e92-414a-b7c8-2da6dbac5810 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:05.813274 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:05.813274 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:05.813274 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:05.813274 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:05.813274 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:05.813274 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:05.813274 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:05.813274 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:05.813274 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:05.813274 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:05.813274 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:05.813274 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:31:05.813274 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:31:05.813274 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:31:05.813274 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:31:05.814304 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:05.814304 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:05.814304 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:05.814304 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:05.814304 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:05.814304 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:05.814304 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:05.814304 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:05.814304 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:05.814304 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:05.814304 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:05.814304 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:05.814304 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:05.814304 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:05.814304 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:05.814304 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:05.814304 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:31:05.815215 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:31:05.815215 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:05.815215 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:05.816062 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 317/640] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:31:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:05.817066 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad36f5-5e92-414a-b7c8-2da6dbac5810 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:05.871110 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:05.922464 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3835825d-dfc8-42ba-b0cb-fb3f5d4f0ffc None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:05.938205 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad36f5-5e92-414a-b7c8-2da6dbac5810 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:05.961621 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e21d4e4-265f-43a9-ad77-6d8c39666ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:05.962628 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21d4e4-265f-43a9-ad77-6d8c39666ccc None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:05.963161 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21d4e4-265f-43a9-ad77-6d8c39666ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:05.964086 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21d4e4-265f-43a9-ad77-6d8c39666ccc None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:05.964938 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e21d4e4-265f-43a9-ad77-6d8c39666ccc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:05.965439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e21d4e4-265f-43a9-ad77-6d8c39666ccc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:05.967314 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e21d4e4-265f-43a9-ad77-6d8c39666ccc None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:05.978958 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58368b-63d5-4352-8c62-d8e8cf449342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:05.979621 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58368b-63d5-4352-8c62-d8e8cf449342 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:05.979957 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58368b-63d5-4352-8c62-d8e8cf449342 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:05.980167 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58368b-63d5-4352-8c62-d8e8cf449342 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:05.983309 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 324/641] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:31:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:05.986105 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f4da9-0f19-4459-9f4e-4f453287a002 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:05.986605 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f4da9-0f19-4459-9f4e-4f453287a002 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:05.987097 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f4da9-0f19-4459-9f4e-4f453287a002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:05.992824 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58368b-63d5-4352-8c62-d8e8cf449342 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:05.994280 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58368b-63d5-4352-8c62-d8e8cf449342 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:06.011075 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-746f4da9-0f19-4459-9f4e-4f453287a002 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:06.012635 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-746f4da9-0f19-4459-9f4e-4f453287a002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:06.014593 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-fc58368b-63d5-4352-8c62-d8e8cf449342 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:06.014593 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:06.014593 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:06.014593 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:06.014593 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:06.014593 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:06.014593 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:06.014593 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:06.014593 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:06.014593 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:06.014593 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:06.014593 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:06.014593 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:31:06.014593 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:31:06.014593 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:31:06.014593 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:31:06.016026 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:06.016026 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:06.016026 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:06.016026 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:06.016026 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:06.016026 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:06.016026 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:06.016026 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:06.016026 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:06.016026 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:06.016026 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:06.016026 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:06.016026 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:06.016026 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:06.016026 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:06.016026 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:06.016026 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:31:06.017082 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:31:06.017082 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:06.017082 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:06.017082 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 318/642] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:31:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:06.017082 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58368b-63d5-4352-8c62-d8e8cf449342 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:06.053195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:06.111701 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 325/643] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:31:06.113095 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f4da9-0f19-4459-9f4e-4f453287a002 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:06.155477 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:06.166973 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58368b-63d5-4352-8c62-d8e8cf449342 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:06.229463 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b06007e-81dd-4775-b49e-4d0377b0e5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:06.230295 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06007e-81dd-4775-b49e-4d0377b0e5ce None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:06.230907 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06007e-81dd-4775-b49e-4d0377b0e5ce None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:06.231119 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06007e-81dd-4775-b49e-4d0377b0e5ce None admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:06.231877 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b06007e-81dd-4775-b49e-4d0377b0e5ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:06.232339 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b06007e-81dd-4775-b49e-4d0377b0e5ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:06.233767 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b06007e-81dd-4775-b49e-4d0377b0e5ce None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:06.251021 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 319/644] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:06.251021 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b06007e-81dd-4775-b49e-4d0377b0e5ce None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:06.261261 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f4da9-0f19-4459-9f4e-4f453287a002 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:06.320080 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a9a17-72d1-452d-94b7-886431b5ba08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:06.321155 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a9a17-72d1-452d-94b7-886431b5ba08 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:06.321904 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a9a17-72d1-452d-94b7-886431b5ba08 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:06.322287 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a9a17-72d1-452d-94b7-886431b5ba08 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:06.332540 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a9a17-72d1-452d-94b7-886431b5ba08 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:06.334397 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a9a17-72d1-452d-94b7-886431b5ba08 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:06.348080 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-751a9a17-72d1-452d-94b7-886431b5ba08 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 26 07:31:06.348080 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:06.348080 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:06.348080 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:06.348080 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:06.348080 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:06.348080 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:06.348080 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:06.348080 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:06.348080 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:06.348080 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:06.348080 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:06.348080 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 07:31:06.348080 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 07:31:06.348080 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 07:31:06.348080 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 07:31:06.349277 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:06.349277 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:06.349277 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 07:31:06.349277 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:31:06.349277 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 07:31:06.349277 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:31:06.349277 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:06.349277 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:06.349277 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:06.349277 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:06.349277 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:06.349277 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:06.349277 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:06.349277 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:06.349277 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:06.349277 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:06.349277 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:06.349277 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:06.350577 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:06.350577 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:06.350577 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 07:31:06.350577 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 07:31:06.350577 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 07:31:06.350577 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 07:31:06.350577 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 07:31:06.350577 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 07:31:06.350577 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 26 07:31:06.350577 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:06.352541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 326/645] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:31:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:06.353631 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a9a17-72d1-452d-94b7-886431b5ba08 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:06.384780 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:06.412632 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b06007e-81dd-4775-b49e-4d0377b0e5ce None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:06.460484 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ca067-1aba-40d2-945e-8a990d5fa8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:06.461381 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ca067-1aba-40d2-945e-8a990d5fa8f7 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:06.461802 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ca067-1aba-40d2-945e-8a990d5fa8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:06.462247 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ca067-1aba-40d2-945e-8a990d5fa8f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:06.462895 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ca067-1aba-40d2-945e-8a990d5fa8f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:06.463225 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ca067-1aba-40d2-945e-8a990d5fa8f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:06.464728 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ca067-1aba-40d2-945e-8a990d5fa8f7 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:06.481846 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 320/646] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:06.481846 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ca067-1aba-40d2-945e-8a990d5fa8f7 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:06.482121 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a9a17-72d1-452d-94b7-886431b5ba08 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:06.498065 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:06.525834 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9d3d2-c8a4-4ac5-8374-5d7a9fd0b15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:06.526654 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9d3d2-c8a4-4ac5-8374-5d7a9fd0b15d None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:06.527079 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9d3d2-c8a4-4ac5-8374-5d7a9fd0b15d None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:06.527448 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9d3d2-c8a4-4ac5-8374-5d7a9fd0b15d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:06.537168 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c9d3d2-c8a4-4ac5-8374-5d7a9fd0b15d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:06.538767 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c9d3d2-c8a4-4ac5-8374-5d7a9fd0b15d None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:06.552204 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-b6c9d3d2-c8a4-4ac5-8374-5d7a9fd0b15d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 07:31:06.552204 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:06.552204 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:06.552204 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:06.552204 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:06.552204 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:06.552204 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:06.552204 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:06.552204 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:06.552204 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:06.552204 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:06.552204 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:06.552204 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 07:31:06.552204 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 07:31:06.552204 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 07:31:06.552204 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 07:31:06.553706 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:06.553706 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:06.553706 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 07:31:06.553706 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:31:06.553706 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 07:31:06.553706 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:31:06.553706 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:06.553706 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:06.553706 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:06.553706 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:06.553706 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:06.553706 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:06.553706 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:06.553706 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:06.553706 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:06.553706 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:06.553706 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:06.553706 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:06.555006 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:06.555006 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:06.555006 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 07:31:06.555006 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 07:31:06.555006 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 07:31:06.555006 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 07:31:06.555006 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 07:31:06.555006 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 07:31:06.555006 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 07:31:06.555006 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:06.555006 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 327/647] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:31:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:06.555669 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9d3d2-c8a4-4ac5-8374-5d7a9fd0b15d None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:06.625355 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ca067-1aba-40d2-945e-8a990d5fa8f7 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:06.664141 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:06.673870 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480b12f-9e2c-4a2e-98ca-0bc97efc6305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:06.674499 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480b12f-9e2c-4a2e-98ca-0bc97efc6305 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:06.677674 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480b12f-9e2c-4a2e-98ca-0bc97efc6305 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:06.677674 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480b12f-9e2c-4a2e-98ca-0bc97efc6305 None admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:06.677674 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0480b12f-9e2c-4a2e-98ca-0bc97efc6305 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:06.677674 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0480b12f-9e2c-4a2e-98ca-0bc97efc6305 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:06.678159 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0480b12f-9e2c-4a2e-98ca-0bc97efc6305 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:06.682837 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9d3d2-c8a4-4ac5-8374-5d7a9fd0b15d None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:06.697729 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 321/648] 10.222.0.42 () {56 vars in 1137 bytes} [Fri Aug 26 07:31:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:06.698577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480b12f-9e2c-4a2e-98ca-0bc97efc6305 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:06.730569 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f2002-285a-499e-a840-8e2e9972ff5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:06.731274 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f2002-285a-499e-a840-8e2e9972ff5e None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:06.731574 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f2002-285a-499e-a840-8e2e9972ff5e None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:06.731830 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f2002-285a-499e-a840-8e2e9972ff5e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:06.748177 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f2002-285a-499e-a840-8e2e9972ff5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:31:06.754658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-5d6f2002-285a-499e-a840-8e2e9972ff5e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 07:31:06.754658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:06.754658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:06.754658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:06.754658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:06.754658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:06.754658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:06.754658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:06.754658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:06.754658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:06.754658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:06.754658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:06.754658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:31:06.754658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:31:06.754658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:31:06.754658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:31:06.755803 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:31:06.755803 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:31:06.755803 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:31:06.755803 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:31:06.755803 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:06.755803 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:06.755803 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:06.755803 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:06.755803 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:06.755803 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:06.755803 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:06.755803 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:06.755803 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:06.755803 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:06.755803 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:06.755803 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:06.756658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:06.756658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:06.756658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:06.756658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:06.756658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:31:06.756658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:31:06.756658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:31:06.756658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:31:06.756658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:31:06.756658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:31:06.756658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 07:31:06.756658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:06.756658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 328/649] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 26 07:31:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:06.757349 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f2002-285a-499e-a840-8e2e9972ff5e None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:06.789291 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:06.820558 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480b12f-9e2c-4a2e-98ca-0bc97efc6305 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:06.860711 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8302871-bcaf-455e-bc04-c1ac7c3b1f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:06.861347 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8302871-bcaf-455e-bc04-c1ac7c3b1f48 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:06.861625 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8302871-bcaf-455e-bc04-c1ac7c3b1f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:06.861902 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8302871-bcaf-455e-bc04-c1ac7c3b1f48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:06.868771 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8302871-bcaf-455e-bc04-c1ac7c3b1f48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:06.870208 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8302871-bcaf-455e-bc04-c1ac7c3b1f48 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:06.886551 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-a8302871-bcaf-455e-bc04-c1ac7c3b1f48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:31:06.886551 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:06.886551 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:06.886551 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:06.886551 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:06.886551 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:06.886551 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:06.886551 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:06.886551 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:06.886551 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:06.886551 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:06.886551 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:06.886551 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 07:31:06.886551 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 07:31:06.886551 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 07:31:06.887696 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 07:31:06.887696 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:06.887696 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:06.887696 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:06.887696 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:06.887696 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:06.887696 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:06.887696 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:06.887696 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:06.887696 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:06.887696 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:06.887696 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:06.887696 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:06.887696 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:06.887696 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:06.887696 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:06.887696 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:06.888804 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 07:31:06.888804 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 07:31:06.888804 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 07:31:06.888804 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 07:31:06.888804 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 07:31:06.888804 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 07:31:06.888804 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:31:06.888804 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:06.892281 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f2002-285a-499e-a840-8e2e9972ff5e None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:06.893750 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 322/650] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:31:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:06.894672 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8302871-bcaf-455e-bc04-c1ac7c3b1f48 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:06.932922 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902def1-aa6b-4949-baad-c9f62a1f7a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:06.933530 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902def1-aa6b-4949-baad-c9f62a1f7a93 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:06.933806 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902def1-aa6b-4949-baad-c9f62a1f7a93 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:06.934064 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902def1-aa6b-4949-baad-c9f62a1f7a93 None admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:06.934801 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4902def1-aa6b-4949-baad-c9f62a1f7a93 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:06.935142 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4902def1-aa6b-4949-baad-c9f62a1f7a93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:06.937727 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4902def1-aa6b-4949-baad-c9f62a1f7a93 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:06.965284 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 329/651] 10.222.0.42 () {56 vars in 1137 bytes} [Fri Aug 26 07:31:06 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:06.965284 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902def1-aa6b-4949-baad-c9f62a1f7a93 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:06.971370 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:07.025642 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8302871-bcaf-455e-bc04-c1ac7c3b1f48 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:07.066639 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:07.073819 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50083de-235a-44cf-ae09-8d701eabe2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:07.074832 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50083de-235a-44cf-ae09-8d701eabe2cf None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:07.075142 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50083de-235a-44cf-ae09-8d701eabe2cf None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:07.077926 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50083de-235a-44cf-ae09-8d701eabe2cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:07.080170 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902def1-aa6b-4949-baad-c9f62a1f7a93 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:07.126862 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e85f5-6af4-4647-bfab-c65ac96dab79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:07.127535 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e85f5-6af4-4647-bfab-c65ac96dab79 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:07.127820 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e85f5-6af4-4647-bfab-c65ac96dab79 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:07.128099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e85f5-6af4-4647-bfab-c65ac96dab79 None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:07.128786 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e85f5-6af4-4647-bfab-c65ac96dab79 None admin] RBAC: Adding query filter params (name=service) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:07.129297 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e85f5-6af4-4647-bfab-c65ac96dab79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:07.130644 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e85f5-6af4-4647-bfab-c65ac96dab79 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:07.151484 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 330/652] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 26 07:31:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:07.151484 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e85f5-6af4-4647-bfab-c65ac96dab79 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:07.185293 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50083de-235a-44cf-ae09-8d701eabe2cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:07.186923 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50083de-235a-44cf-ae09-8d701eabe2cf None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:07.231357 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:07.291262 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e85f5-6af4-4647-bfab-c65ac96dab79 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:07.321935 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 323/653] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:31:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 07:31:07.323058 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50083de-235a-44cf-ae09-8d701eabe2cf None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:07.334021 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46237445-f0e6-4476-b712-cf9bec538359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:07.334644 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46237445-f0e6-4476-b712-cf9bec538359 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:07.334925 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46237445-f0e6-4476-b712-cf9bec538359 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:07.335228 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46237445-f0e6-4476-b712-cf9bec538359 None admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:07.335936 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46237445-f0e6-4476-b712-cf9bec538359 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:07.336248 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46237445-f0e6-4476-b712-cf9bec538359 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:07.337716 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46237445-f0e6-4476-b712-cf9bec538359 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:07.351804 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 331/654] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 26 07:31:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:07.352675 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46237445-f0e6-4476-b712-cf9bec538359 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:07.368795 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:07.448966 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50083de-235a-44cf-ae09-8d701eabe2cf None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:07.466599 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46237445-f0e6-4476-b712-cf9bec538359 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:07.494006 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa38df7-836f-4b88-8e85-a1b24a2b1be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:07.494656 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:07.494813 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa38df7-836f-4b88-8e85-a1b24a2b1be8 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:07.495104 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa38df7-836f-4b88-8e85-a1b24a2b1be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:07.495444 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa38df7-836f-4b88-8e85-a1b24a2b1be8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:07.509620 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f592eea2-d46f-4823-a878-9218afc9a5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:07.510424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592eea2-d46f-4823-a878-9218afc9a5cb None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:07.510712 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592eea2-d46f-4823-a878-9218afc9a5cb None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:07.511065 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592eea2-d46f-4823-a878-9218afc9a5cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:07.529171 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f592eea2-d46f-4823-a878-9218afc9a5cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:07.529171 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f592eea2-d46f-4823-a878-9218afc9a5cb None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:07.540747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-f592eea2-d46f-4823-a878-9218afc9a5cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:07.540747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:07.540747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:07.540747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:07.540747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:07.540747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:07.540747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:07.540747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:07.540747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:07.540747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:07.540747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:07.540747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:07.540747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:31:07.540747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:31:07.540747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:31:07.540747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:31:07.542004 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:07.542004 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:07.542004 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:07.542004 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:07.542004 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:07.542004 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:07.542004 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:07.542004 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:07.542004 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:07.542004 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:07.542004 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:07.542004 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:07.542004 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:07.542004 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:07.542004 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:07.542004 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:07.542004 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:31:07.542930 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:31:07.542930 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:07.542930 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:07.542930 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 332/655] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:31:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:07.543329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f592eea2-d46f-4823-a878-9218afc9a5cb None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:07.597030 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa38df7-836f-4b88-8e85-a1b24a2b1be8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:07.598502 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa38df7-836f-4b88-8e85-a1b24a2b1be8 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:07.638696 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:07.666036 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f592eea2-d46f-4823-a878-9218afc9a5cb None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:07.710806 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c155a-bd69-4b32-bbe8-156942272af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:07.711474 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c155a-bd69-4b32-bbe8-156942272af0 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:07.711751 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c155a-bd69-4b32-bbe8-156942272af0 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:07.712022 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c155a-bd69-4b32-bbe8-156942272af0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:07.725215 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c155a-bd69-4b32-bbe8-156942272af0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:07.726682 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c155a-bd69-4b32-bbe8-156942272af0 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:07.731852 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 324/656] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:31:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 07:31:07.732777 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa38df7-836f-4b88-8e85-a1b24a2b1be8 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:07.747059 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-140c155a-bd69-4b32-bbe8-156942272af0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:07.747059 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:07.747059 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:07.747059 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:07.747059 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:07.747059 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:07.747059 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:07.747059 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:07.747059 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:07.747059 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:07.747059 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:07.747059 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:07.747059 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:31:07.747059 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:31:07.747059 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:31:07.747059 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:31:07.748127 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:07.748127 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:07.748127 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:07.748127 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:07.748127 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:07.748127 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:07.748127 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:07.748127 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:07.748127 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:07.748127 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:07.748127 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:07.748127 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:07.748127 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:07.748127 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:07.748127 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:07.748127 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:07.748127 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:31:07.749437 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:31:07.749437 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:07.749437 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:07.749437 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 333/657] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:31:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:07.756134 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b2cb7-d452-4460-aa20-1e787b499d34 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:07.756412 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b2cb7-d452-4460-aa20-1e787b499d34 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:07.756690 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b2cb7-d452-4460-aa20-1e787b499d34 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:07.758165 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 334/658] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:07 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:31:07.758812 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b2cb7-d452-4460-aa20-1e787b499d34 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:07.798638 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:07.847788 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa38df7-836f-4b88-8e85-a1b24a2b1be8 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:07.874421 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b2cb7-d452-4460-aa20-1e787b499d34 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:07.888603 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:07.893795 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d41dd8-490b-4518-8bc3-0c99cd0d4768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:07.894404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d41dd8-490b-4518-8bc3-0c99cd0d4768 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:07.894679 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d41dd8-490b-4518-8bc3-0c99cd0d4768 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:07.894952 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d41dd8-490b-4518-8bc3-0c99cd0d4768 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:07.895707 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d41dd8-490b-4518-8bc3-0c99cd0d4768 None admin] RBAC: Adding query filter params (role.id=aad163eaa5c8447ca5d5a7d5d861395a, scope.project.id=becbf57e91454d499dec313ff9eadfae, user.id=bc92c0a0a2cc4722868e6877bac93ada) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:07.896010 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d41dd8-490b-4518-8bc3-0c99cd0d4768 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:07.897451 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d41dd8-490b-4518-8bc3-0c99cd0d4768 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:07.903415 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 325/659] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:31:07 2022] GET /identity/v3/role_assignments?user.id=bc92c0a0a2cc4722868e6877bac93ada&scope.project.id=becbf57e91454d499dec313ff9eadfae&role.id=aad163eaa5c8447ca5d5a7d5d861395a => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:07.904220 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d41dd8-490b-4518-8bc3-0c99cd0d4768 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:07.915505 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404477a-012f-4186-ac95-0e862021ca2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:07.916145 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404477a-012f-4186-ac95-0e862021ca2d None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:07.916423 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404477a-012f-4186-ac95-0e862021ca2d None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:07.916696 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404477a-012f-4186-ac95-0e862021ca2d None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:07.917377 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404477a-012f-4186-ac95-0e862021ca2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:07.917680 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404477a-012f-4186-ac95-0e862021ca2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:07.919147 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404477a-012f-4186-ac95-0e862021ca2d None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:07.933645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 335/660] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:07.934487 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404477a-012f-4186-ac95-0e862021ca2d None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:08.045208 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:08.053798 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d41dd8-490b-4518-8bc3-0c99cd0d4768 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:08.058842 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404477a-012f-4186-ac95-0e862021ca2d None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:08.108129 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd330d-3bb3-4e4d-a1c1-25525d809f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:08.108806 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd330d-3bb3-4e4d-a1c1-25525d809f40 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:08.109076 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd330d-3bb3-4e4d-a1c1-25525d809f40 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:08.109452 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd330d-3bb3-4e4d-a1c1-25525d809f40 None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:08.110196 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcd330d-3bb3-4e4d-a1c1-25525d809f40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:08.110501 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcd330d-3bb3-4e4d-a1c1-25525d809f40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:08.112154 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcd330d-3bb3-4e4d-a1c1-25525d809f40 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:08.115567 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a297e-3f28-42fb-82af-f2646e3e0e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:08.116231 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a297e-3f28-42fb-82af-f2646e3e0e92 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:08.116514 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a297e-3f28-42fb-82af-f2646e3e0e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:08.116782 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a297e-3f28-42fb-82af-f2646e3e0e92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:08.129574 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7a297e-3f28-42fb-82af-f2646e3e0e92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:08.129771 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 336/661] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:08.133715 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506fa3a-1373-4083-9c6b-c83c246e60c2 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:08.133715 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506fa3a-1373-4083-9c6b-c83c246e60c2 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:08.133715 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506fa3a-1373-4083-9c6b-c83c246e60c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:08.134088 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7a297e-3f28-42fb-82af-f2646e3e0e92 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:08.154397 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-fd7a297e-3f28-42fb-82af-f2646e3e0e92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:08.154397 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:08.154397 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:08.154397 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:08.154397 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:08.154397 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:08.154397 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:08.154397 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:08.154397 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:08.154397 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:08.154397 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:08.154397 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:08.154397 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:31:08.154397 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:31:08.154397 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:31:08.154397 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:31:08.155480 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:08.155480 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:08.155480 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:08.155480 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:08.155480 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:08.155480 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:08.155480 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:08.155480 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:08.155480 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:08.155480 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:08.155480 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:08.155480 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:08.155480 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:08.155480 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:08.155480 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:08.155480 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:08.155480 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:31:08.156409 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:31:08.156409 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:08.156409 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:08.156409 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 326/662] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:31:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:08.156409 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a297e-3f28-42fb-82af-f2646e3e0e92 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:08.159462 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-b506fa3a-1373-4083-9c6b-c83c246e60c2 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:08.160737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-b506fa3a-1373-4083-9c6b-c83c246e60c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:08.220232 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:08.258639 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 337/663] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:31:08.259690 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506fa3a-1373-4083-9c6b-c83c246e60c2 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:08.304571 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a297e-3f28-42fb-82af-f2646e3e0e92 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:08.351221 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b21c6-38a9-4aff-acc7-cf2a0871cf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:08.352778 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b21c6-38a9-4aff-acc7-cf2a0871cf8a None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:08.353558 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b21c6-38a9-4aff-acc7-cf2a0871cf8a None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:08.354049 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b21c6-38a9-4aff-acc7-cf2a0871cf8a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:08.365799 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b21c6-38a9-4aff-acc7-cf2a0871cf8a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:08.368306 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b21c6-38a9-4aff-acc7-cf2a0871cf8a None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:08.375106 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:08.391577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-5d5b21c6-38a9-4aff-acc7-cf2a0871cf8a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 07:31:08.391577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:08.391577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:08.391577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:08.391577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:08.391577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:08.391577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:08.391577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:08.391577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:08.391577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:08.391577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:08.391577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:08.391577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 07:31:08.391577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 07:31:08.391577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 07:31:08.391577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 07:31:08.392957 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:08.392957 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:08.392957 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 07:31:08.392957 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:31:08.392957 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 07:31:08.392957 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:31:08.392957 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:08.392957 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:08.392957 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:08.392957 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:08.392957 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:08.392957 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:08.392957 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:08.392957 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:08.392957 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:08.392957 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:08.392957 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:08.392957 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:08.393905 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:08.393905 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:08.393905 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 07:31:08.393905 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 07:31:08.393905 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 07:31:08.393905 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 07:31:08.393905 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 07:31:08.393905 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 07:31:08.393905 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 07:31:08.393905 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:08.398442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 327/664] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 26 07:31:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:08.399047 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b21c6-38a9-4aff-acc7-cf2a0871cf8a None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:08.411169 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506fa3a-1373-4083-9c6b-c83c246e60c2 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:08.459357 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0099022-422e-4423-97e6-3165338f003d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:08.460069 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0099022-422e-4423-97e6-3165338f003d None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:08.460348 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0099022-422e-4423-97e6-3165338f003d None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:08.460619 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0099022-422e-4423-97e6-3165338f003d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:08.469478 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0099022-422e-4423-97e6-3165338f003d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:08.471167 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0099022-422e-4423-97e6-3165338f003d None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:08.483952 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-f0099022-422e-4423-97e6-3165338f003d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:31:08.483952 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:08.483952 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:08.483952 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:08.483952 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:08.483952 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:08.483952 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:08.483952 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:08.483952 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:08.483952 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:08.483952 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:08.483952 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:08.483952 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 07:31:08.483952 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 07:31:08.483952 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 07:31:08.486096 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 07:31:08.486096 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:08.486096 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:08.486096 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:08.486096 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:08.486096 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:08.486096 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:08.486096 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:08.486096 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:08.486096 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:08.486096 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:08.486096 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:08.486096 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:08.486096 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:08.486096 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:08.486096 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:08.486096 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:08.487028 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 07:31:08.487028 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 07:31:08.487028 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 07:31:08.487028 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 07:31:08.487028 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 07:31:08.487028 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 07:31:08.487028 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:31:08.487028 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:08.487028 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 338/665] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:31:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:08.487028 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0099022-422e-4423-97e6-3165338f003d None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:08.553857 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b21c6-38a9-4aff-acc7-cf2a0871cf8a None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:08.564369 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:08.591171 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd1578-9268-417b-ac61-1a8006d45800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:08.591863 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd1578-9268-417b-ac61-1a8006d45800 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:08.592371 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd1578-9268-417b-ac61-1a8006d45800 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:08.592371 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd1578-9268-417b-ac61-1a8006d45800 None admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:08.593013 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd1578-9268-417b-ac61-1a8006d45800 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:08.593882 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd1578-9268-417b-ac61-1a8006d45800 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:08.595436 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd1578-9268-417b-ac61-1a8006d45800 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:08.609628 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 328/666] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:08.614966 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd1578-9268-417b-ac61-1a8006d45800 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:08.627925 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0099022-422e-4423-97e6-3165338f003d None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:08.668793 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0edcbb-d064-4bcc-8ea0-097bfec12726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:08.669759 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0edcbb-d064-4bcc-8ea0-097bfec12726 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:08.670277 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0edcbb-d064-4bcc-8ea0-097bfec12726 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:08.670898 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0edcbb-d064-4bcc-8ea0-097bfec12726 None admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:08.672347 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0edcbb-d064-4bcc-8ea0-097bfec12726 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:08.672661 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0edcbb-d064-4bcc-8ea0-097bfec12726 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:08.674227 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0edcbb-d064-4bcc-8ea0-097bfec12726 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:08.685946 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:08.701587 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 339/667] 10.222.0.42 () {56 vars in 1139 bytes} [Fri Aug 26 07:31:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:08.701587 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0edcbb-d064-4bcc-8ea0-097bfec12726 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:08.742218 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd1578-9268-417b-ac61-1a8006d45800 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:08.788824 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512228b-41a4-47bd-9621-01bc98c92943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:08.789442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512228b-41a4-47bd-9621-01bc98c92943 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:08.789723 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512228b-41a4-47bd-9621-01bc98c92943 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:08.790049 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512228b-41a4-47bd-9621-01bc98c92943 None admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:08.790906 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f512228b-41a4-47bd-9621-01bc98c92943 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:08.791249 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f512228b-41a4-47bd-9621-01bc98c92943 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:08.792825 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f512228b-41a4-47bd-9621-01bc98c92943 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:08.811687 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 329/668] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 26 07:31:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:08.812650 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512228b-41a4-47bd-9621-01bc98c92943 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:08.820248 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0edcbb-d064-4bcc-8ea0-097bfec12726 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:08.845772 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:08.858613 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b65088-835c-4871-bfe7-690b9b18f879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:08.859433 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b65088-835c-4871-bfe7-690b9b18f879 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:08.859916 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b65088-835c-4871-bfe7-690b9b18f879 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:08.860269 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b65088-835c-4871-bfe7-690b9b18f879 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:08.871051 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b65088-835c-4871-bfe7-690b9b18f879 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:31:08.876313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-59b65088-835c-4871-bfe7-690b9b18f879 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 07:31:08.876313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:08.876313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:08.876313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:08.876313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:08.876313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:08.876313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:08.876313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:08.876313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:08.876313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:08.876313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:08.876313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:08.876313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:31:08.876313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:31:08.876313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:31:08.876313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:31:08.877522 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:31:08.877522 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:31:08.877522 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:31:08.877522 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:31:08.877522 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:08.877522 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:08.877522 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:08.877522 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:08.877522 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:08.877522 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:08.877522 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:08.877522 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:08.877522 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:08.877522 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:08.877522 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:08.877522 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:08.878381 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:08.878381 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:08.878381 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:08.878381 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:08.878381 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:31:08.878381 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:31:08.878381 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:31:08.878381 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:31:08.878381 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:31:08.878381 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:31:08.878381 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 07:31:08.878381 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:08.878381 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 340/669] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 26 07:31:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:08.878381 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b65088-835c-4871-bfe7-690b9b18f879 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:08.945545 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512228b-41a4-47bd-9621-01bc98c92943 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:08.952825 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:08.981822 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee697d9-c375-4ef8-9126-ddd019202391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:08.982889 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee697d9-c375-4ef8-9126-ddd019202391 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:08.983341 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee697d9-c375-4ef8-9126-ddd019202391 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:08.989466 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee697d9-c375-4ef8-9126-ddd019202391 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:08.992175 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee697d9-c375-4ef8-9126-ddd019202391 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:08.993770 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee697d9-c375-4ef8-9126-ddd019202391 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:08.999059 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b65088-835c-4871-bfe7-690b9b18f879 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:09.008139 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-1ee697d9-c375-4ef8-9126-ddd019202391 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:31:09.008139 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:09.008139 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:09.008139 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:09.008139 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:09.008139 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:09.008139 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:09.008139 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:09.008139 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:09.008139 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:09.008139 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:09.008139 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:09.008139 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 07:31:09.008139 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 07:31:09.008139 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 07:31:09.009394 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 07:31:09.009394 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:09.009394 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:09.009394 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:09.009394 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:09.009394 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:09.009394 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:09.009394 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:09.009394 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:09.009394 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:09.009394 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:09.009394 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:09.009394 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:09.009394 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:09.009394 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:09.009394 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:09.009394 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:09.010429 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 07:31:09.010429 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 07:31:09.010429 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 07:31:09.010429 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 07:31:09.010429 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 07:31:09.010429 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 07:31:09.010429 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:31:09.010429 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:09.013949 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 330/670] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:31:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:09.014824 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee697d9-c375-4ef8-9126-ddd019202391 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:09.048124 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6401f67c-231b-4045-865f-07528474334c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:09.049230 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401f67c-231b-4045-865f-07528474334c None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:09.049514 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401f67c-231b-4045-865f-07528474334c None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:09.049784 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401f67c-231b-4045-865f-07528474334c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:09.124299 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:09.135818 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6401f67c-231b-4045-865f-07528474334c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:09.137278 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6401f67c-231b-4045-865f-07528474334c None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:09.139583 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee697d9-c375-4ef8-9126-ddd019202391 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:09.181780 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db190c29-13f6-4e89-91cf-29bbebf29a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:09.182439 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db190c29-13f6-4e89-91cf-29bbebf29a34 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:09.182723 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db190c29-13f6-4e89-91cf-29bbebf29a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:09.182999 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db190c29-13f6-4e89-91cf-29bbebf29a34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:09.183747 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db190c29-13f6-4e89-91cf-29bbebf29a34 None admin] RBAC: Adding query filter params (role.id=aad163eaa5c8447ca5d5a7d5d861395a, scope.project.id=becbf57e91454d499dec313ff9eadfae, user.id=2df7725203304d8fbe3a768656cabf23) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:09.184054 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db190c29-13f6-4e89-91cf-29bbebf29a34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:09.185485 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db190c29-13f6-4e89-91cf-29bbebf29a34 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:09.195036 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 331/671] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:31:09 2022] GET /identity/v3/role_assignments?user.id=2df7725203304d8fbe3a768656cabf23&scope.project.id=becbf57e91454d499dec313ff9eadfae&role.id=aad163eaa5c8447ca5d5a7d5d861395a => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:09.196321 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db190c29-13f6-4e89-91cf-29bbebf29a34 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:09.208638 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:09.279627 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 341/672] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:31:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 07:31:09.281414 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6401f67c-231b-4045-865f-07528474334c None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:09.380874 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db190c29-13f6-4e89-91cf-29bbebf29a34 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:09.437414 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1586f-faae-49fb-abe0-44f26d93db99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:09.438119 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1586f-faae-49fb-abe0-44f26d93db99 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:09.438396 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1586f-faae-49fb-abe0-44f26d93db99 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:09.438666 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1586f-faae-49fb-abe0-44f26d93db99 None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:09.439396 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f1586f-faae-49fb-abe0-44f26d93db99 None admin] RBAC: Adding query filter params (name=service) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:09.439698 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f1586f-faae-49fb-abe0-44f26d93db99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:09.441185 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f1586f-faae-49fb-abe0-44f26d93db99 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:09.452632 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 332/673] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 26 07:31:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:09.453630 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1586f-faae-49fb-abe0-44f26d93db99 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:09.463296 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6401f67c-231b-4045-865f-07528474334c None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:09.476501 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:09.508015 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688af411-6ae9-431c-ba69-cdf9f615568e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:09.508633 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688af411-6ae9-431c-ba69-cdf9f615568e None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:09.508914 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688af411-6ae9-431c-ba69-cdf9f615568e None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:09.509194 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688af411-6ae9-431c-ba69-cdf9f615568e None admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:09.509896 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688af411-6ae9-431c-ba69-cdf9f615568e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:09.510204 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688af411-6ae9-431c-ba69-cdf9f615568e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:09.511842 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688af411-6ae9-431c-ba69-cdf9f615568e None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:09.526569 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 342/674] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 26 07:31:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:09.527262 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688af411-6ae9-431c-ba69-cdf9f615568e None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:09.553744 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:09.613843 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1586f-faae-49fb-abe0-44f26d93db99 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:09.664324 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b6ae2-ed09-47ab-9da8-584d60cfd4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:09.665194 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b6ae2-ed09-47ab-9da8-584d60cfd4ac None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:09.665857 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b6ae2-ed09-47ab-9da8-584d60cfd4ac None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:09.666548 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b6ae2-ed09-47ab-9da8-584d60cfd4ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:09.672900 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688af411-6ae9-431c-ba69-cdf9f615568e None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:09.680608 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b6ae2-ed09-47ab-9da8-584d60cfd4ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:09.682251 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b6ae2-ed09-47ab-9da8-584d60cfd4ac None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:09.698907 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-614b6ae2-ed09-47ab-9da8-584d60cfd4ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:09.698907 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:09.698907 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:09.698907 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:09.698907 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:09.698907 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:09.698907 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:09.698907 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:09.698907 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:09.698907 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:09.698907 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:09.698907 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:09.698907 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:31:09.698907 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:31:09.698907 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:31:09.698907 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:31:09.700087 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:09.700087 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:09.700087 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:09.700087 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:09.700087 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:09.700087 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:09.700087 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:09.700087 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:09.700087 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:09.700087 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:09.700087 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:09.700087 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:09.700087 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:09.700087 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:09.700087 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:09.700087 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:09.700087 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:31:09.701369 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:31:09.701369 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:09.701369 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:09.703809 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 333/675] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:31:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:09.705137 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b6ae2-ed09-47ab-9da8-584d60cfd4ac None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:09.725970 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984abe61-0447-4a6f-83b5-d66d22c80bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:09.727124 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984abe61-0447-4a6f-83b5-d66d22c80bcc None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:09.727503 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984abe61-0447-4a6f-83b5-d66d22c80bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:09.727872 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984abe61-0447-4a6f-83b5-d66d22c80bcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:09.744553 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984abe61-0447-4a6f-83b5-d66d22c80bcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:09.746716 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984abe61-0447-4a6f-83b5-d66d22c80bcc None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:09.766737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-984abe61-0447-4a6f-83b5-d66d22c80bcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:09.766737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:09.766737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:09.766737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:09.766737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:09.766737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:09.766737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:09.766737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:09.766737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:09.766737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:09.766737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:09.766737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:09.766737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:31:09.766737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:31:09.766737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:31:09.766737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:31:09.767905 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:09.767905 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:09.767905 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:09.767905 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:09.767905 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:09.767905 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:09.767905 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:09.767905 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:09.767905 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:09.767905 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:09.767905 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:09.767905 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:09.767905 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:09.767905 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:09.767905 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:09.767905 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:09.767905 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:31:09.769030 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:31:09.769030 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:09.769030 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:09.779183 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 343/676] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:31:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:09.779183 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984abe61-0447-4a6f-83b5-d66d22c80bcc None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:09.805612 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:09.860074 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b6ae2-ed09-47ab-9da8-584d60cfd4ac None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:09.869171 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:09.910770 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a13febb-dc25-4590-99eb-44e70e61d67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:09.912036 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13febb-dc25-4590-99eb-44e70e61d67f None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:09.912420 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13febb-dc25-4590-99eb-44e70e61d67f None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:09.913233 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13febb-dc25-4590-99eb-44e70e61d67f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:09.914400 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a13febb-dc25-4590-99eb-44e70e61d67f None admin] RBAC: Adding query filter params (role.id=aad163eaa5c8447ca5d5a7d5d861395a, scope.project.id=becbf57e91454d499dec313ff9eadfae, user.id=f23fe4069f39499c9ed8e27566eddc77) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:09.914807 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a13febb-dc25-4590-99eb-44e70e61d67f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:09.916336 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984abe61-0447-4a6f-83b5-d66d22c80bcc None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:09.916503 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a13febb-dc25-4590-99eb-44e70e61d67f None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:09.925110 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 334/677] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:31:09 2022] GET /identity/v3/role_assignments?user.id=f23fe4069f39499c9ed8e27566eddc77&scope.project.id=becbf57e91454d499dec313ff9eadfae&role.id=aad163eaa5c8447ca5d5a7d5d861395a => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:09.926190 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a13febb-dc25-4590-99eb-44e70e61d67f None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:09.973982 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c862dd-35a5-4f40-80ef-191ee7795803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:09.974869 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c862dd-35a5-4f40-80ef-191ee7795803 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:09.975326 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c862dd-35a5-4f40-80ef-191ee7795803 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:09.976612 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c862dd-35a5-4f40-80ef-191ee7795803 None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:09.978818 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c862dd-35a5-4f40-80ef-191ee7795803 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:09.979287 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c862dd-35a5-4f40-80ef-191ee7795803 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:09.981169 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c862dd-35a5-4f40-80ef-191ee7795803 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:10.024828 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 344/678] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:31:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:10.030362 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c862dd-35a5-4f40-80ef-191ee7795803 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:10.103107 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a13febb-dc25-4590-99eb-44e70e61d67f None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:10.148244 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:10.155111 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c1dcb-e9a9-422a-919b-3144d1b433f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:10.159369 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c1dcb-e9a9-422a-919b-3144d1b433f7 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:10.159369 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c1dcb-e9a9-422a-919b-3144d1b433f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:10.159369 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c1dcb-e9a9-422a-919b-3144d1b433f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:10.159369 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c1dcb-e9a9-422a-919b-3144d1b433f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:10.159369 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c1dcb-e9a9-422a-919b-3144d1b433f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:10.159988 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c1dcb-e9a9-422a-919b-3144d1b433f7 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:10.182430 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c862dd-35a5-4f40-80ef-191ee7795803 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:10.186854 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 335/679] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:31:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:10.189528 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a6562-18e5-4575-a782-73e1fc1455a7 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:10.189685 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a6562-18e5-4575-a782-73e1fc1455a7 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:10.189963 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a6562-18e5-4575-a782-73e1fc1455a7 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:10.192550 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 336/680] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:31:10.195684 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a6562-18e5-4575-a782-73e1fc1455a7 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:10.223564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:10.240524 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108ff42-c4a1-4f11-b9bb-5307d187050e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:10.241941 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108ff42-c4a1-4f11-b9bb-5307d187050e None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:10.242529 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108ff42-c4a1-4f11-b9bb-5307d187050e None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:10.243298 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108ff42-c4a1-4f11-b9bb-5307d187050e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:10.253412 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6108ff42-c4a1-4f11-b9bb-5307d187050e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:10.256193 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6108ff42-c4a1-4f11-b9bb-5307d187050e None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:10.273342 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-6108ff42-c4a1-4f11-b9bb-5307d187050e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:31:10.273342 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:10.273342 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:10.273342 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:10.273342 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:10.273342 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:10.273342 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:10.273342 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:10.273342 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:10.273342 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:10.273342 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:10.273342 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:10.273342 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 07:31:10.273342 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 07:31:10.273342 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 07:31:10.274309 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 07:31:10.274309 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:10.274309 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:10.274309 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:10.274309 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:10.274309 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:10.274309 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:10.274309 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:10.274309 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:10.274309 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:10.274309 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:10.274309 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:10.274309 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:10.274309 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:10.274309 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:10.274309 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:10.274309 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:10.275258 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 07:31:10.275258 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 07:31:10.275258 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 07:31:10.275258 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 07:31:10.275258 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 07:31:10.275258 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 07:31:10.275258 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:31:10.275258 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:10.276466 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 345/681] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:31:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 07:31:10.277683 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988537d-2922-4e91-82ed-b173537593d2 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:10.278978 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988537d-2922-4e91-82ed-b173537593d2 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:10.279206 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988537d-2922-4e91-82ed-b173537593d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:10.303209 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-8988537d-2922-4e91-82ed-b173537593d2 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:10.304875 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-8988537d-2922-4e91-82ed-b173537593d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:10.329399 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a6562-18e5-4575-a782-73e1fc1455a7 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:10.368074 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bae24f-9dbf-4522-8b51-b77c1fd07c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:10.368707 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bae24f-9dbf-4522-8b51-b77c1fd07c40 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:10.369041 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bae24f-9dbf-4522-8b51-b77c1fd07c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:10.369315 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bae24f-9dbf-4522-8b51-b77c1fd07c40 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:10.379547 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bae24f-9dbf-4522-8b51-b77c1fd07c40 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:10.381017 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bae24f-9dbf-4522-8b51-b77c1fd07c40 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:10.386880 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 346/682] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:31:10.388134 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988537d-2922-4e91-82ed-b173537593d2 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:10.401488 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-79bae24f-9dbf-4522-8b51-b77c1fd07c40 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 26 07:31:10.401488 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:10.401488 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:10.401488 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:10.401488 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:10.401488 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:10.401488 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:10.401488 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:10.401488 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:10.401488 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:10.401488 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:10.401488 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:10.401488 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 07:31:10.401488 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 07:31:10.401488 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 07:31:10.401488 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 07:31:10.402528 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:10.402528 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:10.402528 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 07:31:10.402528 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:31:10.402528 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 07:31:10.402528 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:31:10.402528 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:10.402528 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:10.402528 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:10.402528 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:10.402528 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:10.402528 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:10.402528 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:10.402528 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:10.402528 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:10.402528 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:10.402528 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:10.402528 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:10.404292 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:10.404292 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:10.404292 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 07:31:10.404292 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 07:31:10.404292 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 07:31:10.404292 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 07:31:10.404292 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 07:31:10.404292 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 07:31:10.404292 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 26 07:31:10.404292 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:10.404292 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 337/683] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 26 07:31:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:10.409194 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bae24f-9dbf-4522-8b51-b77c1fd07c40 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:10.500938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:10.508556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988537d-2922-4e91-82ed-b173537593d2 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:10.536350 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:10.551869 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad6462-3389-4a12-9c87-93cc10ba8ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:10.553213 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad6462-3389-4a12-9c87-93cc10ba8ef9 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:10.554705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad6462-3389-4a12-9c87-93cc10ba8ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:10.556092 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad6462-3389-4a12-9c87-93cc10ba8ef9 None admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:10.557032 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad6462-3389-4a12-9c87-93cc10ba8ef9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:10.559548 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad6462-3389-4a12-9c87-93cc10ba8ef9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:10.561247 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad6462-3389-4a12-9c87-93cc10ba8ef9 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:10.589216 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 347/684] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 26 07:31:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:10.595339 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad6462-3389-4a12-9c87-93cc10ba8ef9 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:10.604321 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bae24f-9dbf-4522-8b51-b77c1fd07c40 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:10.645245 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e834bd-1be8-4bb2-9e15-ecbce934bbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:10.645870 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e834bd-1be8-4bb2-9e15-ecbce934bbed None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:10.646153 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e834bd-1be8-4bb2-9e15-ecbce934bbed None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:10.646428 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e834bd-1be8-4bb2-9e15-ecbce934bbed None admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:10.647212 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e834bd-1be8-4bb2-9e15-ecbce934bbed None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:10.647522 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e834bd-1be8-4bb2-9e15-ecbce934bbed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:10.648973 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e834bd-1be8-4bb2-9e15-ecbce934bbed None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:10.669067 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 338/685] 10.222.0.42 () {56 vars in 1135 bytes} [Fri Aug 26 07:31:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:31:10.678491 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e834bd-1be8-4bb2-9e15-ecbce934bbed None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:10.816707 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e834bd-1be8-4bb2-9e15-ecbce934bbed None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:10.818667 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad6462-3389-4a12-9c87-93cc10ba8ef9 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:10.829795 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:10.860132 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e9f2e-07e5-4f31-be07-85a5b2d69301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:10.860987 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e9f2e-07e5-4f31-be07-85a5b2d69301 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:10.861432 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e9f2e-07e5-4f31-be07-85a5b2d69301 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:10.861838 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e9f2e-07e5-4f31-be07-85a5b2d69301 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:10.862734 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40e9f2e-07e5-4f31-be07-85a5b2d69301 None admin] RBAC: Adding query filter params (role.id=aad163eaa5c8447ca5d5a7d5d861395a, scope.project.id=becbf57e91454d499dec313ff9eadfae, user.id=a5ea9916c82647f3a645f1a4258f558b) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:10.863206 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40e9f2e-07e5-4f31-be07-85a5b2d69301 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:10.864767 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40e9f2e-07e5-4f31-be07-85a5b2d69301 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:10.866626 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3170e-cbab-4b05-97e3-36b40ed8e980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:10.867360 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3170e-cbab-4b05-97e3-36b40ed8e980 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:10.867712 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3170e-cbab-4b05-97e3-36b40ed8e980 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:10.868062 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3170e-cbab-4b05-97e3-36b40ed8e980 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:10.879021 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 348/686] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:31:10 2022] GET /identity/v3/role_assignments?user.id=a5ea9916c82647f3a645f1a4258f558b&scope.project.id=becbf57e91454d499dec313ff9eadfae&role.id=aad163eaa5c8447ca5d5a7d5d861395a => generated 608 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:10.881209 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e9f2e-07e5-4f31-be07-85a5b2d69301 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:10.996606 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:11.038261 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef3170e-cbab-4b05-97e3-36b40ed8e980 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:11.041291 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef3170e-cbab-4b05-97e3-36b40ed8e980 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:11.119558 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e9f2e-07e5-4f31-be07-85a5b2d69301 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:11.170082 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c74eeab-44d0-435e-8542-e77ae847296b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:11.170724 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74eeab-44d0-435e-8542-e77ae847296b None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:11.171095 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74eeab-44d0-435e-8542-e77ae847296b None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:11.171475 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74eeab-44d0-435e-8542-e77ae847296b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:11.179934 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 339/687] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:31:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 07:31:11.186243 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3170e-cbab-4b05-97e3-36b40ed8e980 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:11.192259 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c74eeab-44d0-435e-8542-e77ae847296b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:31:11.199242 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-7c74eeab-44d0-435e-8542-e77ae847296b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:31:11.199242 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:11.199242 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:11.199242 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:11.199242 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:11.199242 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:11.199242 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:11.199242 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:11.199242 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:11.199242 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:11.199242 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:11.199242 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:11.199242 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:31:11.199242 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:31:11.199242 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:31:11.199242 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:31:11.200244 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:31:11.200244 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:31:11.200244 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:31:11.200244 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:31:11.200244 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:11.200244 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:11.200244 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:11.200244 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:11.200244 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:11.200244 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:11.200244 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:11.200244 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:11.200244 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:11.200244 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:11.200244 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:11.200244 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:11.201088 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:11.201088 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:11.201088 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:11.201088 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:11.201088 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:31:11.201088 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:31:11.201088 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:31:11.201088 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:31:11.201088 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:31:11.201088 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:31:11.201088 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:31:11.201088 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:11.201088 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 349/688] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 26 07:31:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:11.203851 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:11.207597 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c74eeab-44d0-435e-8542-e77ae847296b None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:11.349609 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c74eeab-44d0-435e-8542-e77ae847296b None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:11.350373 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3170e-cbab-4b05-97e3-36b40ed8e980 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:11.351815 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:11.415650 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e756a0-833d-4de5-9d2e-eac6f6bc4c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:11.416651 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e756a0-833d-4de5-9d2e-eac6f6bc4c1a None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:11.417155 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e756a0-833d-4de5-9d2e-eac6f6bc4c1a None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:11.417652 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e756a0-833d-4de5-9d2e-eac6f6bc4c1a None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:11.418532 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e756a0-833d-4de5-9d2e-eac6f6bc4c1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:11.419707 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e756a0-833d-4de5-9d2e-eac6f6bc4c1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:11.420539 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2cc511-6f69-421f-a66f-b07889beaad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:11.423071 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e756a0-833d-4de5-9d2e-eac6f6bc4c1a None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:11.423930 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2cc511-6f69-421f-a66f-b07889beaad7 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:11.424231 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2cc511-6f69-421f-a66f-b07889beaad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:11.424510 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2cc511-6f69-421f-a66f-b07889beaad7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:11.433952 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 350/689] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:31:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:11.440253 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e756a0-833d-4de5-9d2e-eac6f6bc4c1a None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:11.446554 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2cc511-6f69-421f-a66f-b07889beaad7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:11.446554 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2cc511-6f69-421f-a66f-b07889beaad7 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:11.463053 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-0c2cc511-6f69-421f-a66f-b07889beaad7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:11.463053 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:11.463053 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:11.463053 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:11.463053 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:11.463053 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:11.463053 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:11.463053 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:11.463053 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:11.463053 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:11.463053 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:11.463053 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:11.463053 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:31:11.463053 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:31:11.463053 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:31:11.463053 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:31:11.464088 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:11.464088 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:11.464088 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:11.464088 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:11.464088 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:11.464088 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:11.464088 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:11.464088 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:11.464088 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:11.464088 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:11.464088 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:11.464088 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:11.464088 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:11.464088 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:11.464088 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:11.464088 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:11.464088 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:31:11.464969 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:31:11.464969 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:11.464969 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:11.464969 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 340/690] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:31:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:11.471962 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2cc511-6f69-421f-a66f-b07889beaad7 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:11.582535 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:11.610167 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e756a0-833d-4de5-9d2e-eac6f6bc4c1a None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:11.653019 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903f863-8a6b-4fc2-9504-7b9a6e30e8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:11.656868 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903f863-8a6b-4fc2-9504-7b9a6e30e8d8 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:11.656868 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903f863-8a6b-4fc2-9504-7b9a6e30e8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:11.656868 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903f863-8a6b-4fc2-9504-7b9a6e30e8d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:11.662370 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2cc511-6f69-421f-a66f-b07889beaad7 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:11.667570 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903f863-8a6b-4fc2-9504-7b9a6e30e8d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:11.669048 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903f863-8a6b-4fc2-9504-7b9a6e30e8d8 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:11.687892 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-b903f863-8a6b-4fc2-9504-7b9a6e30e8d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:11.687892 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:11.687892 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:11.687892 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:11.687892 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:11.687892 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:11.687892 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:11.687892 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:11.687892 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:11.687892 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:11.687892 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:11.687892 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:11.687892 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:31:11.687892 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:31:11.687892 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:31:11.687892 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:31:11.688936 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:11.688936 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:11.688936 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:11.688936 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:11.688936 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:11.688936 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:11.688936 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:11.688936 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:11.688936 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:11.688936 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:11.688936 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:11.688936 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:11.688936 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:11.688936 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:11.688936 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:11.688936 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:11.688936 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:31:11.689922 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:31:11.689922 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:11.689922 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:11.689922 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 351/691] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:31:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:11.690790 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed713b-630e-41e9-b644-4018395d0324 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:11.691280 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed713b-630e-41e9-b644-4018395d0324 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:11.691559 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed713b-630e-41e9-b644-4018395d0324 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:11.693005 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 352/692] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:31:11.698551 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed713b-630e-41e9-b644-4018395d0324 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:11.716869 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e618c7-927a-44e1-b87f-d236b9aabea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:11.717744 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e618c7-927a-44e1-b87f-d236b9aabea9 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:11.718080 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e618c7-927a-44e1-b87f-d236b9aabea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:11.719087 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e618c7-927a-44e1-b87f-d236b9aabea9 None admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:11.722366 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e618c7-927a-44e1-b87f-d236b9aabea9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:11.722366 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e618c7-927a-44e1-b87f-d236b9aabea9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:11.722366 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e618c7-927a-44e1-b87f-d236b9aabea9 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:11.726742 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:11.743273 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 341/693] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:31:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:11.745692 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9c142-4242-4b3e-992d-3c30959c641a None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:11.747398 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9c142-4242-4b3e-992d-3c30959c641a None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:11.747720 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9c142-4242-4b3e-992d-3c30959c641a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:11.772010 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-04f9c142-4242-4b3e-992d-3c30959c641a None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:11.773239 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-04f9c142-4242-4b3e-992d-3c30959c641a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:11.859479 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed713b-630e-41e9-b644-4018395d0324 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:11.877035 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 342/694] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:31:11.878825 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f9c142-4242-4b3e-992d-3c30959c641a None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:11.910310 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22432166-4a5a-4a1e-b90e-4801d0503dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:11.911015 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22432166-4a5a-4a1e-b90e-4801d0503dbb None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:11.911296 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22432166-4a5a-4a1e-b90e-4801d0503dbb None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:11.911569 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22432166-4a5a-4a1e-b90e-4801d0503dbb None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:11.912904 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22432166-4a5a-4a1e-b90e-4801d0503dbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:11.913226 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22432166-4a5a-4a1e-b90e-4801d0503dbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:11.914871 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22432166-4a5a-4a1e-b90e-4801d0503dbb None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:11.931736 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 353/695] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:31:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:11.936820 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22432166-4a5a-4a1e-b90e-4801d0503dbb None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:12.004568 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:12.083009 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:12.112517 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f9c142-4242-4b3e-992d-3c30959c641a None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:12.114646 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22432166-4a5a-4a1e-b90e-4801d0503dbb None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:12.191842 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c038815-fe50-4c73-aed4-84c430dd0445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:12.192408 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c038815-fe50-4c73-aed4-84c430dd0445 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:12.192685 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c038815-fe50-4c73-aed4-84c430dd0445 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:12.192957 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c038815-fe50-4c73-aed4-84c430dd0445 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:12.195876 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ccd63-81c0-4721-a2f2-8eeb9d553d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:12.196511 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ccd63-81c0-4721-a2f2-8eeb9d553d33 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:12.196793 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ccd63-81c0-4721-a2f2-8eeb9d553d33 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:12.197060 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ccd63-81c0-4721-a2f2-8eeb9d553d33 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:12.206039 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c038815-fe50-4c73-aed4-84c430dd0445 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:12.207668 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c038815-fe50-4c73-aed4-84c430dd0445 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:12.220843 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ccd63-81c0-4721-a2f2-8eeb9d553d33 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:12.221472 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-6c038815-fe50-4c73-aed4-84c430dd0445 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:31:12.221472 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:12.221472 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:12.221472 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:12.221472 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:12.221472 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:12.221472 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:12.221472 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:12.221472 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:12.221472 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:12.221472 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:12.221472 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:12.221472 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 07:31:12.221472 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 07:31:12.221472 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 07:31:12.222534 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 07:31:12.222534 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:12.222534 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:12.222534 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:12.222534 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:12.222534 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:12.222534 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:12.222534 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:12.222534 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:12.222534 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:12.222534 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:12.222534 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:12.222534 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:12.222534 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:12.222534 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:12.222534 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:12.222534 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:12.223535 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 07:31:12.223535 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 07:31:12.223535 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 07:31:12.223535 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 07:31:12.223535 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 07:31:12.223535 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 07:31:12.223535 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:31:12.223535 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:12.223535 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 343/696] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:31:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:12.223535 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c038815-fe50-4c73-aed4-84c430dd0445 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:12.225716 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ccd63-81c0-4721-a2f2-8eeb9d553d33 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:12.240160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-e97ccd63-81c0-4721-a2f2-8eeb9d553d33 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 07:31:12.240160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:12.240160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:12.240160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:12.240160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:12.240160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:12.240160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:12.240160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:12.240160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:12.240160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:12.240160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:12.240160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:12.240160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 07:31:12.240160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 07:31:12.240160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 07:31:12.240160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 07:31:12.241407 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:12.241407 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:12.241407 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 07:31:12.241407 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:31:12.241407 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 07:31:12.241407 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:31:12.241407 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:12.241407 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:12.241407 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:12.241407 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:12.241407 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:12.241407 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:12.241407 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:12.241407 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:12.241407 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:12.241407 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:12.241407 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:12.241407 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:12.242668 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:12.242668 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:12.242668 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 07:31:12.242668 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 07:31:12.242668 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 07:31:12.242668 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 07:31:12.242668 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 07:31:12.242668 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 07:31:12.242668 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 07:31:12.242668 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:12.247129 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 354/697] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Aug 26 07:31:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:12.249529 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c0ad0-bc9e-4dc2-a102-7db666c1fad0 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:12.249863 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c0ad0-bc9e-4dc2-a102-7db666c1fad0 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:12.250134 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c0ad0-bc9e-4dc2-a102-7db666c1fad0 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:12.251975 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 355/698] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:31:12.252754 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c0ad0-bc9e-4dc2-a102-7db666c1fad0 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:12.363853 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c038815-fe50-4c73-aed4-84c430dd0445 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:12.375485 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:12.376672 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c0ad0-bc9e-4dc2-a102-7db666c1fad0 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:12.403467 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec8d4e-dfb2-424c-b395-feabf7a48a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:12.404210 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec8d4e-dfb2-424c-b395-feabf7a48a88 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:12.404488 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec8d4e-dfb2-424c-b395-feabf7a48a88 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:12.404758 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec8d4e-dfb2-424c-b395-feabf7a48a88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:12.415244 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f92f5a-99ed-416a-bd44-e8ac6443c093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:12.415881 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f92f5a-99ed-416a-bd44-e8ac6443c093 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:12.416164 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f92f5a-99ed-416a-bd44-e8ac6443c093 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:12.416436 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f92f5a-99ed-416a-bd44-e8ac6443c093 None admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:12.416966 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec8d4e-dfb2-424c-b395-feabf7a48a88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:12.417140 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f92f5a-99ed-416a-bd44-e8ac6443c093 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:12.417454 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f92f5a-99ed-416a-bd44-e8ac6443c093 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:12.418918 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f92f5a-99ed-416a-bd44-e8ac6443c093 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:12.419300 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec8d4e-dfb2-424c-b395-feabf7a48a88 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:12.423449 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:12.439688 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 356/699] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 26 07:31:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:12.439688 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f92f5a-99ed-416a-bd44-e8ac6443c093 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:12.440156 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-b3ec8d4e-dfb2-424c-b395-feabf7a48a88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:12.440156 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:12.440156 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:12.440156 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:12.440156 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:12.440156 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:12.440156 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:12.440156 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:12.440156 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:12.440156 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:12.440156 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:12.440156 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:12.440156 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:31:12.440156 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:31:12.440156 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:31:12.440156 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:31:12.441100 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:12.441100 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:12.441100 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:12.441100 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:12.441100 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:12.441100 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:12.441100 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:12.441100 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:12.441100 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:12.441100 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:12.441100 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:12.441100 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:12.441100 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:12.441100 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:12.441100 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:12.441100 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:12.441100 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:31:12.442045 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:31:12.442045 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:12.442045 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:12.442045 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 344/700] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:31:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:12.442045 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ff1a0-a9df-45e5-bd37-d5936bc4cb06 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:12.442045 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ff1a0-a9df-45e5-bd37-d5936bc4cb06 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:12.442045 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ff1a0-a9df-45e5-bd37-d5936bc4cb06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:12.458930 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-858ff1a0-a9df-45e5-bd37-d5936bc4cb06 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:12.460131 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-858ff1a0-a9df-45e5-bd37-d5936bc4cb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:12.548511 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 345/701] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:31:12.549984 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ff1a0-a9df-45e5-bd37-d5936bc4cb06 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:12.550964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f92f5a-99ed-416a-bd44-e8ac6443c093 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:12.596986 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df779dd4-f948-4581-acd3-f306956f4e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:12.597776 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df779dd4-f948-4581-acd3-f306956f4e8b None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:12.598159 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df779dd4-f948-4581-acd3-f306956f4e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:12.598531 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df779dd4-f948-4581-acd3-f306956f4e8b None admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:12.599437 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df779dd4-f948-4581-acd3-f306956f4e8b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:12.599872 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df779dd4-f948-4581-acd3-f306956f4e8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:12.601613 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df779dd4-f948-4581-acd3-f306956f4e8b None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:12.628093 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 357/702] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Aug 26 07:31:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:12.628093 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df779dd4-f948-4581-acd3-f306956f4e8b None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:12.688355 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:12.690710 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:12.700719 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ff1a0-a9df-45e5-bd37-d5936bc4cb06 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:12.741002 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e8573-20ee-4037-b38f-6c5170e03095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:12.741797 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e8573-20ee-4037-b38f-6c5170e03095 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:12.742174 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e8573-20ee-4037-b38f-6c5170e03095 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:12.742548 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e8573-20ee-4037-b38f-6c5170e03095 None admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:12.743473 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e8573-20ee-4037-b38f-6c5170e03095 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:12.743760 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e8573-20ee-4037-b38f-6c5170e03095 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:12.745254 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e8573-20ee-4037-b38f-6c5170e03095 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:12.746976 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df779dd4-f948-4581-acd3-f306956f4e8b None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:12.768098 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 346/703] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:31:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:12.769950 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e8573-20ee-4037-b38f-6c5170e03095 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:12.790409 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf1b18-0611-45f6-a458-f0944114285e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:12.791249 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf1b18-0611-45f6-a458-f0944114285e None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:12.791626 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf1b18-0611-45f6-a458-f0944114285e None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:12.791995 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf1b18-0611-45f6-a458-f0944114285e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:12.792827 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf1b18-0611-45f6-a458-f0944114285e None admin] RBAC: Adding query filter params (role.id=aad163eaa5c8447ca5d5a7d5d861395a, scope.project.id=becbf57e91454d499dec313ff9eadfae, user.id=3142255c263e44a189db82c621f87e7d) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:12.793234 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf1b18-0611-45f6-a458-f0944114285e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:12.794868 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf1b18-0611-45f6-a458-f0944114285e None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:12.811511 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 358/704] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:31:12 2022] GET /identity/v3/role_assignments?user.id=3142255c263e44a189db82c621f87e7d&scope.project.id=becbf57e91454d499dec313ff9eadfae&role.id=aad163eaa5c8447ca5d5a7d5d861395a => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:12.813301 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf1b18-0611-45f6-a458-f0944114285e None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:12.913063 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e8573-20ee-4037-b38f-6c5170e03095 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:12.967635 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cec4dd-7847-49cd-86a6-1a90aef31632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:12.968767 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cec4dd-7847-49cd-86a6-1a90aef31632 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:12.969046 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cec4dd-7847-49cd-86a6-1a90aef31632 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:12.969375 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cec4dd-7847-49cd-86a6-1a90aef31632 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:12.992791 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf1b18-0611-45f6-a458-f0944114285e None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:12.999304 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:13.014768 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:13.037574 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07374d7-4728-4169-9657-620a22581ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:13.038465 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07374d7-4728-4169-9657-620a22581ca1 None admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:13.038906 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07374d7-4728-4169-9657-620a22581ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:13.039435 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07374d7-4728-4169-9657-620a22581ca1 None admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:13.040241 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07374d7-4728-4169-9657-620a22581ca1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:13.041844 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07374d7-4728-4169-9657-620a22581ca1 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:13.059872 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cec4dd-7847-49cd-86a6-1a90aef31632 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:13.061672 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cec4dd-7847-49cd-86a6-1a90aef31632 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:13.131704 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 359/705] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 26 07:31:12 2022] POST /identity/v3/users => generated 254 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:31:13.132381 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07374d7-4728-4169-9657-620a22581ca1 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:13.197053 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 347/706] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:31:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 07:31:13.206802 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cec4dd-7847-49cd-86a6-1a90aef31632 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:13.305641 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07374d7-4728-4169-9657-620a22581ca1 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:13.320435 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:13.362905 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14169b53-bdda-4859-a055-0a60b563f2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:13.363574 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14169b53-bdda-4859-a055-0a60b563f2c0 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:13.363852 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14169b53-bdda-4859-a055-0a60b563f2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:13.364119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14169b53-bdda-4859-a055-0a60b563f2c0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:13.364706 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14169b53-bdda-4859-a055-0a60b563f2c0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:13.366066 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14169b53-bdda-4859-a055-0a60b563f2c0 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:13.379645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-14169b53-bdda-4859-a055-0a60b563f2c0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 07:31:13.379645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:13.379645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 07:31:13.379645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 07:31:13.379645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 07:31:13.379645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 07:31:13.379645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 07:31:13.379645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:31:13.379645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 07:31:13.379645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:13.379645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 07:31:13.379645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:13.379645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:13.379645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:13.379645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:13.379645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:13.379645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:13.380810 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:13.380810 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:13.380810 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:13.380810 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:13.380810 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:13.380810 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:13.380810 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 07:31:13.380810 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 07:31:13.380810 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 07:31:13.380810 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 07:31:13.380810 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:13.380810 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:13.380810 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:13.380810 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:13.380810 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:13.380810 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:13.381742 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:13.381742 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:13.381742 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:13.381742 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:13.381742 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:13.381742 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:13.381742 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:13.381742 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:13.381742 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:13.381742 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:13.381742 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 07:31:13.381742 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:31:13.381742 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 07:31:13.381742 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:13.384299 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 360/707] 10.222.0.42 () {56 vars in 1129 bytes} [Fri Aug 26 07:31:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:13.385809 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a066ed-79f9-4250-9691-e34265625d37 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:13.386094 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a066ed-79f9-4250-9691-e34265625d37 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:13.386368 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a066ed-79f9-4250-9691-e34265625d37 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:13.389137 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 361/708] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:31:13.396357 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b3ab3-bffb-479c-90ab-3baef5241e7b None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:13.396659 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b3ab3-bffb-479c-90ab-3baef5241e7b None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:13.396905 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b3ab3-bffb-479c-90ab-3baef5241e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:13.397003 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cec4dd-7847-49cd-86a6-1a90aef31632 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:13.417428 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-bf6b3ab3-bffb-479c-90ab-3baef5241e7b None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:13.418673 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-bf6b3ab3-bffb-479c-90ab-3baef5241e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:13.455550 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6de208-f11b-4173-b4c5-a89ed7a15fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:13.457245 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6de208-f11b-4173-b4c5-a89ed7a15fa7 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:13.457719 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6de208-f11b-4173-b4c5-a89ed7a15fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:13.458180 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6de208-f11b-4173-b4c5-a89ed7a15fa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:13.474494 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6de208-f11b-4173-b4c5-a89ed7a15fa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:13.476736 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6de208-f11b-4173-b4c5-a89ed7a15fa7 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:13.487430 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:13.496336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-0d6de208-f11b-4173-b4c5-a89ed7a15fa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:13.496336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:13.496336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:13.496336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:13.496336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:13.496336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:13.496336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:13.496336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:13.496336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:13.496336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:13.496336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:13.496336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:13.496336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:31:13.496336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:31:13.496336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:31:13.496336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:31:13.497344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:13.497344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:13.497344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:13.497344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:13.497344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:13.497344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:13.497344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:13.497344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:13.497344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:13.497344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:13.497344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:13.497344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:13.497344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:13.497344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:13.497344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:13.497344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:13.497344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:31:13.498318 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:31:13.498318 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:13.498318 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:13.498318 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 348/709] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:31:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:13.500730 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6de208-f11b-4173-b4c5-a89ed7a15fa7 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:13.520733 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 362/710] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 07:31:13.520733 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b3ab3-bffb-479c-90ab-3baef5241e7b None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:13.677979 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b3ab3-bffb-479c-90ab-3baef5241e7b None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:13.726329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1003a-3da2-46f4-8c0f-cfd5e3a94811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:13.727869 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1003a-3da2-46f4-8c0f-cfd5e3a94811 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:13.728321 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1003a-3da2-46f4-8c0f-cfd5e3a94811 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:13.728744 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1003a-3da2-46f4-8c0f-cfd5e3a94811 None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:13.729561 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f1003a-3da2-46f4-8c0f-cfd5e3a94811 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:13.730026 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f1003a-3da2-46f4-8c0f-cfd5e3a94811 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:13.731625 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f1003a-3da2-46f4-8c0f-cfd5e3a94811 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:13.747542 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 363/711] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:31:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:13.754818 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1003a-3da2-46f4-8c0f-cfd5e3a94811 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:13.774767 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6de208-f11b-4173-b4c5-a89ed7a15fa7 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:13.784397 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:13.828449 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:13.858142 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8104c-558f-421a-a49b-d887cb891583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:13.860049 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8104c-558f-421a-a49b-d887cb891583 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:13.860612 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8104c-558f-421a-a49b-d887cb891583 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:13.861091 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8104c-558f-421a-a49b-d887cb891583 None admin] PATH_INFO: `/v3/services` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:13.862459 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b8104c-558f-421a-a49b-d887cb891583 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:13.863278 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b8104c-558f-421a-a49b-d887cb891583 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:13.865591 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b8104c-558f-421a-a49b-d887cb891583 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:13.877609 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 349/712] 10.222.0.42 () {56 vars in 1124 bytes} [Fri Aug 26 07:31:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:13.879428 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8104c-558f-421a-a49b-d887cb891583 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:13.918752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1003a-3da2-46f4-8c0f-cfd5e3a94811 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:13.968846 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54320a49-862a-4b2b-ad29-c0d313796c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:13.970584 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54320a49-862a-4b2b-ad29-c0d313796c46 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:13.971286 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54320a49-862a-4b2b-ad29-c0d313796c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:13.971814 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54320a49-862a-4b2b-ad29-c0d313796c46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:13.981524 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54320a49-862a-4b2b-ad29-c0d313796c46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:13.984898 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54320a49-862a-4b2b-ad29-c0d313796c46 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:14.001597 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-54320a49-862a-4b2b-ad29-c0d313796c46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:31:14.001597 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:14.001597 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:14.001597 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:14.001597 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:14.001597 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:14.001597 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:14.001597 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:14.001597 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:14.001597 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:14.001597 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:14.001597 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:14.001597 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 07:31:14.001597 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 07:31:14.001597 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 07:31:14.002752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 07:31:14.002752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:14.002752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:14.002752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:14.002752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:14.002752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:14.002752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:14.002752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:14.002752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:14.002752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:14.002752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:14.002752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:14.002752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:14.002752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:14.002752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:14.002752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:14.002752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:14.003969 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 07:31:14.003969 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 07:31:14.003969 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 07:31:14.003969 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 07:31:14.003969 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 07:31:14.003969 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 07:31:14.003969 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:31:14.003969 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:14.006935 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 364/713] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:31:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 07:31:14.008032 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54320a49-862a-4b2b-ad29-c0d313796c46 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:14.018652 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8104c-558f-421a-a49b-d887cb891583 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:14.067426 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61db36e-d63c-4cee-9712-e265389c5957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:14.068597 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61db36e-d63c-4cee-9712-e265389c5957 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:14.069350 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61db36e-d63c-4cee-9712-e265389c5957 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:14.070110 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61db36e-d63c-4cee-9712-e265389c5957 None admin] PATH_INFO: `/v3/services/network` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:14.070961 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61db36e-d63c-4cee-9712-e265389c5957 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:14.072768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61db36e-d63c-4cee-9712-e265389c5957 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:14.088755 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-a61db36e-d63c-4cee-9712-e265389c5957 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 07:31:14.088755 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:14.088755 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 07:31:14.088755 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 07:31:14.088755 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 07:31:14.088755 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 07:31:14.088755 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 07:31:14.088755 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:31:14.088755 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 07:31:14.088755 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:14.088755 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 07:31:14.088755 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:14.088755 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:14.088755 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:14.088755 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:14.088755 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:14.088755 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:14.090047 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:14.090047 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:14.090047 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:14.090047 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:14.090047 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:14.090047 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:14.090047 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 07:31:14.090047 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 07:31:14.090047 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 07:31:14.090047 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 07:31:14.090047 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:14.090047 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:14.090047 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:14.090047 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:14.090047 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:14.090047 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:14.091091 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:14.091091 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:14.091091 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:14.091091 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:14.091091 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:14.091091 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:14.091091 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:14.091091 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:14.091091 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:14.091091 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:14.091091 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 07:31:14.091091 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:31:14.091091 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 07:31:14.091091 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:14.097786 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 350/714] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:31:13 2022] GET /identity/v3/services/network => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:14.097786 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61db36e-d63c-4cee-9712-e265389c5957 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:14.130711 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:14.132307 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:14.144830 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54320a49-862a-4b2b-ad29-c0d313796c46 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:14.184816 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c891953-bcc6-4fbb-879f-4e616459034e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:14.185863 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c891953-bcc6-4fbb-879f-4e616459034e None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:14.186345 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c891953-bcc6-4fbb-879f-4e616459034e None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:14.186845 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c891953-bcc6-4fbb-879f-4e616459034e None admin] PATH_INFO: `/v3/services` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:14.188399 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c891953-bcc6-4fbb-879f-4e616459034e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:14.188958 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c891953-bcc6-4fbb-879f-4e616459034e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:14.190508 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c891953-bcc6-4fbb-879f-4e616459034e None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:14.197336 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 365/715] 10.222.0.42 () {56 vars in 1124 bytes} [Fri Aug 26 07:31:14 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:14.198569 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c891953-bcc6-4fbb-879f-4e616459034e None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:14.215104 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61db36e-d63c-4cee-9712-e265389c5957 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:14.260496 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c47b1-5467-4131-8faf-de0db15494b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:14.261038 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c47b1-5467-4131-8faf-de0db15494b4 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:14.261314 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c47b1-5467-4131-8faf-de0db15494b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:14.261585 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c47b1-5467-4131-8faf-de0db15494b4 None admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:14.262295 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c47b1-5467-4131-8faf-de0db15494b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:14.262674 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c47b1-5467-4131-8faf-de0db15494b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:14.264301 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c47b1-5467-4131-8faf-de0db15494b4 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:14.278688 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 351/716] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 26 07:31:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:14.288064 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c47b1-5467-4131-8faf-de0db15494b4 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:14.315682 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c891953-bcc6-4fbb-879f-4e616459034e None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:14.355548 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d246f29-be84-4a22-804d-e5bf89ff3359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:14.356854 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d246f29-be84-4a22-804d-e5bf89ff3359 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:14.357605 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d246f29-be84-4a22-804d-e5bf89ff3359 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:14.360813 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d246f29-be84-4a22-804d-e5bf89ff3359 None admin] PATH_INFO: `/v3/services` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:14.361745 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d246f29-be84-4a22-804d-e5bf89ff3359 None admin] RBAC: Adding query filter params (name=network) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:14.362249 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d246f29-be84-4a22-804d-e5bf89ff3359 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:14.364212 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d246f29-be84-4a22-804d-e5bf89ff3359 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:14.380499 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 366/717] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Aug 26 07:31:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:14.382475 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d246f29-be84-4a22-804d-e5bf89ff3359 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:14.420372 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:14.491438 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:14.507978 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c47b1-5467-4131-8faf-de0db15494b4 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:14.535366 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d246f29-be84-4a22-804d-e5bf89ff3359 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:14.578414 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aedbde0-20d5-4d03-a5ea-f7f6a6bdf29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:14.580405 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aedbde0-20d5-4d03-a5ea-f7f6a6bdf29b None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:14.581260 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aedbde0-20d5-4d03-a5ea-f7f6a6bdf29b None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:14.582013 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aedbde0-20d5-4d03-a5ea-f7f6a6bdf29b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:14.583417 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aedbde0-20d5-4d03-a5ea-f7f6a6bdf29b None admin] RBAC: Adding query filter params (role.id=07ed857b2feb472f9fa9e7fe0b08582b, scope.project.id=becbf57e91454d499dec313ff9eadfae, user.id=bc92c0a0a2cc4722868e6877bac93ada) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:14.584167 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514dbc80-85c5-4e2e-856e-a9b91316b979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:14.584662 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aedbde0-20d5-4d03-a5ea-f7f6a6bdf29b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:14.585412 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514dbc80-85c5-4e2e-856e-a9b91316b979 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:14.587022 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aedbde0-20d5-4d03-a5ea-f7f6a6bdf29b None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:14.587455 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514dbc80-85c5-4e2e-856e-a9b91316b979 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:14.587875 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514dbc80-85c5-4e2e-856e-a9b91316b979 None admin] PATH_INFO: `/v3/services` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:14.588672 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514dbc80-85c5-4e2e-856e-a9b91316b979 None admin] RBAC: Adding query filter params (type=network) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:14.589937 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514dbc80-85c5-4e2e-856e-a9b91316b979 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:14.591575 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514dbc80-85c5-4e2e-856e-a9b91316b979 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:14.601232 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 352/718] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:31:14 2022] GET /identity/v3/role_assignments?user.id=bc92c0a0a2cc4722868e6877bac93ada&scope.project.id=becbf57e91454d499dec313ff9eadfae&role.id=07ed857b2feb472f9fa9e7fe0b08582b => generated 259 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:14.607161 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 367/719] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Aug 26 07:31:14 2022] GET /identity/v3/services?type=network => generated 124 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:15.232252 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ca46a-768c-427a-8477-765af887bb5a None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:15.232787 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ca46a-768c-427a-8477-765af887bb5a None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:15.232787 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ca46a-768c-427a-8477-765af887bb5a None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:15.234740 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 353/720] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:31:15.240687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b201e8a-674d-4ff9-8cd3-5aede6aff211 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:15.240997 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b201e8a-674d-4ff9-8cd3-5aede6aff211 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:15.241249 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b201e8a-674d-4ff9-8cd3-5aede6aff211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:15.263628 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-5b201e8a-674d-4ff9-8cd3-5aede6aff211 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:15.265015 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-5b201e8a-674d-4ff9-8cd3-5aede6aff211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:15.372692 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cacacb9-4d98-4f32-83ef-789f0b6290ff None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:15.373060 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cacacb9-4d98-4f32-83ef-789f0b6290ff None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:15.373284 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cacacb9-4d98-4f32-83ef-789f0b6290ff None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:15.375740 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 354/721] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 07:31:15.379109 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 368/722] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:31:15.382913 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75123b-5b05-47c9-9279-75d6cedf1a62 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:15.383511 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75123b-5b05-47c9-9279-75d6cedf1a62 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:15.383982 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75123b-5b05-47c9-9279-75d6cedf1a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:15.408159 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-9e75123b-5b05-47c9-9279-75d6cedf1a62 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:15.409707 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-9e75123b-5b05-47c9-9279-75d6cedf1a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:15.504065 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 355/723] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:31:15.705576 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b201e8a-674d-4ff9-8cd3-5aede6aff211 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:15.722908 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:15.852970 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b201e8a-674d-4ff9-8cd3-5aede6aff211 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:15.856414 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75123b-5b05-47c9-9279-75d6cedf1a62 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:15.918311 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b881d-9232-4caf-993f-2a2e65650bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:15.919652 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b881d-9232-4caf-993f-2a2e65650bcb None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:15.922720 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b881d-9232-4caf-993f-2a2e65650bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:15.923293 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b881d-9232-4caf-993f-2a2e65650bcb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:15.958652 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b881d-9232-4caf-993f-2a2e65650bcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:31:15.968644 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-1e0b881d-9232-4caf-993f-2a2e65650bcb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:31:15.968644 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:15.968644 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:15.968644 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:15.968644 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:15.968644 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:15.968644 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:15.968644 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:15.968644 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:15.968644 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:15.968644 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:15.968644 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:15.968644 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:31:15.968644 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:31:15.968644 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:31:15.968644 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:31:15.969712 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:31:15.969712 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:31:15.969712 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:31:15.969712 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:31:15.969712 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:15.969712 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:15.969712 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:15.969712 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:15.969712 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:15.969712 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:15.969712 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:15.969712 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:15.969712 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:15.969712 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:15.969712 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:15.969712 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:15.970586 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:15.970586 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:15.970586 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:15.970586 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:15.970586 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:31:15.970586 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:31:15.970586 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:31:15.970586 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:31:15.970586 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:31:15.970586 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:31:15.970586 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:31:15.970586 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:15.970586 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 369/724] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 26 07:31:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:15.975911 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b881d-9232-4caf-993f-2a2e65650bcb None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:16.001811 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:16.060275 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:16.069234 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75123b-5b05-47c9-9279-75d6cedf1a62 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:16.087174 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b881d-9232-4caf-993f-2a2e65650bcb None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:16.128212 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a82c32-62d9-43d1-b8cc-8c891bdb38f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:16.128862 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a82c32-62d9-43d1-b8cc-8c891bdb38f8 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:16.129143 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a82c32-62d9-43d1-b8cc-8c891bdb38f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:16.129416 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a82c32-62d9-43d1-b8cc-8c891bdb38f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:16.156954 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a82c32-62d9-43d1-b8cc-8c891bdb38f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:31:16.163079 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69a282a-3be9-485c-b257-196566cbf8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:16.163699 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a282a-3be9-485c-b257-196566cbf8ad None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:16.164028 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a282a-3be9-485c-b257-196566cbf8ad None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:16.164306 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a282a-3be9-485c-b257-196566cbf8ad None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:16.164988 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69a282a-3be9-485c-b257-196566cbf8ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:16.165294 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69a282a-3be9-485c-b257-196566cbf8ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:16.166688 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69a282a-3be9-485c-b257-196566cbf8ad None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:16.173037 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-41a82c32-62d9-43d1-b8cc-8c891bdb38f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 07:31:16.173037 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:16.173037 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:16.173037 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:16.173037 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:16.173037 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:16.173037 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:16.173037 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:16.173037 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:16.173037 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:16.173037 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:16.173037 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:16.173037 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:31:16.173037 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:31:16.173037 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:31:16.173037 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:31:16.174114 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:31:16.174114 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:31:16.174114 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:31:16.174114 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:31:16.174114 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:16.174114 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:16.174114 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:16.174114 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:16.174114 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:16.174114 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:16.174114 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:16.174114 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:16.174114 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:16.174114 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:16.174114 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:16.174114 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:16.175063 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:16.175063 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:16.175063 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:16.175063 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:16.175063 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:31:16.175063 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:31:16.175063 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:31:16.175063 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:31:16.175063 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:31:16.175063 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:31:16.175063 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 07:31:16.175063 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:16.175063 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 356/725] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 26 07:31:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:16.180528 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 370/726] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:31:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:16.182457 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a82c32-62d9-43d1-b8cc-8c891bdb38f8 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:16.187957 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69a282a-3be9-485c-b257-196566cbf8ad None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:16.309976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a82c32-62d9-43d1-b8cc-8c891bdb38f8 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:16.353216 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515aac48-bb1d-44ed-b8d9-fb08eb53efec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:16.353781 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515aac48-bb1d-44ed-b8d9-fb08eb53efec None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:16.354066 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515aac48-bb1d-44ed-b8d9-fb08eb53efec None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:16.354352 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515aac48-bb1d-44ed-b8d9-fb08eb53efec None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:16.355150 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515aac48-bb1d-44ed-b8d9-fb08eb53efec None admin] RBAC: Adding query filter params (name=service) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:16.355554 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515aac48-bb1d-44ed-b8d9-fb08eb53efec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:16.357067 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515aac48-bb1d-44ed-b8d9-fb08eb53efec None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:16.366898 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 357/727] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 26 07:31:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:16.374862 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515aac48-bb1d-44ed-b8d9-fb08eb53efec None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:16.397103 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:16.465276 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69a282a-3be9-485c-b257-196566cbf8ad None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:16.492755 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515aac48-bb1d-44ed-b8d9-fb08eb53efec None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:16.532519 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff76a76-55dc-4079-8966-f5bf8273843c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:16.533239 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff76a76-55dc-4079-8966-f5bf8273843c None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:16.533528 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff76a76-55dc-4079-8966-f5bf8273843c None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:16.533807 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff76a76-55dc-4079-8966-f5bf8273843c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:16.545389 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff76a76-55dc-4079-8966-f5bf8273843c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:16.547915 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff76a76-55dc-4079-8966-f5bf8273843c None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:16.561373 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8c868-c095-4da0-8b8b-c2b898c56210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:16.562709 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8c868-c095-4da0-8b8b-c2b898c56210 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:16.563224 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8c868-c095-4da0-8b8b-c2b898c56210 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:16.563530 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8c868-c095-4da0-8b8b-c2b898c56210 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:16.566119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-5ff76a76-55dc-4079-8966-f5bf8273843c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:16.566119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:16.566119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:16.566119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:16.566119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:16.566119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:16.566119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:16.566119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:16.566119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:16.566119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:16.566119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:16.566119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:16.566119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:31:16.566119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:31:16.566119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:31:16.566119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:31:16.567229 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:16.567229 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:16.567229 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:16.567229 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:16.567229 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:16.567229 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:16.567229 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:16.567229 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:16.567229 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:16.567229 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:16.567229 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:16.567229 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:16.567229 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:16.567229 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:16.567229 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:16.567229 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:16.567229 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:31:16.568190 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:31:16.568190 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:16.568190 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:16.568190 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 371/728] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:31:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:16.571325 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:16.573479 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff76a76-55dc-4079-8966-f5bf8273843c None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:16.593302 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd8c868-c095-4da0-8b8b-c2b898c56210 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:16.595200 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd8c868-c095-4da0-8b8b-c2b898c56210 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:16.628046 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-cdd8c868-c095-4da0-8b8b-c2b898c56210 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:16.628046 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:16.628046 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:16.628046 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:16.628046 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:16.628046 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:16.628046 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:16.628046 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:16.628046 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:16.628046 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:16.628046 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:16.628046 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:16.628046 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:31:16.628046 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:31:16.628046 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:31:16.628046 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:31:16.629077 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:16.629077 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:16.629077 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:16.629077 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:16.629077 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:16.629077 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:16.629077 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:16.629077 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:16.629077 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:16.629077 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:16.629077 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:16.629077 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:16.629077 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:16.629077 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:16.629077 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:16.629077 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:16.629077 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:31:16.629971 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:31:16.629971 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:16.629971 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:16.629971 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 358/729] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:31:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:16.636778 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8c868-c095-4da0-8b8b-c2b898c56210 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:16.698719 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff76a76-55dc-4079-8966-f5bf8273843c None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:16.715988 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:16.740243 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb1274-4735-4d65-a60a-9288dd2c00b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:16.740874 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb1274-4735-4d65-a60a-9288dd2c00b0 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:16.741157 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb1274-4735-4d65-a60a-9288dd2c00b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:16.741431 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb1274-4735-4d65-a60a-9288dd2c00b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:16.742096 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb1274-4735-4d65-a60a-9288dd2c00b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:16.742402 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb1274-4735-4d65-a60a-9288dd2c00b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:16.743824 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb1274-4735-4d65-a60a-9288dd2c00b0 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:16.758129 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 372/730] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:16.761428 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8c868-c095-4da0-8b8b-c2b898c56210 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:16.764235 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150d013-f672-4a05-a5f2-48d867b04c32 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:16.764531 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150d013-f672-4a05-a5f2-48d867b04c32 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:16.764818 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150d013-f672-4a05-a5f2-48d867b04c32 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:16.767101 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 373/731] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:31:16.767736 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150d013-f672-4a05-a5f2-48d867b04c32 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:16.821382 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fede82f-5751-44de-9474-352020422467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:16.822592 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fede82f-5751-44de-9474-352020422467 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:16.823114 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fede82f-5751-44de-9474-352020422467 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:16.823807 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fede82f-5751-44de-9474-352020422467 None admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:16.825087 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fede82f-5751-44de-9474-352020422467 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:16.825993 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fede82f-5751-44de-9474-352020422467 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:16.828291 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fede82f-5751-44de-9474-352020422467 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:16.831745 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:16.859141 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 359/732] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:16.859141 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b3096-d76b-4b24-b516-501d230d6bc1 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:16.859141 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b3096-d76b-4b24-b516-501d230d6bc1 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:16.859141 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b3096-d76b-4b24-b516-501d230d6bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:16.883243 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-043b3096-d76b-4b24-b516-501d230d6bc1 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:16.885040 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-043b3096-d76b-4b24-b516-501d230d6bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:16.901771 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150d013-f672-4a05-a5f2-48d867b04c32 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:16.948893 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47c974-0176-4a4f-acff-3d0a48ae0944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:16.949535 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47c974-0176-4a4f-acff-3d0a48ae0944 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:16.949815 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47c974-0176-4a4f-acff-3d0a48ae0944 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:16.950083 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47c974-0176-4a4f-acff-3d0a48ae0944 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:16.961493 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd47c974-0176-4a4f-acff-3d0a48ae0944 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:16.962936 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd47c974-0176-4a4f-acff-3d0a48ae0944 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:16.979363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-bd47c974-0176-4a4f-acff-3d0a48ae0944 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 26 07:31:16.979363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:16.979363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:16.979363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:16.979363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:16.979363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:16.979363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:16.979363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:16.979363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:16.979363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:16.979363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:16.979363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:16.979363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 07:31:16.979363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 07:31:16.979363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 07:31:16.979363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 07:31:16.980630 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:16.980630 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:16.980630 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 07:31:16.980630 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:31:16.980630 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 07:31:16.980630 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:31:16.980630 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:16.980630 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:16.980630 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:16.980630 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:16.980630 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:16.980630 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:16.980630 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:16.980630 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:16.980630 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:16.980630 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:16.980630 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:16.980630 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:16.981590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:16.981590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:16.981590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 07:31:16.981590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 07:31:16.981590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 07:31:16.981590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 07:31:16.981590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 07:31:16.981590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 07:31:16.981590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 26 07:31:16.981590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:16.981590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 374/733] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 26 07:31:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:16.982272 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47c974-0176-4a4f-acff-3d0a48ae0944 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:16.988902 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 360/734] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:31:16.988902 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b3096-d76b-4b24-b516-501d230d6bc1 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:17.093295 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:17.177322 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47c974-0176-4a4f-acff-3d0a48ae0944 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:17.184008 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:17.221664 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b3096-d76b-4b24-b516-501d230d6bc1 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:17.235049 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f52d98-4ec2-498f-a1f2-3bc589e3c7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:17.235728 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f52d98-4ec2-498f-a1f2-3bc589e3c7e1 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:17.236007 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f52d98-4ec2-498f-a1f2-3bc589e3c7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:17.236288 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f52d98-4ec2-498f-a1f2-3bc589e3c7e1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:17.244322 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f52d98-4ec2-498f-a1f2-3bc589e3c7e1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:17.245780 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f52d98-4ec2-498f-a1f2-3bc589e3c7e1 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:17.263848 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-f2f52d98-4ec2-498f-a1f2-3bc589e3c7e1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 07:31:17.263848 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:17.263848 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:17.263848 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:17.263848 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:17.263848 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:17.263848 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:17.263848 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:17.263848 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:17.263848 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:17.263848 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:17.263848 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:17.263848 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 07:31:17.263848 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 07:31:17.263848 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 07:31:17.263848 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 07:31:17.265473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:17.265473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:17.265473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 07:31:17.265473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:31:17.265473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 07:31:17.265473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:31:17.265473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:17.265473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:17.265473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:17.265473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:17.265473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:17.265473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:17.265473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:17.265473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:17.265473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:17.265473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:17.265473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:17.265473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:17.266842 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:17.266842 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:17.266842 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 07:31:17.266842 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 07:31:17.266842 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 07:31:17.266842 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 07:31:17.266842 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 07:31:17.266842 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 07:31:17.266842 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 07:31:17.266842 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:17.266842 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 375/735] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Aug 26 07:31:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:17.268649 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03d0cb-7221-4581-8a77-f3c2c07bf271 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:17.268649 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03d0cb-7221-4581-8a77-f3c2c07bf271 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:17.270702 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03d0cb-7221-4581-8a77-f3c2c07bf271 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:17.271606 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f763d-ad71-4671-a863-8e9cb193f8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:17.275007 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f763d-ad71-4671-a863-8e9cb193f8f4 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:17.275007 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f763d-ad71-4671-a863-8e9cb193f8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:17.275007 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f763d-ad71-4671-a863-8e9cb193f8f4 None admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:17.275007 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f763d-ad71-4671-a863-8e9cb193f8f4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:17.275007 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f763d-ad71-4671-a863-8e9cb193f8f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:17.275856 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f763d-ad71-4671-a863-8e9cb193f8f4 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:17.276007 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 376/736] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:31:17.276569 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03d0cb-7221-4581-8a77-f3c2c07bf271 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:17.301175 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 361/737] 10.222.0.42 () {56 vars in 1135 bytes} [Fri Aug 26 07:31:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:17.303068 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8483650-bb01-4019-a366-1f4efb861e82 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:17.303361 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8483650-bb01-4019-a366-1f4efb861e82 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:17.303634 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8483650-bb01-4019-a366-1f4efb861e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:17.328612 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-a8483650-bb01-4019-a366-1f4efb861e82 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:17.330241 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-a8483650-bb01-4019-a366-1f4efb861e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:17.403051 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 362/738] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:31:17.403254 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03d0cb-7221-4581-8a77-f3c2c07bf271 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:17.403907 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8483650-bb01-4019-a366-1f4efb861e82 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:17.445452 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b847ab-6812-4dc4-8a6a-ff3e1cda807b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:17.446270 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b847ab-6812-4dc4-8a6a-ff3e1cda807b None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:17.446806 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b847ab-6812-4dc4-8a6a-ff3e1cda807b None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:17.447110 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b847ab-6812-4dc4-8a6a-ff3e1cda807b None admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:17.448102 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b847ab-6812-4dc4-8a6a-ff3e1cda807b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:17.448435 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b847ab-6812-4dc4-8a6a-ff3e1cda807b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:17.450473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b847ab-6812-4dc4-8a6a-ff3e1cda807b None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:17.461162 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:17.472275 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 377/739] 10.222.0.42 () {56 vars in 1149 bytes} [Fri Aug 26 07:31:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:17.477174 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b847ab-6812-4dc4-8a6a-ff3e1cda807b None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:17.508346 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:17.533120 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8483650-bb01-4019-a366-1f4efb861e82 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:17.578077 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ccd85-4ce6-477e-898c-04f12c56998f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:17.579164 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ccd85-4ce6-477e-898c-04f12c56998f None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:17.579506 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ccd85-4ce6-477e-898c-04f12c56998f None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:17.579851 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ccd85-4ce6-477e-898c-04f12c56998f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:17.598873 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b847ab-6812-4dc4-8a6a-ff3e1cda807b None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:17.635604 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a858f-4b49-422e-abb8-60f0b2aaef5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:17.636218 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a858f-4b49-422e-abb8-60f0b2aaef5e None admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:17.636497 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a858f-4b49-422e-abb8-60f0b2aaef5e None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:17.636768 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a858f-4b49-422e-abb8-60f0b2aaef5e None admin] PATH_INFO: `/v3/services` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:17.637416 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488a858f-4b49-422e-abb8-60f0b2aaef5e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:17.638792 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488a858f-4b49-422e-abb8-60f0b2aaef5e None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:17.654791 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ccd85-4ce6-477e-898c-04f12c56998f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:17.657054 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ccd85-4ce6-477e-898c-04f12c56998f None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:17.702644 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:17.727710 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 378/740] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Aug 26 07:31:17 2022] POST /identity/v3/services => generated 251 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:31:17.735386 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53e536-eec2-45e7-8bc6-797eebcb95d4 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:17.735386 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53e536-eec2-45e7-8bc6-797eebcb95d4 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:17.735386 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53e536-eec2-45e7-8bc6-797eebcb95d4 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:17.735386 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 379/741] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:31:17.735386 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53e536-eec2-45e7-8bc6-797eebcb95d4 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:17.771608 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 363/742] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:31:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 07:31:17.771946 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ccd85-4ce6-477e-898c-04f12c56998f None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:17.849624 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:17.881969 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53e536-eec2-45e7-8bc6-797eebcb95d4 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:17.907665 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ccd85-4ce6-477e-898c-04f12c56998f None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:17.926200 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b4e0f-cc30-4537-bb7b-176beae799c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:17.926824 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b4e0f-cc30-4537-bb7b-176beae799c4 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:17.927263 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b4e0f-cc30-4537-bb7b-176beae799c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:17.927589 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b4e0f-cc30-4537-bb7b-176beae799c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:17.947043 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21648347-12f9-490a-9c8c-54f83dc71935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:17.947719 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21648347-12f9-490a-9c8c-54f83dc71935 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:17.947997 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21648347-12f9-490a-9c8c-54f83dc71935 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:17.948271 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21648347-12f9-490a-9c8c-54f83dc71935 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:17.956306 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:17.960442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21648347-12f9-490a-9c8c-54f83dc71935 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:31:17.965620 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-21648347-12f9-490a-9c8c-54f83dc71935 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:31:17.965620 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:17.965620 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:17.965620 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:17.965620 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:17.965620 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:17.965620 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:17.965620 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:17.965620 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:17.965620 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:17.965620 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:17.965620 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:17.965620 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:31:17.965620 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:31:17.965620 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:31:17.965620 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:31:17.966704 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:31:17.966704 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:31:17.966704 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:31:17.966704 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:31:17.966704 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:17.966704 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:17.966704 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:17.966704 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:17.966704 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:17.966704 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:17.966704 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:17.966704 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:17.966704 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:17.966704 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:17.966704 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:17.966704 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:17.967616 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:17.967616 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:17.967616 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:17.967616 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:17.967616 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:31:17.967616 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:31:17.967616 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:31:17.967616 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:31:17.967616 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:31:17.967616 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:31:17.967616 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:31:17.967616 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:17.967616 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 364/743] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 26 07:31:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:17.970334 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cec03b-dc18-4ca7-86ca-e009e19f390e None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:17.970334 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cec03b-dc18-4ca7-86ca-e009e19f390e None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:17.970334 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cec03b-dc18-4ca7-86ca-e009e19f390e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:17.988223 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-b3cec03b-dc18-4ca7-86ca-e009e19f390e None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:17.989456 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-b3cec03b-dc18-4ca7-86ca-e009e19f390e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:18.007978 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b4e0f-cc30-4537-bb7b-176beae799c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:18.009470 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b4e0f-cc30-4537-bb7b-176beae799c4 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:18.071017 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 365/744] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:17 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 07:31:18.071017 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cec03b-dc18-4ca7-86ca-e009e19f390e None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:18.111249 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:18.146614 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 380/745] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:31:17 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 07:31:18.147596 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b4e0f-cc30-4537-bb7b-176beae799c4 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:18.201337 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cec03b-dc18-4ca7-86ca-e009e19f390e None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:18.246390 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:18.252383 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead5250-9881-4fb1-8e57-522e9aa6f024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:18.253485 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead5250-9881-4fb1-8e57-522e9aa6f024 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:18.253984 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead5250-9881-4fb1-8e57-522e9aa6f024 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:18.254853 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead5250-9881-4fb1-8e57-522e9aa6f024 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:18.260128 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b4e0f-cc30-4537-bb7b-176beae799c4 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:18.268847 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead5250-9881-4fb1-8e57-522e9aa6f024 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:18.270317 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead5250-9881-4fb1-8e57-522e9aa6f024 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:18.286758 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-cead5250-9881-4fb1-8e57-522e9aa6f024 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:18.286758 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:18.286758 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:18.286758 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:18.286758 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:18.286758 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:18.286758 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:18.286758 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:18.286758 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:18.286758 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:18.286758 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:18.286758 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:18.286758 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:31:18.286758 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:31:18.286758 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:31:18.286758 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:31:18.287991 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:18.287991 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:18.287991 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:18.287991 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:18.287991 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:18.287991 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:18.287991 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:18.287991 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:18.287991 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:18.287991 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:18.287991 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:18.287991 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:18.287991 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:18.287991 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:18.287991 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:18.287991 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:18.287991 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:31:18.289073 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:31:18.289073 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:18.289073 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:18.289073 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 366/746] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:31:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:18.289305 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead5250-9881-4fb1-8e57-522e9aa6f024 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:18.308732 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b4135-def1-4f95-8ea5-0e01ab7216cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:18.309872 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b4135-def1-4f95-8ea5-0e01ab7216cc None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:18.310759 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b4135-def1-4f95-8ea5-0e01ab7216cc None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:18.311214 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b4135-def1-4f95-8ea5-0e01ab7216cc None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:18.312161 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b4135-def1-4f95-8ea5-0e01ab7216cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:18.312627 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b4135-def1-4f95-8ea5-0e01ab7216cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:18.314747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b4135-def1-4f95-8ea5-0e01ab7216cc None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:18.327086 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 381/747] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:31:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:18.329206 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b4135-def1-4f95-8ea5-0e01ab7216cc None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:18.386373 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:18.402519 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead5250-9881-4fb1-8e57-522e9aa6f024 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:18.437950 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149950c-514c-4221-b9ae-ea5dc4bae153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:18.438858 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149950c-514c-4221-b9ae-ea5dc4bae153 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:18.438858 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149950c-514c-4221-b9ae-ea5dc4bae153 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:18.439179 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149950c-514c-4221-b9ae-ea5dc4bae153 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:18.448478 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b4135-def1-4f95-8ea5-0e01ab7216cc None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:18.449838 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8149950c-514c-4221-b9ae-ea5dc4bae153 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:18.451306 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8149950c-514c-4221-b9ae-ea5dc4bae153 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:18.466099 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-8149950c-514c-4221-b9ae-ea5dc4bae153 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:18.466099 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:18.466099 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:18.466099 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:18.466099 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:18.466099 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:18.466099 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:18.466099 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:18.466099 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:18.466099 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:18.466099 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:18.466099 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:18.466099 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:31:18.466099 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:31:18.466099 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:31:18.466099 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:31:18.467191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:18.467191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:18.467191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:18.467191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:18.467191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:18.467191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:18.467191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:18.467191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:18.467191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:18.467191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:18.467191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:18.467191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:18.467191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:18.467191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:18.467191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:18.467191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:18.467191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:31:18.469019 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:31:18.469019 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:18.469019 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:18.469019 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 367/748] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:31:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:18.469019 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149950c-514c-4221-b9ae-ea5dc4bae153 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:18.492574 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a68ca-547d-48cb-a2df-75f0c1fe81f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:18.493203 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a68ca-547d-48cb-a2df-75f0c1fe81f5 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:18.493487 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a68ca-547d-48cb-a2df-75f0c1fe81f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:18.493763 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a68ca-547d-48cb-a2df-75f0c1fe81f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:18.494416 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549a68ca-547d-48cb-a2df-75f0c1fe81f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:18.494720 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549a68ca-547d-48cb-a2df-75f0c1fe81f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:18.496129 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549a68ca-547d-48cb-a2df-75f0c1fe81f5 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:18.508708 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 382/749] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:31:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:18.509427 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a68ca-547d-48cb-a2df-75f0c1fe81f5 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:18.514514 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:18.598301 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149950c-514c-4221-b9ae-ea5dc4bae153 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:18.631716 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:18.635024 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a68ca-547d-48cb-a2df-75f0c1fe81f5 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:18.635240 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cfa56-098d-43cc-a295-0d6433d1aecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:18.635881 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cfa56-098d-43cc-a295-0d6433d1aecb None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:18.636162 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cfa56-098d-43cc-a295-0d6433d1aecb None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:18.636433 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cfa56-098d-43cc-a295-0d6433d1aecb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:18.648531 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910cfa56-098d-43cc-a295-0d6433d1aecb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:18.649993 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910cfa56-098d-43cc-a295-0d6433d1aecb None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:18.665705 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-910cfa56-098d-43cc-a295-0d6433d1aecb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:18.665705 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:18.665705 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:18.665705 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:18.665705 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:18.665705 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:18.665705 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:18.665705 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:18.665705 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:18.665705 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:18.665705 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:18.665705 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:18.665705 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:31:18.665705 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:31:18.665705 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:31:18.665705 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:31:18.666739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:18.666739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:18.666739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:18.666739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:18.666739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:18.666739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:18.666739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:18.666739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:18.666739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:18.666739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:18.666739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:18.666739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:18.666739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:18.666739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:18.666739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:18.666739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:18.666739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:31:18.672844 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:31:18.672844 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:18.672844 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:18.672844 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 368/750] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:31:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:18.672844 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cfa56-098d-43cc-a295-0d6433d1aecb None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:18.678852 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb103f2-d646-40e2-865f-d5f54a9870ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:18.679505 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb103f2-d646-40e2-865f-d5f54a9870ac None admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:18.679788 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb103f2-d646-40e2-865f-d5f54a9870ac None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:18.680062 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb103f2-d646-40e2-865f-d5f54a9870ac None admin] PATH_INFO: `/v3/services` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:18.680713 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb103f2-d646-40e2-865f-d5f54a9870ac None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:18.682088 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb103f2-d646-40e2-865f-d5f54a9870ac None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:18.765103 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:18.771023 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 383/751] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Aug 26 07:31:18 2022] POST /identity/v3/services => generated 240 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:31:18.771023 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb103f2-d646-40e2-865f-d5f54a9870ac None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:18.786191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cfa56-098d-43cc-a295-0d6433d1aecb None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:18.840666 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f8990-f81d-45bc-956b-4f46e168fd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:18.841320 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f8990-f81d-45bc-956b-4f46e168fd9d None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:18.841600 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f8990-f81d-45bc-956b-4f46e168fd9d None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:18.841873 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f8990-f81d-45bc-956b-4f46e168fd9d None admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:18.842548 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f8990-f81d-45bc-956b-4f46e168fd9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:18.842906 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f8990-f81d-45bc-956b-4f46e168fd9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:18.844637 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f8990-f81d-45bc-956b-4f46e168fd9d None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:18.859855 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 369/752] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:31:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:18.860994 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f8990-f81d-45bc-956b-4f46e168fd9d None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:18.902138 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb103f2-d646-40e2-865f-d5f54a9870ac None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:18.941346 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4da3b-532a-4f5a-a0b0-abd74a2c85fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:18.942541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4da3b-532a-4f5a-a0b0-abd74a2c85fb None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:18.942827 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4da3b-532a-4f5a-a0b0-abd74a2c85fb None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:18.943508 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4da3b-532a-4f5a-a0b0-abd74a2c85fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:18.953586 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4da3b-532a-4f5a-a0b0-abd74a2c85fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:18.955422 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4da3b-532a-4f5a-a0b0-abd74a2c85fb None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:18.970757 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-b1d4da3b-532a-4f5a-a0b0-abd74a2c85fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:31:18.970757 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:18.970757 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:18.970757 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:18.970757 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:18.970757 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:18.970757 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:18.970757 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:18.970757 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:18.970757 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:18.970757 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:18.970757 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:18.970757 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 07:31:18.970757 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 07:31:18.970757 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 07:31:18.971858 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 07:31:18.971858 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:18.971858 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:18.971858 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:18.971858 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:18.971858 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:18.971858 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:18.971858 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:18.971858 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:18.971858 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:18.971858 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:18.971858 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:18.971858 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:18.971858 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:18.971858 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:18.971858 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:18.971858 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:18.972753 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 07:31:18.972753 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 07:31:18.972753 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 07:31:18.972753 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 07:31:18.972753 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 07:31:18.972753 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 07:31:18.972753 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:31:18.972753 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:18.972753 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 384/753] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:31:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:18.973286 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4da3b-532a-4f5a-a0b0-abd74a2c85fb None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:18.984632 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f8990-f81d-45bc-956b-4f46e168fd9d None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:19.005906 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:19.034519 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55569c-9580-44e6-883a-1502025fc119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:19.035757 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55569c-9580-44e6-883a-1502025fc119 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:19.036565 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55569c-9580-44e6-883a-1502025fc119 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:19.036989 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55569c-9580-44e6-883a-1502025fc119 None admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:19.038050 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55569c-9580-44e6-883a-1502025fc119 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:19.038496 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55569c-9580-44e6-883a-1502025fc119 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:19.040521 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55569c-9580-44e6-883a-1502025fc119 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:19.056690 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 370/754] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:31:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:19.057831 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55569c-9580-44e6-883a-1502025fc119 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:19.058825 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:19.100658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4da3b-532a-4f5a-a0b0-abd74a2c85fb None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:19.150870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4bd10e-b4c0-405f-9066-3936fe1b8bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:19.151699 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4bd10e-b4c0-405f-9066-3936fe1b8bfa None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:19.152104 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4bd10e-b4c0-405f-9066-3936fe1b8bfa None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:19.152491 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4bd10e-b4c0-405f-9066-3936fe1b8bfa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:19.162413 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4bd10e-b4c0-405f-9066-3936fe1b8bfa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:19.164437 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4bd10e-b4c0-405f-9066-3936fe1b8bfa None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:19.180550 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-1a4bd10e-b4c0-405f-9066-3936fe1b8bfa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:31:19.180550 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:19.180550 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:19.180550 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:19.180550 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:19.180550 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:19.180550 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:19.180550 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:19.180550 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:19.180550 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:19.180550 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:19.180550 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:19.180550 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 07:31:19.180550 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 07:31:19.180550 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 07:31:19.181658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 07:31:19.181658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:19.181658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:19.181658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:19.181658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:19.181658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:19.181658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:19.181658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:19.181658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:19.181658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:19.181658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:19.181658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:19.181658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:19.181658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:19.181658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:19.181658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:19.181658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:19.182747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 07:31:19.182747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 07:31:19.182747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 07:31:19.182747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 07:31:19.182747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 07:31:19.182747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 07:31:19.182747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:31:19.182747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:19.185037 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 385/755] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:31:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:19.186074 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4bd10e-b4c0-405f-9066-3936fe1b8bfa None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:19.192607 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55569c-9580-44e6-883a-1502025fc119 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:19.230168 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216993f-0b50-4690-9c68-c4d13499f635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:19.231767 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216993f-0b50-4690-9c68-c4d13499f635 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:19.232199 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216993f-0b50-4690-9c68-c4d13499f635 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:19.232643 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216993f-0b50-4690-9c68-c4d13499f635 None admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:19.234175 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216993f-0b50-4690-9c68-c4d13499f635 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:19.234641 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216993f-0b50-4690-9c68-c4d13499f635 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:19.237254 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216993f-0b50-4690-9c68-c4d13499f635 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:19.259177 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 371/756] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 26 07:31:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:19.259177 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216993f-0b50-4690-9c68-c4d13499f635 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:19.324099 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:19.329053 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:19.349382 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4bd10e-b4c0-405f-9066-3936fe1b8bfa None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:19.369748 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216993f-0b50-4690-9c68-c4d13499f635 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:19.393485 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca847cf-93ed-405b-bc15-22144ff438e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:19.394450 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca847cf-93ed-405b-bc15-22144ff438e3 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:19.394959 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca847cf-93ed-405b-bc15-22144ff438e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:19.395406 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca847cf-93ed-405b-bc15-22144ff438e3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:19.403899 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca847cf-93ed-405b-bc15-22144ff438e3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:19.405941 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca847cf-93ed-405b-bc15-22144ff438e3 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:19.406701 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2b9d0-6867-4a06-a338-ae87cfbb05b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:19.407460 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2b9d0-6867-4a06-a338-ae87cfbb05b2 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:19.407831 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2b9d0-6867-4a06-a338-ae87cfbb05b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:19.408200 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2b9d0-6867-4a06-a338-ae87cfbb05b2 None admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:19.409008 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a2b9d0-6867-4a06-a338-ae87cfbb05b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:19.409406 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a2b9d0-6867-4a06-a338-ae87cfbb05b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:19.410957 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a2b9d0-6867-4a06-a338-ae87cfbb05b2 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:19.420870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-eca847cf-93ed-405b-bc15-22144ff438e3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 07:31:19.420870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:19.420870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:19.420870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:19.420870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:19.420870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:19.420870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:19.420870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:19.420870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:19.420870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:19.420870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:19.420870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:19.420870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 07:31:19.420870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 07:31:19.420870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 07:31:19.420870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 07:31:19.422933 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:19.422933 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:19.422933 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 07:31:19.422933 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:31:19.422933 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 07:31:19.422933 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:31:19.422933 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:19.422933 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:19.422933 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:19.422933 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:19.422933 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:19.422933 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:19.422933 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:19.422933 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:19.422933 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:19.422933 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:19.422933 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:19.422933 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:19.424148 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:19.424148 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:19.424148 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 07:31:19.424148 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 07:31:19.424148 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 07:31:19.424148 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 07:31:19.424148 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 07:31:19.424148 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 07:31:19.424148 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 07:31:19.424148 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:19.426489 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 386/757] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Aug 26 07:31:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:19.427188 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 372/758] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 26 07:31:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:19.427754 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca847cf-93ed-405b-bc15-22144ff438e3 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:19.431583 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2b9d0-6867-4a06-a338-ae87cfbb05b2 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:19.535338 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2b9d0-6867-4a06-a338-ae87cfbb05b2 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:19.544445 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca847cf-93ed-405b-bc15-22144ff438e3 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:19.557090 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:19.571718 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cbaaa2-cbe8-4b80-8648-a4055c98cc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:19.572443 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbaaa2-cbe8-4b80-8648-a4055c98cc36 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:19.572780 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbaaa2-cbe8-4b80-8648-a4055c98cc36 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:19.573134 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbaaa2-cbe8-4b80-8648-a4055c98cc36 None admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:19.573919 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cbaaa2-cbe8-4b80-8648-a4055c98cc36 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:19.579265 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cbaaa2-cbe8-4b80-8648-a4055c98cc36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:19.579265 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cbaaa2-cbe8-4b80-8648-a4055c98cc36 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:19.587255 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c4d50-3676-4fb4-9816-186d54f3cbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:19.588157 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c4d50-3676-4fb4-9816-186d54f3cbda None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:19.588630 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c4d50-3676-4fb4-9816-186d54f3cbda None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:19.589105 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c4d50-3676-4fb4-9816-186d54f3cbda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:19.590024 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c4d50-3676-4fb4-9816-186d54f3cbda None admin] RBAC: Adding query filter params (role.id=07ed857b2feb472f9fa9e7fe0b08582b, scope.project.id=becbf57e91454d499dec313ff9eadfae, user.id=3142255c263e44a189db82c621f87e7d) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:19.590548 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c4d50-3676-4fb4-9816-186d54f3cbda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:19.592450 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c4d50-3676-4fb4-9816-186d54f3cbda None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:19.595627 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 373/759] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Aug 26 07:31:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:19.596602 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cbaaa2-cbe8-4b80-8648-a4055c98cc36 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:19.607268 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 387/760] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:31:19 2022] GET /identity/v3/role_assignments?user.id=3142255c263e44a189db82c621f87e7d&scope.project.id=becbf57e91454d499dec313ff9eadfae&role.id=07ed857b2feb472f9fa9e7fe0b08582b => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:19.609520 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c4d50-3676-4fb4-9816-186d54f3cbda None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:19.614909 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:19.771707 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c4d50-3676-4fb4-9816-186d54f3cbda None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:19.782834 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cbaaa2-cbe8-4b80-8648-a4055c98cc36 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:19.815152 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858ea6e-8953-447a-ac98-995ea6af80bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:19.815798 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858ea6e-8953-447a-ac98-995ea6af80bf None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:19.816077 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858ea6e-8953-447a-ac98-995ea6af80bf None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:19.816351 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858ea6e-8953-447a-ac98-995ea6af80bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:19.828866 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858ea6e-8953-447a-ac98-995ea6af80bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:19.830515 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858ea6e-8953-447a-ac98-995ea6af80bf None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:19.835778 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6eedb0-b226-442f-b158-392ebc2bee94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:19.836501 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6eedb0-b226-442f-b158-392ebc2bee94 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:19.836876 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6eedb0-b226-442f-b158-392ebc2bee94 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:19.837780 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6eedb0-b226-442f-b158-392ebc2bee94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:19.838609 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6eedb0-b226-442f-b158-392ebc2bee94 None admin] RBAC: Adding query filter params (role.id=aad163eaa5c8447ca5d5a7d5d861395a, scope.project.id=becbf57e91454d499dec313ff9eadfae, user.id=30dc2621143f4604b53bb44b82e8efbb) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:19.839474 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6eedb0-b226-442f-b158-392ebc2bee94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:19.841330 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6eedb0-b226-442f-b158-392ebc2bee94 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:19.845617 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-e858ea6e-8953-447a-ac98-995ea6af80bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:19.845617 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:19.845617 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:19.845617 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:19.845617 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:19.845617 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:19.845617 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:19.845617 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:19.845617 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:19.845617 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:19.845617 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:19.845617 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:19.845617 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:31:19.845617 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:31:19.845617 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:31:19.845617 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:31:19.846924 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:19.846924 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:19.846924 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:19.846924 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:19.846924 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:19.846924 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:19.846924 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:19.846924 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:19.846924 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:19.846924 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:19.846924 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:19.846924 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:19.846924 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:19.846924 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:19.846924 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:19.846924 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:19.846924 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:31:19.849284 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:31:19.849284 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:19.849284 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:19.849284 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 388/761] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:31:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:19.849284 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16336ba4-c78b-49fd-8ebd-2f0816a06ac7 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:19.849284 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16336ba4-c78b-49fd-8ebd-2f0816a06ac7 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:19.849284 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16336ba4-c78b-49fd-8ebd-2f0816a06ac7 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:19.854067 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 389/762] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:31:19.854723 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16336ba4-c78b-49fd-8ebd-2f0816a06ac7 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:19.856151 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 374/763] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:31:19 2022] GET /identity/v3/role_assignments?user.id=30dc2621143f4604b53bb44b82e8efbb&scope.project.id=becbf57e91454d499dec313ff9eadfae&role.id=aad163eaa5c8447ca5d5a7d5d861395a => generated 259 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:19.858033 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aead805-4257-4e20-8e44-15c9c950a672 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:19.858316 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aead805-4257-4e20-8e44-15c9c950a672 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:19.859701 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aead805-4257-4e20-8e44-15c9c950a672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:19.882103 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-8aead805-4257-4e20-8e44-15c9c950a672 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:19.883488 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-8aead805-4257-4e20-8e44-15c9c950a672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:19.971309 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:20.020016 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:20.053812 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 375/764] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:31:20.091590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16336ba4-c78b-49fd-8ebd-2f0816a06ac7 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:20.138539 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974eefa5-8602-4011-b43b-2ed67a085dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:20.139555 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974eefa5-8602-4011-b43b-2ed67a085dd3 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:20.140579 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974eefa5-8602-4011-b43b-2ed67a085dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:20.141044 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974eefa5-8602-4011-b43b-2ed67a085dd3 None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:20.141889 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974eefa5-8602-4011-b43b-2ed67a085dd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:20.142407 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974eefa5-8602-4011-b43b-2ed67a085dd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:20.144073 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974eefa5-8602-4011-b43b-2ed67a085dd3 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:20.161101 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 390/765] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:31:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:20.166903 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aead805-4257-4e20-8e44-15c9c950a672 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:20.320423 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aead805-4257-4e20-8e44-15c9c950a672 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:20.368875 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157c253-0773-4268-94d2-e2ffb23e90ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:20.369524 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157c253-0773-4268-94d2-e2ffb23e90ab None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:20.369805 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157c253-0773-4268-94d2-e2ffb23e90ab None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:20.370076 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157c253-0773-4268-94d2-e2ffb23e90ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:20.380688 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9157c253-0773-4268-94d2-e2ffb23e90ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:20.382218 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9157c253-0773-4268-94d2-e2ffb23e90ab None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:20.393727 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974eefa5-8602-4011-b43b-2ed67a085dd3 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:20.396178 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-9157c253-0773-4268-94d2-e2ffb23e90ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:31:20.396178 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:20.396178 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:20.396178 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:20.396178 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:20.396178 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:20.396178 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:20.396178 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:20.396178 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:20.396178 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:20.396178 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:20.396178 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:20.396178 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 07:31:20.396178 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 07:31:20.396178 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 07:31:20.397044 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 07:31:20.397044 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:20.397044 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:20.397044 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:20.397044 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:20.397044 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:20.397044 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:20.397044 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:20.397044 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:20.397044 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:20.397044 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:20.397044 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:20.397044 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:20.397044 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:20.397044 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:20.397044 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:20.397044 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:20.397915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 07:31:20.397915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 07:31:20.397915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 07:31:20.397915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 07:31:20.397915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 07:31:20.397915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 07:31:20.397915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:31:20.397915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:20.397915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 376/766] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:31:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:20.402968 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157c253-0773-4268-94d2-e2ffb23e90ab None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:20.444332 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:20.571084 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974eefa5-8602-4011-b43b-2ed67a085dd3 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:20.579101 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157c253-0773-4268-94d2-e2ffb23e90ab None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:20.590290 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:20.636670 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765a22d-358b-4442-9eb1-9dd3b6089aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:20.637239 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765a22d-358b-4442-9eb1-9dd3b6089aa2 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:20.637521 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765a22d-358b-4442-9eb1-9dd3b6089aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:20.637797 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765a22d-358b-4442-9eb1-9dd3b6089aa2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:20.638401 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9765a22d-358b-4442-9eb1-9dd3b6089aa2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:20.645398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9765a22d-358b-4442-9eb1-9dd3b6089aa2 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:20.651509 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f743ef-35be-47ee-a456-a7ba561505c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:20.652128 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f743ef-35be-47ee-a456-a7ba561505c0 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:20.652411 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f743ef-35be-47ee-a456-a7ba561505c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:20.652685 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f743ef-35be-47ee-a456-a7ba561505c0 None admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:20.653383 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f743ef-35be-47ee-a456-a7ba561505c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:20.653692 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f743ef-35be-47ee-a456-a7ba561505c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:20.655143 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f743ef-35be-47ee-a456-a7ba561505c0 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:20.664400 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-9765a22d-358b-4442-9eb1-9dd3b6089aa2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 07:31:20.664400 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:20.664400 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 07:31:20.664400 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 07:31:20.664400 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 07:31:20.664400 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 07:31:20.664400 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 07:31:20.664400 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:31:20.664400 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 07:31:20.664400 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:20.664400 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 07:31:20.664400 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:20.664400 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:20.664400 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:20.664400 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:20.664400 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:20.664400 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:20.665398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:20.665398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:20.665398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:20.665398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:20.665398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:20.665398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:20.665398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 07:31:20.665398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 07:31:20.665398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 07:31:20.665398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 07:31:20.665398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:20.665398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:20.665398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:20.665398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:20.665398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:20.665398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:20.667181 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:20.667181 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:20.667181 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:20.667181 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:20.667181 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:20.667181 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:20.667181 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:20.667181 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:20.667181 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:20.667181 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:20.667181 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 07:31:20.667181 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:31:20.667181 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 07:31:20.667181 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:20.667181 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 391/767] 10.222.0.42 () {56 vars in 1129 bytes} [Fri Aug 26 07:31:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 07:31:20.674608 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765a22d-358b-4442-9eb1-9dd3b6089aa2 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:20.689642 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 377/768] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 26 07:31:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:31:20.695924 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f743ef-35be-47ee-a456-a7ba561505c0 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:20.846964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765a22d-358b-4442-9eb1-9dd3b6089aa2 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:20.881773 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:20.897701 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f743ef-35be-47ee-a456-a7ba561505c0 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:20.915043 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40b73b-7d85-4fdd-a6f0-f79ad500b293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:20.915666 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40b73b-7d85-4fdd-a6f0-f79ad500b293 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:20.915947 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40b73b-7d85-4fdd-a6f0-f79ad500b293 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:20.916220 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40b73b-7d85-4fdd-a6f0-f79ad500b293 None admin] PATH_INFO: `/v3/services` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:20.916865 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40b73b-7d85-4fdd-a6f0-f79ad500b293 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:20.917170 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40b73b-7d85-4fdd-a6f0-f79ad500b293 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:20.918596 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40b73b-7d85-4fdd-a6f0-f79ad500b293 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:20.924828 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 392/769] 10.222.0.42 () {56 vars in 1124 bytes} [Fri Aug 26 07:31:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:31:20.936671 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40b73b-7d85-4fdd-a6f0-f79ad500b293 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:20.941239 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e67c8-6841-4812-a087-94ab7bbedf4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:20.941906 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e67c8-6841-4812-a087-94ab7bbedf4a None admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:20.942186 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e67c8-6841-4812-a087-94ab7bbedf4a None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:20.942459 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e67c8-6841-4812-a087-94ab7bbedf4a None admin] PATH_INFO: `/v3/projects/becbf57e91454d499dec313ff9eadfae/users/bc92c0a0a2cc4722868e6877bac93ada/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:20.944670 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e67c8-6841-4812-a087-94ab7bbedf4a None admin] RBAC: Authorizing `identity:create_grant(project_id=becbf57e91454d499dec313ff9eadfae, user_id=bc92c0a0a2cc4722868e6877bac93ada, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:20.946114 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e67c8-6841-4812-a087-94ab7bbedf4a None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:20.991524 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:21.048367 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40b73b-7d85-4fdd-a6f0-f79ad500b293 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:21.057570 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 378/770] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 26 07:31:20 2022] PUT /identity/v3/projects/becbf57e91454d499dec313ff9eadfae/users/bc92c0a0a2cc4722868e6877bac93ada/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:31:21.063904 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5b931-6264-431d-a839-62dbf1a8e352 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:21.064574 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5b931-6264-431d-a839-62dbf1a8e352 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:21.065448 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5b931-6264-431d-a839-62dbf1a8e352 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:21.072246 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 379/771] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:21 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:31:21.078094 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b70c8-497e-4cf9-a4c5-49f00f47eed0 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:21.078780 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b70c8-497e-4cf9-a4c5-49f00f47eed0 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:21.079608 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b70c8-497e-4cf9-a4c5-49f00f47eed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:21.103873 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-505b70c8-497e-4cf9-a4c5-49f00f47eed0 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:21.105746 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-505b70c8-497e-4cf9-a4c5-49f00f47eed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:21.136401 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0093f-2785-4a96-bc2f-86a4177c4baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:21.137017 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0093f-2785-4a96-bc2f-86a4177c4baf None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:21.137295 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0093f-2785-4a96-bc2f-86a4177c4baf None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:21.137564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0093f-2785-4a96-bc2f-86a4177c4baf None admin] PATH_INFO: `/v3/services` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:21.138205 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a0093f-2785-4a96-bc2f-86a4177c4baf None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:21.138508 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a0093f-2785-4a96-bc2f-86a4177c4baf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:21.140489 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a0093f-2785-4a96-bc2f-86a4177c4baf None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:21.157033 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 393/772] 10.222.0.42 () {56 vars in 1124 bytes} [Fri Aug 26 07:31:20 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:21.168503 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0093f-2785-4a96-bc2f-86a4177c4baf None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:21.203959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 380/773] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:31:21.346866 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0093f-2785-4a96-bc2f-86a4177c4baf None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:21.356784 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:21.386322 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac114f9c-2313-4efa-a837-12a5bef67d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:21.386946 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac114f9c-2313-4efa-a837-12a5bef67d53 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:21.387249 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac114f9c-2313-4efa-a837-12a5bef67d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:21.387515 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac114f9c-2313-4efa-a837-12a5bef67d53 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:21.388286 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac114f9c-2313-4efa-a837-12a5bef67d53 None admin] RBAC: Adding query filter params (interface=public, service_id=59e363e5a4ad4de799a4671e682b9b80, region_id=RegionOne) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:21.388592 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac114f9c-2313-4efa-a837-12a5bef67d53 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:21.390171 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac114f9c-2313-4efa-a837-12a5bef67d53 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:21.399269 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 394/774] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Aug 26 07:31:21 2022] GET /identity/v3/endpoints?service_id=59e363e5a4ad4de799a4671e682b9b80&interface=public®ion_id=RegionOne => generated 194 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:21.404978 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b70c8-497e-4cf9-a4c5-49f00f47eed0 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:21.501246 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:21.524556 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b70c8-497e-4cf9-a4c5-49f00f47eed0 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:21.570138 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d9c8d-15e3-4e91-935f-25a633b47ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:21.570771 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d9c8d-15e3-4e91-935f-25a633b47ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:21.571076 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d9c8d-15e3-4e91-935f-25a633b47ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:21.571349 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d9c8d-15e3-4e91-935f-25a633b47ad6 None admin] PATH_INFO: `/v3/services` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:21.572062 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d9c8d-15e3-4e91-935f-25a633b47ad6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:21.573437 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d9c8d-15e3-4e91-935f-25a633b47ad6 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:21.580027 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 381/775] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Aug 26 07:31:21 2022] GET /identity/v3/services => generated 772 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:21.596330 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac114f9c-2313-4efa-a837-12a5bef67d53 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:21.734885 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac114f9c-2313-4efa-a837-12a5bef67d53 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:21.785736 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a355e2-48b8-4f0e-bc48-b1d4c4106be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:21.786391 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a355e2-48b8-4f0e-bc48-b1d4c4106be7 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:21.786670 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a355e2-48b8-4f0e-bc48-b1d4c4106be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:21.786942 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a355e2-48b8-4f0e-bc48-b1d4c4106be7 None admin] PATH_INFO: `/v3/services/network` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:21.787560 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a355e2-48b8-4f0e-bc48-b1d4c4106be7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:21.788925 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a355e2-48b8-4f0e-bc48-b1d4c4106be7 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:21.803252 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-e6a355e2-48b8-4f0e-bc48-b1d4c4106be7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 07:31:21.803252 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:21.803252 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 07:31:21.803252 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 07:31:21.803252 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 07:31:21.803252 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 07:31:21.803252 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 07:31:21.803252 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:31:21.803252 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 07:31:21.803252 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:21.803252 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 07:31:21.803252 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:21.803252 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:21.803252 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:21.803252 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:21.803252 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:21.803252 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:21.804315 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:21.804315 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:21.804315 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:21.804315 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:21.804315 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:21.804315 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:21.804315 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 07:31:21.804315 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 07:31:21.804315 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 07:31:21.804315 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 07:31:21.804315 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:21.804315 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:21.804315 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:21.804315 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:21.804315 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:21.804315 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:21.805759 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:21.805759 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:21.805759 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:21.805759 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:21.805759 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:21.805759 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:21.805759 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:21.805759 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:21.805759 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:21.805759 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:21.805759 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 07:31:21.805759 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:31:21.805759 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 07:31:21.805759 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:21.805759 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 395/776] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:31:21 2022] GET /identity/v3/services/network => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:21.810487 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d9c8d-15e3-4e91-935f-25a633b47ad6 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:21.937593 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60e558-5290-474c-8f18-e1e13e462f93 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:21.937922 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60e558-5290-474c-8f18-e1e13e462f93 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:21.938138 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60e558-5290-474c-8f18-e1e13e462f93 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:21.939803 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 396/777] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:31:21.945665 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73eab68-294d-4032-a02d-8904657110a2 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:21.945944 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73eab68-294d-4032-a02d-8904657110a2 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:21.946215 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73eab68-294d-4032-a02d-8904657110a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:21.966323 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d9c8d-15e3-4e91-935f-25a633b47ad6 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:22.011810 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705741f-5ffe-42f6-987e-5d2468e8264b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:22.012458 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705741f-5ffe-42f6-987e-5d2468e8264b None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:22.012735 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705741f-5ffe-42f6-987e-5d2468e8264b None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:22.013003 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705741f-5ffe-42f6-987e-5d2468e8264b None admin] PATH_INFO: `/v3/services` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:22.013659 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d705741f-5ffe-42f6-987e-5d2468e8264b None admin] RBAC: Adding query filter params (name=network) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:22.013964 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d705741f-5ffe-42f6-987e-5d2468e8264b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:22.016363 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d705741f-5ffe-42f6-987e-5d2468e8264b None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:22.023302 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 382/778] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Aug 26 07:31:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:22.030208 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705741f-5ffe-42f6-987e-5d2468e8264b None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:22.071396 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:22.094797 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-e73eab68-294d-4032-a02d-8904657110a2 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:22.096078 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-e73eab68-294d-4032-a02d-8904657110a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:22.147505 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:22.179767 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705741f-5ffe-42f6-987e-5d2468e8264b None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:22.220088 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57417f-a5ed-4fce-a679-d05ce9ecc0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:22.220816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57417f-a5ed-4fce-a679-d05ce9ecc0bc None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:22.221102 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57417f-a5ed-4fce-a679-d05ce9ecc0bc None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:22.221368 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57417f-a5ed-4fce-a679-d05ce9ecc0bc None admin] PATH_INFO: `/v3/services` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:22.222015 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57417f-a5ed-4fce-a679-d05ce9ecc0bc None admin] RBAC: Adding query filter params (type=network) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:22.222318 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57417f-a5ed-4fce-a679-d05ce9ecc0bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:22.223278 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 397/779] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 07:31:22.223733 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57417f-a5ed-4fce-a679-d05ce9ecc0bc None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:22.230675 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 383/780] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Aug 26 07:31:22 2022] GET /identity/v3/services?type=network => generated 350 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:22.236669 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73eab68-294d-4032-a02d-8904657110a2 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:22.245674 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8c879-f5aa-4c41-b4f5-bcb8f0b30e8b None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:22.245967 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8c879-f5aa-4c41-b4f5-bcb8f0b30e8b None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:22.246242 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8c879-f5aa-4c41-b4f5-bcb8f0b30e8b None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:22.247610 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 384/781] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 07:31:22.255721 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548873a-77c9-47f9-96fa-717a90beddfb None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:22.256006 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548873a-77c9-47f9-96fa-717a90beddfb None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:22.256284 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548873a-77c9-47f9-96fa-717a90beddfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:22.288672 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-6548873a-77c9-47f9-96fa-717a90beddfb None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:22.289811 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-6548873a-77c9-47f9-96fa-717a90beddfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:22.419227 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 385/782] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:31:22.439036 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73eab68-294d-4032-a02d-8904657110a2 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:22.494150 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4e12db-a977-4df0-b1c2-bc30d6402978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:22.494769 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e12db-a977-4df0-b1c2-bc30d6402978 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:22.495068 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e12db-a977-4df0-b1c2-bc30d6402978 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:22.495336 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e12db-a977-4df0-b1c2-bc30d6402978 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:22.496043 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4e12db-a977-4df0-b1c2-bc30d6402978 None admin] RBAC: Adding query filter params (interface=public, service_id=6f6f5fe5490741e3b1f6ca0d18babf49, region_id=RegionOne) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:22.496346 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4e12db-a977-4df0-b1c2-bc30d6402978 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:22.497721 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4e12db-a977-4df0-b1c2-bc30d6402978 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:22.504098 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 398/783] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Aug 26 07:31:22 2022] GET /identity/v3/endpoints?service_id=6f6f5fe5490741e3b1f6ca0d18babf49&interface=public®ion_id=RegionOne => generated 194 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:22.509573 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548873a-77c9-47f9-96fa-717a90beddfb None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:22.519615 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:22.579684 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4e12db-a977-4df0-b1c2-bc30d6402978 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:22.615374 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:22.625878 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548873a-77c9-47f9-96fa-717a90beddfb None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:22.685835 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0cf9c-7f68-43f7-80ac-e739a3021567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:22.686461 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0cf9c-7f68-43f7-80ac-e739a3021567 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:22.687534 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0cf9c-7f68-43f7-80ac-e739a3021567 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:22.687712 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0cf9c-7f68-43f7-80ac-e739a3021567 None admin] PATH_INFO: `/v3/services` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:22.688313 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d0cf9c-7f68-43f7-80ac-e739a3021567 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:22.689591 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4e12db-a977-4df0-b1c2-bc30d6402978 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:22.689795 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d0cf9c-7f68-43f7-80ac-e739a3021567 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:22.704748 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 386/784] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Aug 26 07:31:22 2022] GET /identity/v3/services => generated 772 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:22.751183 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ce47c-3c99-46ea-9f9a-ce1e1b966598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:22.751838 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ce47c-3c99-46ea-9f9a-ce1e1b966598 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:22.752114 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ce47c-3c99-46ea-9f9a-ce1e1b966598 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:22.752382 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ce47c-3c99-46ea-9f9a-ce1e1b966598 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:22.752811 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0cf9c-7f68-43f7-80ac-e739a3021567 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:22.772851 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ce47c-3c99-46ea-9f9a-ce1e1b966598 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:31:22.783398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-ce9ce47c-3c99-46ea-9f9a-ce1e1b966598 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:31:22.783398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:22.783398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:22.783398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:22.783398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:22.783398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:22.783398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:22.783398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:22.783398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:22.783398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:22.783398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:22.783398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:22.783398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:31:22.783398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:31:22.783398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:31:22.783398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:31:22.784396 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:31:22.784396 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:31:22.784396 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:31:22.784396 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:31:22.784396 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:22.784396 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:22.784396 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:22.784396 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:22.784396 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:22.784396 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:22.784396 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:22.784396 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:22.784396 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:22.784396 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:22.784396 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:22.784396 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:22.785278 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:22.785278 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:22.785278 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:22.785278 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:22.785278 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:31:22.785278 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:31:22.785278 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:31:22.785278 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:31:22.785278 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:31:22.785278 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:31:22.785278 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:31:22.785278 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:22.791794 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 399/785] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 26 07:31:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 07:31:22.794272 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ce47c-3c99-46ea-9f9a-ce1e1b966598 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:22.976605 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:22.987198 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ce47c-3c99-46ea-9f9a-ce1e1b966598 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:23.001093 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:23.037470 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba009b-8b83-41bc-8812-8259ed1207d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:23.038091 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba009b-8b83-41bc-8812-8259ed1207d6 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:23.038372 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba009b-8b83-41bc-8812-8259ed1207d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:23.038807 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba009b-8b83-41bc-8812-8259ed1207d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:23.039909 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba009b-8b83-41bc-8812-8259ed1207d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:23.040492 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba009b-8b83-41bc-8812-8259ed1207d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:23.041917 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba009b-8b83-41bc-8812-8259ed1207d6 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:23.042244 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0cf9c-7f68-43f7-80ac-e739a3021567 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:23.054838 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 400/786] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:31:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:23.061135 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba009b-8b83-41bc-8812-8259ed1207d6 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:23.086418 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c842a0d-d877-4171-9523-83b99399e122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:23.087116 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c842a0d-d877-4171-9523-83b99399e122 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:23.087391 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c842a0d-d877-4171-9523-83b99399e122 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:23.087705 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c842a0d-d877-4171-9523-83b99399e122 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:23.099899 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c842a0d-d877-4171-9523-83b99399e122 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:31:23.105090 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-9c842a0d-d877-4171-9523-83b99399e122 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 07:31:23.105090 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:23.105090 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:23.105090 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:23.105090 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:23.105090 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:23.105090 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:23.105090 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:23.105090 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:23.105090 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:23.105090 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:23.105090 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:23.105090 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:31:23.105090 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:31:23.105090 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:31:23.105090 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:31:23.106284 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:31:23.106284 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:31:23.106284 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:31:23.106284 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:31:23.106284 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:23.106284 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:23.106284 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:23.106284 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:23.106284 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:23.106284 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:23.106284 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:23.106284 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:23.106284 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:23.106284 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:23.106284 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:23.106284 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:23.107217 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:23.107217 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:23.107217 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:23.107217 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:23.107217 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:31:23.107217 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:31:23.107217 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:31:23.107217 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:31:23.107217 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:31:23.107217 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:31:23.107217 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 07:31:23.107217 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:23.107217 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 387/787] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 26 07:31:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 07:31:23.116172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c842a0d-d877-4171-9523-83b99399e122 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:23.262420 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba009b-8b83-41bc-8812-8259ed1207d6 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:23.289287 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c842a0d-d877-4171-9523-83b99399e122 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:23.347731 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a139e3-09ef-4561-bbec-4f9405864705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:23.348619 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a139e3-09ef-4561-bbec-4f9405864705 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:23.348783 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a139e3-09ef-4561-bbec-4f9405864705 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:23.349059 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a139e3-09ef-4561-bbec-4f9405864705 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:23.354139 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:23.360241 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05009f5c-0c0c-4589-8134-e3057ab20497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:23.361093 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05009f5c-0c0c-4589-8134-e3057ab20497 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:23.361524 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05009f5c-0c0c-4589-8134-e3057ab20497 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:23.361971 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05009f5c-0c0c-4589-8134-e3057ab20497 None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:23.362804 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05009f5c-0c0c-4589-8134-e3057ab20497 None admin] RBAC: Adding query filter params (name=service) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:23.363283 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05009f5c-0c0c-4589-8134-e3057ab20497 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:23.364815 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05009f5c-0c0c-4589-8134-e3057ab20497 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:23.375832 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 388/788] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 26 07:31:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:23.380213 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a139e3-09ef-4561-bbec-4f9405864705 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:23.381248 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05009f5c-0c0c-4589-8134-e3057ab20497 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:23.383328 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a139e3-09ef-4561-bbec-4f9405864705 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:23.412794 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-d7a139e3-09ef-4561-bbec-4f9405864705 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:23.412794 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:23.412794 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:23.412794 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:23.412794 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:23.412794 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:23.412794 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:23.412794 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:23.412794 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:23.412794 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:23.412794 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:23.412794 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:23.412794 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:31:23.412794 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:31:23.412794 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:31:23.412794 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:31:23.415680 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:23.415680 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:23.415680 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:23.415680 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:23.415680 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:23.415680 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:23.415680 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:23.415680 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:23.415680 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:23.415680 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:23.415680 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:23.415680 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:23.415680 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:23.415680 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:23.415680 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:23.415680 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:23.415680 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:31:23.416781 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:31:23.416781 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:23.416781 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:23.427771 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 401/789] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:31:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:23.435734 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a139e3-09ef-4561-bbec-4f9405864705 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:23.455087 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:23.555335 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05009f5c-0c0c-4589-8134-e3057ab20497 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:23.564582 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a139e3-09ef-4561-bbec-4f9405864705 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:23.620667 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe0878-1b3d-45b0-9115-fda3b717b161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:23.621312 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe0878-1b3d-45b0-9115-fda3b717b161 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:23.621592 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe0878-1b3d-45b0-9115-fda3b717b161 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:23.621864 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe0878-1b3d-45b0-9115-fda3b717b161 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:23.631820 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b99a2-b351-4048-bea9-053f0c00e912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:23.633261 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b99a2-b351-4048-bea9-053f0c00e912 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:23.634025 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b99a2-b351-4048-bea9-053f0c00e912 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:23.634760 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b99a2-b351-4048-bea9-053f0c00e912 None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:23.635913 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b99a2-b351-4048-bea9-053f0c00e912 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:23.636584 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b99a2-b351-4048-bea9-053f0c00e912 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:23.641655 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b99a2-b351-4048-bea9-053f0c00e912 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:23.655642 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe0878-1b3d-45b0-9115-fda3b717b161 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:23.657737 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe0878-1b3d-45b0-9115-fda3b717b161 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:23.673758 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 402/790] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:31:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:23.679161 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b99a2-b351-4048-bea9-053f0c00e912 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:23.696887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-49fe0878-1b3d-45b0-9115-fda3b717b161 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:23.696887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:23.696887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:23.696887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:23.696887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:23.696887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:23.696887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:23.696887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:23.696887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:23.696887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:23.696887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:23.696887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:23.696887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:31:23.696887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:31:23.696887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:31:23.696887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:31:23.697928 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:23.697928 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:23.697928 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:23.697928 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:23.697928 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:23.697928 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:23.697928 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:23.697928 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:23.697928 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:23.697928 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:23.697928 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:23.697928 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:23.697928 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:23.697928 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:23.697928 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:23.697928 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:23.697928 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:31:23.698831 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:31:23.698831 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:23.698831 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:23.701023 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 389/791] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:31:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:23.706887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe0878-1b3d-45b0-9115-fda3b717b161 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:23.825007 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:23.832071 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:23.879660 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b99a2-b351-4048-bea9-053f0c00e912 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:23.901046 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe0878-1b3d-45b0-9115-fda3b717b161 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:23.926094 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dff33c-2011-43d2-8465-809798e22e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:23.926740 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dff33c-2011-43d2-8465-809798e22e9f None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:23.927032 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dff33c-2011-43d2-8465-809798e22e9f None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:23.927438 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dff33c-2011-43d2-8465-809798e22e9f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:23.938144 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dff33c-2011-43d2-8465-809798e22e9f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:23.940021 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dff33c-2011-43d2-8465-809798e22e9f None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:23.952855 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac17c8-58d7-4989-9b18-b992829a593e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:23.953469 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac17c8-58d7-4989-9b18-b992829a593e None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:23.953856 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac17c8-58d7-4989-9b18-b992829a593e None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:23.954131 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac17c8-58d7-4989-9b18-b992829a593e None admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:23.954781 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac17c8-58d7-4989-9b18-b992829a593e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:23.955117 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac17c8-58d7-4989-9b18-b992829a593e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:23.955439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-49dff33c-2011-43d2-8465-809798e22e9f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 26 07:31:23.955439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:23.955439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:23.955439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:23.955439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:23.955439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:23.955439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:23.955439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:23.955439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:23.955439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:23.955439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:23.955439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:23.955439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 07:31:23.955439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 07:31:23.955439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 07:31:23.955439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 07:31:23.956329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:23.956329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:23.956329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 07:31:23.956329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:31:23.956329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 07:31:23.956329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:31:23.956329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:23.956329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:23.956329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:23.956329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:23.956329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:23.956329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:23.956329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:23.956329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:23.956329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:23.956329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:23.956329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:23.956329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:23.957253 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:23.957253 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:23.957253 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 07:31:23.957253 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 07:31:23.957253 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 07:31:23.957253 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 07:31:23.957253 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 07:31:23.957253 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 07:31:23.957253 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 26 07:31:23.957253 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:23.957777 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac17c8-58d7-4989-9b18-b992829a593e None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:23.957856 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 403/792] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 26 07:31:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:23.958383 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a81aa1-5ffe-49e1-a64e-2e32415b9098 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:23.958543 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a81aa1-5ffe-49e1-a64e-2e32415b9098 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:23.959016 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a81aa1-5ffe-49e1-a64e-2e32415b9098 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:23.960882 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 404/793] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:31:23.964879 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a81aa1-5ffe-49e1-a64e-2e32415b9098 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:23.974750 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 390/794] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:31:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:23.976141 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de0104-a03f-4197-ba9c-ba011f1ed4ca None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:23.976432 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de0104-a03f-4197-ba9c-ba011f1ed4ca None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:23.976709 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de0104-a03f-4197-ba9c-ba011f1ed4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:23.996972 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-d8de0104-a03f-4197-ba9c-ba011f1ed4ca None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:23.998508 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-d8de0104-a03f-4197-ba9c-ba011f1ed4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:24.079223 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 391/795] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:31:24.080182 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de0104-a03f-4197-ba9c-ba011f1ed4ca None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:24.103065 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a81aa1-5ffe-49e1-a64e-2e32415b9098 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:24.131327 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:24.144058 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5776bfe-09f7-4cdf-9ebe-1f8d72f9c359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:24.144886 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:24.146474 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5776bfe-09f7-4cdf-9ebe-1f8d72f9c359 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:24.146951 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5776bfe-09f7-4cdf-9ebe-1f8d72f9c359 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:24.147420 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5776bfe-09f7-4cdf-9ebe-1f8d72f9c359 None admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:24.148379 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5776bfe-09f7-4cdf-9ebe-1f8d72f9c359 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:24.148880 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5776bfe-09f7-4cdf-9ebe-1f8d72f9c359 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:24.150497 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5776bfe-09f7-4cdf-9ebe-1f8d72f9c359 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:24.188749 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 405/796] 10.222.0.42 () {56 vars in 1135 bytes} [Fri Aug 26 07:31:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:24.193135 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5776bfe-09f7-4cdf-9ebe-1f8d72f9c359 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:24.267663 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de0104-a03f-4197-ba9c-ba011f1ed4ca None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:24.309122 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4fd06-09d1-4af3-8373-ad4690513101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:24.310160 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4fd06-09d1-4af3-8373-ad4690513101 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:24.310602 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4fd06-09d1-4af3-8373-ad4690513101 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:24.310879 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4fd06-09d1-4af3-8373-ad4690513101 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:24.324165 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa4fd06-09d1-4af3-8373-ad4690513101 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:24.325746 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa4fd06-09d1-4af3-8373-ad4690513101 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:24.328716 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5776bfe-09f7-4cdf-9ebe-1f8d72f9c359 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:24.341336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-2fa4fd06-09d1-4af3-8373-ad4690513101 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 07:31:24.341336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:24.341336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:24.341336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:24.341336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:24.341336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:24.341336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:24.341336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:24.341336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:24.341336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:24.341336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:24.341336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:24.341336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 07:31:24.341336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 07:31:24.341336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 07:31:24.341336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 07:31:24.342430 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:24.342430 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:24.342430 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 07:31:24.342430 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:31:24.342430 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 07:31:24.342430 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:31:24.342430 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:24.342430 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:24.342430 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:24.342430 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:24.342430 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:24.342430 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:24.342430 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:24.342430 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:24.342430 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:24.342430 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:24.342430 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:24.342430 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:24.344159 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:24.344159 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:24.344159 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 07:31:24.344159 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 07:31:24.344159 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 07:31:24.344159 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 07:31:24.344159 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 07:31:24.344159 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 07:31:24.344159 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 07:31:24.344159 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:24.344159 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 392/797] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Aug 26 07:31:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:24.345505 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bc80e-caef-41c5-9812-9a3cd7647aa0 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:24.346074 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bc80e-caef-41c5-9812-9a3cd7647aa0 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:24.346353 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bc80e-caef-41c5-9812-9a3cd7647aa0 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:24.348171 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 393/798] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:31:24.349094 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7bc80e-caef-41c5-9812-9a3cd7647aa0 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:24.372203 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4660f4f-95a2-4098-b1b7-b6b6c5d0561a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:24.373398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4660f4f-95a2-4098-b1b7-b6b6c5d0561a None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:24.374573 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4660f4f-95a2-4098-b1b7-b6b6c5d0561a None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:24.375082 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4660f4f-95a2-4098-b1b7-b6b6c5d0561a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:24.386683 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4660f4f-95a2-4098-b1b7-b6b6c5d0561a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:24.388510 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4660f4f-95a2-4098-b1b7-b6b6c5d0561a None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:24.405029 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-d4660f4f-95a2-4098-b1b7-b6b6c5d0561a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:24.405029 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:24.405029 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:24.405029 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:24.405029 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:24.405029 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:24.405029 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:24.405029 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:24.405029 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:24.405029 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:24.405029 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:24.405029 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:24.405029 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:31:24.405029 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:31:24.405029 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:31:24.405029 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:31:24.406927 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:24.406927 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:24.406927 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:24.406927 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:24.406927 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:24.406927 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:24.406927 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:24.406927 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:24.406927 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:24.406927 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:24.406927 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:24.406927 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:24.406927 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:24.406927 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:24.406927 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:24.406927 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:24.406927 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:31:24.407870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:31:24.407870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:24.407870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:24.414767 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 406/799] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:31:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 07:31:24.416513 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7465cf-d9c4-41e0-8900-518f4e2ebc99 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:24.416993 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7465cf-d9c4-41e0-8900-518f4e2ebc99 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:24.417464 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7465cf-d9c4-41e0-8900-518f4e2ebc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:24.439736 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-4d7465cf-d9c4-41e0-8900-518f4e2ebc99 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:24.441046 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-4d7465cf-d9c4-41e0-8900-518f4e2ebc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:24.474417 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:24.477091 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:24.486910 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7bc80e-caef-41c5-9812-9a3cd7647aa0 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:24.518501 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 407/800] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:31:24.519393 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7465cf-d9c4-41e0-8900-518f4e2ebc99 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:24.541104 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c580c25-2d85-4cc2-ae90-f7231c3c86f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:24.541727 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c580c25-2d85-4cc2-ae90-f7231c3c86f0 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:24.542006 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c580c25-2d85-4cc2-ae90-f7231c3c86f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:24.542280 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c580c25-2d85-4cc2-ae90-f7231c3c86f0 None admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:24.543057 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c580c25-2d85-4cc2-ae90-f7231c3c86f0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:24.543364 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c580c25-2d85-4cc2-ae90-f7231c3c86f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:24.544934 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c580c25-2d85-4cc2-ae90-f7231c3c86f0 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:24.566662 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 394/801] 10.222.0.42 () {56 vars in 1149 bytes} [Fri Aug 26 07:31:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:24.572122 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c580c25-2d85-4cc2-ae90-f7231c3c86f0 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:24.666337 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7465cf-d9c4-41e0-8900-518f4e2ebc99 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:24.710165 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c580c25-2d85-4cc2-ae90-f7231c3c86f0 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:24.716883 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf1b3af-6168-4428-a256-8c560705973a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:24.718395 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1b3af-6168-4428-a256-8c560705973a None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:24.719008 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1b3af-6168-4428-a256-8c560705973a None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:24.719490 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1b3af-6168-4428-a256-8c560705973a None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:24.720422 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf1b3af-6168-4428-a256-8c560705973a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:24.720862 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf1b3af-6168-4428-a256-8c560705973a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:24.722757 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf1b3af-6168-4428-a256-8c560705973a None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:24.736710 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 408/802] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:24.737911 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf1b3af-6168-4428-a256-8c560705973a None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:24.762040 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a0396-f86f-47c7-b8ca-dfc7ed1dd602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:24.762040 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a0396-f86f-47c7-b8ca-dfc7ed1dd602 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:24.762040 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a0396-f86f-47c7-b8ca-dfc7ed1dd602 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:24.762040 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a0396-f86f-47c7-b8ca-dfc7ed1dd602 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:24.777239 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:24.784576 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70a0396-f86f-47c7-b8ca-dfc7ed1dd602 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:31:24.791419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-b70a0396-f86f-47c7-b8ca-dfc7ed1dd602 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:31:24.791419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:24.791419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:24.791419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:24.791419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:24.791419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:24.791419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:24.791419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:24.791419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:24.791419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:24.791419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:24.791419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:24.791419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:31:24.791419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:31:24.791419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:31:24.791419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:31:24.797221 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:31:24.797221 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:31:24.797221 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:31:24.797221 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:31:24.797221 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:24.797221 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:24.797221 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:24.797221 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:24.797221 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:24.797221 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:24.797221 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:24.797221 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:24.797221 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:24.797221 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:24.797221 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:24.797221 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:24.798648 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:24.798648 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:24.798648 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:24.798648 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:24.798648 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:31:24.798648 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:31:24.798648 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:31:24.798648 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:31:24.798648 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:31:24.798648 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:31:24.798648 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:31:24.798648 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:24.798648 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 395/803] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 26 07:31:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:24.798648 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a0396-f86f-47c7-b8ca-dfc7ed1dd602 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:24.813436 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:24.876208 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf1b3af-6168-4428-a256-8c560705973a None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:24.917005 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c944e0-8d70-420c-b928-12a82f08c388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:24.917561 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c944e0-8d70-420c-b928-12a82f08c388 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:24.917837 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c944e0-8d70-420c-b928-12a82f08c388 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:24.918038 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a0396-f86f-47c7-b8ca-dfc7ed1dd602 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:24.918160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c944e0-8d70-420c-b928-12a82f08c388 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:24.930731 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c944e0-8d70-420c-b928-12a82f08c388 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:24.932355 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c944e0-8d70-420c-b928-12a82f08c388 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:24.947994 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-a9c944e0-8d70-420c-b928-12a82f08c388 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:24.947994 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:24.947994 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:24.947994 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:24.947994 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:24.947994 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:24.947994 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:24.947994 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:24.947994 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:24.947994 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:24.947994 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:24.947994 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:24.947994 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:31:24.947994 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:31:24.947994 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:31:24.947994 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:31:24.949005 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:24.949005 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:24.949005 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:24.949005 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:24.949005 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:24.949005 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:24.949005 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:24.949005 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:24.949005 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:24.949005 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:24.949005 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:24.949005 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:24.949005 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:24.949005 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:24.949005 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:24.949005 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:24.949005 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:31:24.949897 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:31:24.949897 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:24.949897 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:24.949897 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 409/804] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:31:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:24.949897 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c944e0-8d70-420c-b928-12a82f08c388 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:24.968686 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67821644-0df1-4f01-8529-f072f4385467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:24.969742 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67821644-0df1-4f01-8529-f072f4385467 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:24.970191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67821644-0df1-4f01-8529-f072f4385467 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:24.970669 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67821644-0df1-4f01-8529-f072f4385467 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:24.978463 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67821644-0df1-4f01-8529-f072f4385467 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:24.980016 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67821644-0df1-4f01-8529-f072f4385467 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:24.992739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-67821644-0df1-4f01-8529-f072f4385467 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:31:24.992739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:24.992739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:24.992739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:24.992739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:24.992739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:24.992739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:24.992739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:24.992739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:24.992739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:24.992739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:24.992739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:24.992739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 07:31:24.992739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 07:31:24.992739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 07:31:24.993716 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 07:31:24.993716 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:24.993716 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:24.993716 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:24.993716 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:24.993716 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:24.993716 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:24.993716 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:24.993716 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:24.993716 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:24.993716 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:24.993716 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:24.993716 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:24.993716 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:24.993716 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:24.993716 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:24.993716 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:24.994627 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 07:31:24.994627 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 07:31:24.994627 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 07:31:24.994627 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 07:31:24.994627 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 07:31:24.994627 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 07:31:24.994627 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:31:24.994627 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:24.998680 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 396/805] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:31:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:25.000428 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67821644-0df1-4f01-8529-f072f4385467 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:25.040761 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:25.068267 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c944e0-8d70-420c-b928-12a82f08c388 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:25.087618 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:25.106324 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cfe1d8-2de9-40b3-a074-7e95dca871cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:25.106941 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cfe1d8-2de9-40b3-a074-7e95dca871cd None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:25.107250 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cfe1d8-2de9-40b3-a074-7e95dca871cd None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:25.107524 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cfe1d8-2de9-40b3-a074-7e95dca871cd None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:25.108199 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cfe1d8-2de9-40b3-a074-7e95dca871cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:25.108528 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cfe1d8-2de9-40b3-a074-7e95dca871cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:25.109922 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cfe1d8-2de9-40b3-a074-7e95dca871cd None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:25.118896 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 410/806] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:31:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:25.119816 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cfe1d8-2de9-40b3-a074-7e95dca871cd None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:25.135144 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67821644-0df1-4f01-8529-f072f4385467 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:25.176813 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367cc96c-2771-4e75-8c8c-dbe58b167bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:25.177365 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cc96c-2771-4e75-8c8c-dbe58b167bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:25.177641 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cc96c-2771-4e75-8c8c-dbe58b167bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:25.177913 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cc96c-2771-4e75-8c8c-dbe58b167bb9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:25.178496 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367cc96c-2771-4e75-8c8c-dbe58b167bb9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:25.179883 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367cc96c-2771-4e75-8c8c-dbe58b167bb9 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:25.189679 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-367cc96c-2771-4e75-8c8c-dbe58b167bb9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 07:31:25.189679 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:25.189679 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 07:31:25.189679 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 07:31:25.189679 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 07:31:25.189679 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 07:31:25.189679 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 07:31:25.189679 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:31:25.189679 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 07:31:25.189679 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:25.189679 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 07:31:25.189679 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:25.189679 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:25.189679 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:25.189679 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:25.189679 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:25.189679 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:25.190719 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:25.190719 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:25.190719 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:25.190719 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:25.190719 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:25.190719 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:25.190719 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 07:31:25.190719 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 07:31:25.190719 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 07:31:25.190719 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 07:31:25.190719 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:25.190719 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:25.190719 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:25.190719 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:25.190719 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:25.190719 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:25.191781 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:25.191781 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:25.191781 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:25.191781 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:25.191781 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:25.191781 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:25.191781 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:25.191781 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:25.191781 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:25.191781 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:25.191781 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 07:31:25.191781 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:31:25.191781 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 07:31:25.191781 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:25.191781 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 397/807] 10.222.0.42 () {56 vars in 1129 bytes} [Fri Aug 26 07:31:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:25.193176 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367cc96c-2771-4e75-8c8c-dbe58b167bb9 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:25.240207 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cfe1d8-2de9-40b3-a074-7e95dca871cd None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:25.276408 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2356b-7431-4a51-a799-c142efe1c1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:25.277023 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2356b-7431-4a51-a799-c142efe1c1c1 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:25.277301 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2356b-7431-4a51-a799-c142efe1c1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:25.277567 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2356b-7431-4a51-a799-c142efe1c1c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:25.278281 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2356b-7431-4a51-a799-c142efe1c1c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:25.278582 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2356b-7431-4a51-a799-c142efe1c1c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:25.280050 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2356b-7431-4a51-a799-c142efe1c1c1 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:25.287975 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:25.293094 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 411/808] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:31:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:25.294092 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2356b-7431-4a51-a799-c142efe1c1c1 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:25.301480 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367cc96c-2771-4e75-8c8c-dbe58b167bb9 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:25.338891 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bae311-782a-47f4-966a-6b3ca63b49a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:25.338891 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bae311-782a-47f4-966a-6b3ca63b49a8 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:25.338891 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bae311-782a-47f4-966a-6b3ca63b49a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:25.338891 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bae311-782a-47f4-966a-6b3ca63b49a8 None admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:25.339386 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bae311-782a-47f4-966a-6b3ca63b49a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:25.339650 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bae311-782a-47f4-966a-6b3ca63b49a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:25.341098 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bae311-782a-47f4-966a-6b3ca63b49a8 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:25.342786 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:25.354204 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 398/809] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 26 07:31:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:25.355475 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c7ae0-41a3-47a6-9476-6d8cac78cb16 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:25.355940 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c7ae0-41a3-47a6-9476-6d8cac78cb16 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:25.362405 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c7ae0-41a3-47a6-9476-6d8cac78cb16 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:25.362405 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 399/810] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:31:25.362405 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c7ae0-41a3-47a6-9476-6d8cac78cb16 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:25.406399 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2356b-7431-4a51-a799-c142efe1c1c1 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:25.444841 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d4d64-113b-41d4-b054-5de8114b0ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:25.445396 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d4d64-113b-41d4-b054-5de8114b0ac0 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:25.445670 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d4d64-113b-41d4-b054-5de8114b0ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:25.445944 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d4d64-113b-41d4-b054-5de8114b0ac0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:25.456803 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077d4d64-113b-41d4-b054-5de8114b0ac0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:25.458256 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077d4d64-113b-41d4-b054-5de8114b0ac0 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:25.473554 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c7ae0-41a3-47a6-9476-6d8cac78cb16 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:25.477510 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-077d4d64-113b-41d4-b054-5de8114b0ac0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:25.477510 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:25.477510 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:25.477510 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:25.477510 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:25.477510 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:25.477510 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:25.477510 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:25.477510 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:25.477510 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:25.477510 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:25.477510 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:25.477510 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:31:25.477510 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:31:25.477510 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:31:25.477510 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:31:25.478657 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:25.478657 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:25.478657 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:25.478657 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:25.478657 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:25.478657 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:25.478657 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:25.478657 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:25.478657 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:25.478657 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:25.478657 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:25.478657 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:25.478657 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:25.478657 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:25.478657 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:25.478657 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:25.478657 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:31:25.479617 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:31:25.479617 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:25.479617 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:25.483143 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 412/811] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:31:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:25.485126 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d4d64-113b-41d4-b054-5de8114b0ac0 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:25.509289 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075eabf-49d1-4990-89eb-ccf7c6e9050f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:25.509901 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075eabf-49d1-4990-89eb-ccf7c6e9050f None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:25.510178 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075eabf-49d1-4990-89eb-ccf7c6e9050f None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:25.510448 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075eabf-49d1-4990-89eb-ccf7c6e9050f None admin] PATH_INFO: `/v3/services` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:25.511118 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075eabf-49d1-4990-89eb-ccf7c6e9050f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:25.511431 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075eabf-49d1-4990-89eb-ccf7c6e9050f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:25.512975 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075eabf-49d1-4990-89eb-ccf7c6e9050f None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:25.518514 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 400/812] 10.222.0.42 () {56 vars in 1124 bytes} [Fri Aug 26 07:31:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:25.519621 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075eabf-49d1-4990-89eb-ccf7c6e9050f None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:25.542368 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:25.584333 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:25.596974 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d4d64-113b-41d4-b054-5de8114b0ac0 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:25.629572 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075eabf-49d1-4990-89eb-ccf7c6e9050f None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:25.631798 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bced1f0-7248-4edb-a542-65f68a7b5c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:25.632438 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bced1f0-7248-4edb-a542-65f68a7b5c79 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:25.632718 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bced1f0-7248-4edb-a542-65f68a7b5c79 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:25.632988 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bced1f0-7248-4edb-a542-65f68a7b5c79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:25.640870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bced1f0-7248-4edb-a542-65f68a7b5c79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:25.642375 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bced1f0-7248-4edb-a542-65f68a7b5c79 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:25.654135 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-6bced1f0-7248-4edb-a542-65f68a7b5c79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:31:25.654135 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:25.654135 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:25.654135 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:25.654135 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:25.654135 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:25.654135 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:25.654135 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:25.654135 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:25.654135 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:25.654135 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:25.654135 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:25.654135 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 07:31:25.654135 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 07:31:25.654135 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 07:31:25.655809 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 07:31:25.655809 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:25.655809 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:25.655809 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:25.655809 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:25.655809 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:25.655809 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:25.655809 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:25.655809 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:25.655809 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:25.655809 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:25.655809 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:25.655809 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:25.655809 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:25.655809 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:25.655809 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:25.655809 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:25.656976 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 07:31:25.656976 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 07:31:25.656976 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 07:31:25.656976 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 07:31:25.656976 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 07:31:25.656976 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 07:31:25.656976 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:31:25.656976 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:25.656976 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 413/813] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:31:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:25.656976 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad846e2-4c00-464b-85d4-7659982afcb3 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:25.657525 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad846e2-4c00-464b-85d4-7659982afcb3 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:25.657525 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad846e2-4c00-464b-85d4-7659982afcb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:25.675874 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-aad846e2-4c00-464b-85d4-7659982afcb3 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:25.676514 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f8ace-9069-41e4-a681-6c80523ce3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:25.677081 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-aad846e2-4c00-464b-85d4-7659982afcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:25.677186 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f8ace-9069-41e4-a681-6c80523ce3e7 None admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:25.677356 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f8ace-9069-41e4-a681-6c80523ce3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:25.677680 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f8ace-9069-41e4-a681-6c80523ce3e7 None admin] PATH_INFO: `/v3/projects/becbf57e91454d499dec313ff9eadfae/users/3142255c263e44a189db82c621f87e7d/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:25.679664 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f8ace-9069-41e4-a681-6c80523ce3e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=becbf57e91454d499dec313ff9eadfae, user_id=3142255c263e44a189db82c621f87e7d, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:25.681078 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f8ace-9069-41e4-a681-6c80523ce3e7 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:25.747336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 401/814] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 26 07:31:25 2022] PUT /identity/v3/projects/becbf57e91454d499dec313ff9eadfae/users/3142255c263e44a189db82c621f87e7d/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:31:25.748103 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f8ace-9069-41e4-a681-6c80523ce3e7 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:25.751117 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 414/815] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:31:25.752129 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad846e2-4c00-464b-85d4-7659982afcb3 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:25.828685 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:25.906760 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f8ace-9069-41e4-a681-6c80523ce3e7 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:25.920474 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad846e2-4c00-464b-85d4-7659982afcb3 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:25.929145 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:25.953907 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74db410-2df6-4e91-a9eb-6aa0bb7d1fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:25.955435 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74db410-2df6-4e91-a9eb-6aa0bb7d1fe1 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:25.955722 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74db410-2df6-4e91-a9eb-6aa0bb7d1fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:25.955997 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74db410-2df6-4e91-a9eb-6aa0bb7d1fe1 None admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:25.957135 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74db410-2df6-4e91-a9eb-6aa0bb7d1fe1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:25.957575 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74db410-2df6-4e91-a9eb-6aa0bb7d1fe1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:25.960340 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74db410-2df6-4e91-a9eb-6aa0bb7d1fe1 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:25.964121 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c94850-0721-458b-acc7-e5c89c367baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:25.964838 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c94850-0721-458b-acc7-e5c89c367baa None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:25.965164 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c94850-0721-458b-acc7-e5c89c367baa None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:25.965439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c94850-0721-458b-acc7-e5c89c367baa None admin] PATH_INFO: `/v3/services` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:25.966090 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c94850-0721-458b-acc7-e5c89c367baa None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:25.966459 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c94850-0721-458b-acc7-e5c89c367baa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:25.968092 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c94850-0721-458b-acc7-e5c89c367baa None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:25.974640 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 415/816] 10.222.0.42 () {56 vars in 1124 bytes} [Fri Aug 26 07:31:25 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:25.975525 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c94850-0721-458b-acc7-e5c89c367baa None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:25.980518 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 402/817] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:31:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:25.982628 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74db410-2df6-4e91-a9eb-6aa0bb7d1fe1 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:26.104638 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74db410-2df6-4e91-a9eb-6aa0bb7d1fe1 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:26.110099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c94850-0721-458b-acc7-e5c89c367baa None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:26.113454 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:26.149148 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b371e2-3c3a-4d55-aeb2-a4d335c4670c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:26.150292 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b371e2-3c3a-4d55-aeb2-a4d335c4670c None admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:26.150745 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b371e2-3c3a-4d55-aeb2-a4d335c4670c None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:26.151320 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b371e2-3c3a-4d55-aeb2-a4d335c4670c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:26.152140 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b371e2-3c3a-4d55-aeb2-a4d335c4670c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:26.153659 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b371e2-3c3a-4d55-aeb2-a4d335c4670c None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:26.153878 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a696e6-ecdd-48ae-97e5-7d8c0d004d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:26.156045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a696e6-ecdd-48ae-97e5-7d8c0d004d05 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:26.156045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a696e6-ecdd-48ae-97e5-7d8c0d004d05 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:26.156045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a696e6-ecdd-48ae-97e5-7d8c0d004d05 None admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:26.156045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a696e6-ecdd-48ae-97e5-7d8c0d004d05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:26.156462 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a696e6-ecdd-48ae-97e5-7d8c0d004d05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:26.157883 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a696e6-ecdd-48ae-97e5-7d8c0d004d05 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:26.171396 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 416/818] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 26 07:31:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:26.172228 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a696e6-ecdd-48ae-97e5-7d8c0d004d05 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:26.265727 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 403/819] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:31:25 2022] POST /identity/v3/endpoints => generated 346 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 07:31:26.266623 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b371e2-3c3a-4d55-aeb2-a4d335c4670c None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:26.309139 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a696e6-ecdd-48ae-97e5-7d8c0d004d05 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:26.319559 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:26.371989 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f359d4e-a4b7-47f3-a5d0-bf8e631d4b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:26.373349 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f359d4e-a4b7-47f3-a5d0-bf8e631d4b93 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:26.373892 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f359d4e-a4b7-47f3-a5d0-bf8e631d4b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:26.374388 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f359d4e-a4b7-47f3-a5d0-bf8e631d4b93 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:26.387308 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f359d4e-a4b7-47f3-a5d0-bf8e631d4b93 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:26.391620 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f359d4e-a4b7-47f3-a5d0-bf8e631d4b93 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:26.409846 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-4f359d4e-a4b7-47f3-a5d0-bf8e631d4b93 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 07:31:26.409846 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:26.409846 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:26.409846 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:26.409846 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:26.409846 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:26.409846 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:26.409846 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:26.409846 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:26.409846 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:26.409846 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:26.409846 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:26.409846 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 07:31:26.409846 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 07:31:26.409846 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 07:31:26.409846 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 07:31:26.410886 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:26.410886 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:26.410886 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 07:31:26.410886 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:31:26.410886 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 07:31:26.410886 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:31:26.410886 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:26.410886 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:26.410886 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:26.410886 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:26.410886 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:26.410886 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:26.410886 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:26.410886 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:26.410886 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:26.410886 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:26.410886 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:26.410886 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:26.412028 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:26.412028 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:26.412028 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 07:31:26.412028 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 07:31:26.412028 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 07:31:26.412028 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 07:31:26.412028 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 07:31:26.412028 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 07:31:26.412028 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 07:31:26.412028 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:26.412562 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b371e2-3c3a-4d55-aeb2-a4d335c4670c None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:26.420531 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 417/820] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Aug 26 07:31:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:26.420531 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f359d4e-a4b7-47f3-a5d0-bf8e631d4b93 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:26.453437 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:26.464231 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f290ec-78de-4a81-982a-62c2e37ff11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:26.464874 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f290ec-78de-4a81-982a-62c2e37ff11b None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:26.465150 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f290ec-78de-4a81-982a-62c2e37ff11b None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:26.465418 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f290ec-78de-4a81-982a-62c2e37ff11b None admin] PATH_INFO: `/v3/services/network` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:26.466055 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f290ec-78de-4a81-982a-62c2e37ff11b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:26.467480 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f290ec-78de-4a81-982a-62c2e37ff11b None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:26.478181 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-e0f290ec-78de-4a81-982a-62c2e37ff11b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 07:31:26.478181 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:26.478181 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 07:31:26.478181 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 07:31:26.478181 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 07:31:26.478181 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 07:31:26.478181 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 07:31:26.478181 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:31:26.478181 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 07:31:26.478181 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:26.478181 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 07:31:26.478181 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:26.478181 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:26.478181 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:26.478181 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:26.478181 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:26.478181 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:26.479429 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:26.479429 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:26.479429 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:26.479429 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:26.479429 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:26.479429 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:26.479429 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 07:31:26.479429 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 07:31:26.479429 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 07:31:26.479429 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 07:31:26.479429 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:26.479429 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:26.479429 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:26.479429 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:26.479429 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:26.479429 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:26.480456 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:26.480456 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:26.480456 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:26.480456 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:26.480456 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:26.480456 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:26.480456 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:26.480456 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:26.480456 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:26.480456 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:26.480456 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 07:31:26.480456 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:31:26.480456 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 07:31:26.480456 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:26.487192 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 404/821] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:31:26 2022] GET /identity/v3/services/network => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:26.487192 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f290ec-78de-4a81-982a-62c2e37ff11b None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:26.568111 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f359d4e-a4b7-47f3-a5d0-bf8e631d4b93 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:26.610716 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23929a5-ed37-4ee9-b43f-ec0dfa6487ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:26.611773 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23929a5-ed37-4ee9-b43f-ec0dfa6487ce None admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:26.612317 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23929a5-ed37-4ee9-b43f-ec0dfa6487ce None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:26.612823 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23929a5-ed37-4ee9-b43f-ec0dfa6487ce None admin] PATH_INFO: `/v3/projects/becbf57e91454d499dec313ff9eadfae/users/30dc2621143f4604b53bb44b82e8efbb/roles/aad163eaa5c8447ca5d5a7d5d861395a` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:26.630505 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23929a5-ed37-4ee9-b43f-ec0dfa6487ce None admin] RBAC: Authorizing `identity:create_grant(project_id=becbf57e91454d499dec313ff9eadfae, user_id=30dc2621143f4604b53bb44b82e8efbb, role_id=aad163eaa5c8447ca5d5a7d5d861395a)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:26.632360 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23929a5-ed37-4ee9-b43f-ec0dfa6487ce None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:26.635285 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:26.640725 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f290ec-78de-4a81-982a-62c2e37ff11b None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:26.684111 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf475b9-c704-4485-acc4-70b88eadb44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:26.684772 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf475b9-c704-4485-acc4-70b88eadb44b None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:26.685050 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf475b9-c704-4485-acc4-70b88eadb44b None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:26.685319 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf475b9-c704-4485-acc4-70b88eadb44b None admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:26.686172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf475b9-c704-4485-acc4-70b88eadb44b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:26.686901 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf475b9-c704-4485-acc4-70b88eadb44b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:26.688568 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf475b9-c704-4485-acc4-70b88eadb44b None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:26.709214 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 405/822] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Aug 26 07:31:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:26.715162 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf475b9-c704-4485-acc4-70b88eadb44b None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:26.715491 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 418/823] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 26 07:31:26 2022] PUT /identity/v3/projects/becbf57e91454d499dec313ff9eadfae/users/30dc2621143f4604b53bb44b82e8efbb/roles/aad163eaa5c8447ca5d5a7d5d861395a => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:31:26.719828 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23929a5-ed37-4ee9-b43f-ec0dfa6487ce None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:26.901214 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:26.937255 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf475b9-c704-4485-acc4-70b88eadb44b None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:26.941039 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23929a5-ed37-4ee9-b43f-ec0dfa6487ce None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:26.981062 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986030e0-ab02-4d1a-a37e-3cffe2a030a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:26.982099 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986030e0-ab02-4d1a-a37e-3cffe2a030a5 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:26.982392 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653425cb-b060-4a81-8d5d-44051ca6094d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:26.982846 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986030e0-ab02-4d1a-a37e-3cffe2a030a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:26.984103 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986030e0-ab02-4d1a-a37e-3cffe2a030a5 None admin] PATH_INFO: `/v3/services` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:26.984103 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986030e0-ab02-4d1a-a37e-3cffe2a030a5 None admin] RBAC: Adding query filter params (name=network) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:26.985358 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653425cb-b060-4a81-8d5d-44051ca6094d None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:26.985472 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986030e0-ab02-4d1a-a37e-3cffe2a030a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:26.985870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653425cb-b060-4a81-8d5d-44051ca6094d None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:26.986279 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653425cb-b060-4a81-8d5d-44051ca6094d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:26.987442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986030e0-ab02-4d1a-a37e-3cffe2a030a5 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:26.993796 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 406/824] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Aug 26 07:31:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:27.001122 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986030e0-ab02-4d1a-a37e-3cffe2a030a5 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:27.026043 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:27.065689 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653425cb-b060-4a81-8d5d-44051ca6094d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:27.067605 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653425cb-b060-4a81-8d5d-44051ca6094d None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:27.114021 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986030e0-ab02-4d1a-a37e-3cffe2a030a5 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:27.143823 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:27.159872 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb17b85-1947-45ef-8ede-5feb02b7688a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:27.159872 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb17b85-1947-45ef-8ede-5feb02b7688a None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:27.159872 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb17b85-1947-45ef-8ede-5feb02b7688a None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:27.159872 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb17b85-1947-45ef-8ede-5feb02b7688a None admin] PATH_INFO: `/v3/services` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:27.160288 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb17b85-1947-45ef-8ede-5feb02b7688a None admin] RBAC: Adding query filter params (type=network) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:27.160288 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb17b85-1947-45ef-8ede-5feb02b7688a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:27.160288 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb17b85-1947-45ef-8ede-5feb02b7688a None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:27.167735 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 407/825] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Aug 26 07:31:27 2022] GET /identity/v3/services?type=network => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:27.169621 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb17b85-1947-45ef-8ede-5feb02b7688a None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:27.183581 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 419/826] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:31:26 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 07:31:27.189075 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653425cb-b060-4a81-8d5d-44051ca6094d None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:27.313049 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653425cb-b060-4a81-8d5d-44051ca6094d None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:27.367589 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1a8ae-80b8-49f4-b20b-537bb5d705c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:27.368630 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1a8ae-80b8-49f4-b20b-537bb5d705c8 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:27.369132 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1a8ae-80b8-49f4-b20b-537bb5d705c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:27.369596 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1a8ae-80b8-49f4-b20b-537bb5d705c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:27.389025 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:27.396342 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1a8ae-80b8-49f4-b20b-537bb5d705c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:27.398222 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1a8ae-80b8-49f4-b20b-537bb5d705c8 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:27.421099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-d3f1a8ae-80b8-49f4-b20b-537bb5d705c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:27.421099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:27.421099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:27.421099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:27.421099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:27.421099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:27.421099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:27.421099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:27.421099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:27.421099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:27.421099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:27.421099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:27.421099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:31:27.421099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:31:27.421099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:31:27.421099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:31:27.422249 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:27.422249 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:27.422249 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:27.422249 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:27.422249 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:27.422249 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:27.422249 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:27.422249 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:27.422249 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:27.422249 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:27.422249 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:27.422249 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:27.422249 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:27.422249 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:27.422249 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:27.422249 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:27.422249 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:31:27.423344 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:31:27.423344 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:27.423344 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:27.426580 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 420/827] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:31:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:27.433244 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb17b85-1947-45ef-8ede-5feb02b7688a None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:27.444994 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1a8ae-80b8-49f4-b20b-537bb5d705c8 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:27.477698 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:27.527765 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424364b-66ea-4669-80d4-97e736cb1258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:27.528405 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424364b-66ea-4669-80d4-97e736cb1258 None admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:27.528688 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424364b-66ea-4669-80d4-97e736cb1258 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:27.528964 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424364b-66ea-4669-80d4-97e736cb1258 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:27.529657 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0424364b-66ea-4669-80d4-97e736cb1258 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:27.531810 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0424364b-66ea-4669-80d4-97e736cb1258 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:27.571320 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1a8ae-80b8-49f4-b20b-537bb5d705c8 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:27.614919 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f8f45-bade-49e5-a6c4-0573498dc49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:27.616025 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f8f45-bade-49e5-a6c4-0573498dc49c None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:27.616537 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f8f45-bade-49e5-a6c4-0573498dc49c None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:27.617026 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f8f45-bade-49e5-a6c4-0573498dc49c None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:27.617866 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f8f45-bade-49e5-a6c4-0573498dc49c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:27.618372 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f8f45-bade-49e5-a6c4-0573498dc49c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:27.620167 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f8f45-bade-49e5-a6c4-0573498dc49c None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:27.634093 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 421/828] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:31:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:27.641183 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f8f45-bade-49e5-a6c4-0573498dc49c None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:27.660902 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 408/829] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:31:27 2022] POST /identity/v3/endpoints => generated 337 bytes in 492 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:31:27.744308 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:27.768361 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f8f45-bade-49e5-a6c4-0573498dc49c None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:27.815759 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108a9ed-70ad-48b6-b652-c5f342be2417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:27.816797 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108a9ed-70ad-48b6-b652-c5f342be2417 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:27.817274 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108a9ed-70ad-48b6-b652-c5f342be2417 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:27.817742 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108a9ed-70ad-48b6-b652-c5f342be2417 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:27.825922 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0108a9ed-70ad-48b6-b652-c5f342be2417 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:27.828536 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0108a9ed-70ad-48b6-b652-c5f342be2417 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:27.841275 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-0108a9ed-70ad-48b6-b652-c5f342be2417 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:31:27.841275 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:27.841275 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:27.841275 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:27.841275 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:27.841275 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:27.841275 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:27.841275 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:27.841275 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:27.841275 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:27.841275 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:27.841275 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:27.841275 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 07:31:27.841275 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 07:31:27.841275 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 07:31:27.842356 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 07:31:27.842356 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:27.842356 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:27.842356 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:27.842356 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:27.842356 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:27.842356 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:27.842356 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:27.842356 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:27.842356 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:27.842356 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:27.842356 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:27.842356 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:27.842356 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:27.842356 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:27.842356 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:27.842356 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:27.843655 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 07:31:27.843655 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 07:31:27.843655 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 07:31:27.843655 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 07:31:27.843655 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 07:31:27.843655 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 07:31:27.843655 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:31:27.843655 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:27.846558 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 422/830] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:31:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:27.856157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424364b-66ea-4669-80d4-97e736cb1258 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:27.966730 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c7049-a88f-4870-9a4d-662a1a402447 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:27.967106 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c7049-a88f-4870-9a4d-662a1a402447 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:27.967344 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c7049-a88f-4870-9a4d-662a1a402447 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:27.970448 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 423/831] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 07:31:27.980781 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181c707-69c7-4dc8-8606-7302e60d865a None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:27.981431 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181c707-69c7-4dc8-8606-7302e60d865a None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:27.981918 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181c707-69c7-4dc8-8606-7302e60d865a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:28.005416 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-5181c707-69c7-4dc8-8606-7302e60d865a None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:28.006559 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-5181c707-69c7-4dc8-8606-7302e60d865a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:28.022814 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424364b-66ea-4669-80d4-97e736cb1258 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:28.066846 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43976ffb-5402-41d7-b481-df4870a5fab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:28.067836 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43976ffb-5402-41d7-b481-df4870a5fab6 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:28.068323 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43976ffb-5402-41d7-b481-df4870a5fab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:28.069037 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43976ffb-5402-41d7-b481-df4870a5fab6 None admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:28.069923 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43976ffb-5402-41d7-b481-df4870a5fab6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:28.070415 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43976ffb-5402-41d7-b481-df4870a5fab6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:28.072076 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43976ffb-5402-41d7-b481-df4870a5fab6 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:28.085190 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:28.089014 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 409/832] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 26 07:31:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:28.095591 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43976ffb-5402-41d7-b481-df4870a5fab6 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:28.111077 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 424/833] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:27 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:31:28.215063 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43976ffb-5402-41d7-b481-df4870a5fab6 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:28.262806 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9173ea-731b-42a8-b305-136db6bc849b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:28.263759 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9173ea-731b-42a8-b305-136db6bc849b None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:28.264239 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9173ea-731b-42a8-b305-136db6bc849b None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:28.264697 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9173ea-731b-42a8-b305-136db6bc849b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:28.266008 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9173ea-731b-42a8-b305-136db6bc849b None admin] RBAC: Adding query filter params (role.id=07ed857b2feb472f9fa9e7fe0b08582b, scope.project.id=becbf57e91454d499dec313ff9eadfae, user.id=bc92c0a0a2cc4722868e6877bac93ada) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:28.266517 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9173ea-731b-42a8-b305-136db6bc849b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:28.268304 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9173ea-731b-42a8-b305-136db6bc849b None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:28.279207 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 410/834] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:31:28 2022] GET /identity/v3/role_assignments?user.id=bc92c0a0a2cc4722868e6877bac93ada&scope.project.id=becbf57e91454d499dec313ff9eadfae&role.id=07ed857b2feb472f9fa9e7fe0b08582b => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:28.434564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5181c707-69c7-4dc8-8606-7302e60d865a None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:28.502339 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc6e42-e9f4-4682-8afa-902ec4b38ac0 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:28.502623 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc6e42-e9f4-4682-8afa-902ec4b38ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:28.502904 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc6e42-e9f4-4682-8afa-902ec4b38ac0 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:28.504566 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 411/835] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 07:31:28.509993 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46aeea-33bd-4be1-b367-c4079bfdbb0a None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:28.510267 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46aeea-33bd-4be1-b367-c4079bfdbb0a None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:28.510543 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46aeea-33bd-4be1-b367-c4079bfdbb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:28.520413 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:28.531435 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-9c46aeea-33bd-4be1-b367-c4079bfdbb0a None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:28.532661 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-9c46aeea-33bd-4be1-b367-c4079bfdbb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:28.564998 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5181c707-69c7-4dc8-8606-7302e60d865a None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:28.603653 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc69a0a-be7f-4255-99bf-addc639ec1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:28.604292 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc69a0a-be7f-4255-99bf-addc639ec1da None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:28.604571 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc69a0a-be7f-4255-99bf-addc639ec1da None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:28.604881 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc69a0a-be7f-4255-99bf-addc639ec1da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:28.615137 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:28.621672 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc69a0a-be7f-4255-99bf-addc639ec1da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:31:28.628666 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 412/836] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:28 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 07:31:28.639040 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-afc69a0a-be7f-4255-99bf-addc639ec1da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:31:28.639040 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:28.639040 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:28.639040 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:28.639040 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:28.639040 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:28.639040 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:28.639040 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:28.639040 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:28.639040 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:28.639040 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:28.639040 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:28.639040 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:31:28.639040 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:31:28.639040 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:31:28.639040 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:31:28.641424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:31:28.641424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:31:28.641424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:31:28.641424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:31:28.641424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:28.641424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:28.641424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:28.641424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:28.641424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:28.641424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:28.641424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:28.641424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:28.641424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:28.641424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:28.641424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:28.641424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:28.642654 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:28.642654 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:28.642654 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:28.642654 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:28.642654 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:31:28.642654 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:31:28.642654 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:31:28.642654 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:31:28.642654 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:31:28.642654 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:31:28.642654 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:31:28.642654 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:28.642654 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 425/837] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 26 07:31:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:28.646007 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46aeea-33bd-4be1-b367-c4079bfdbb0a None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:28.761711 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46aeea-33bd-4be1-b367-c4079bfdbb0a None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:28.798136 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b36c94-ea3b-4f51-94eb-c4ba6c7aa102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:28.798672 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b36c94-ea3b-4f51-94eb-c4ba6c7aa102 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:28.798948 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b36c94-ea3b-4f51-94eb-c4ba6c7aa102 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:28.799257 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b36c94-ea3b-4f51-94eb-c4ba6c7aa102 None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:28.799925 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b36c94-ea3b-4f51-94eb-c4ba6c7aa102 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:28.800224 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b36c94-ea3b-4f51-94eb-c4ba6c7aa102 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:28.801596 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b36c94-ea3b-4f51-94eb-c4ba6c7aa102 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:28.811930 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 413/838] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:31:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:28.817649 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc69a0a-be7f-4255-99bf-addc639ec1da None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:28.935600 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b36c94-ea3b-4f51-94eb-c4ba6c7aa102 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:28.950750 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc69a0a-be7f-4255-99bf-addc639ec1da None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:28.984374 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:28.992644 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51d31d-3d20-4bae-b99e-ab94b728805c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:28.997096 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51d31d-3d20-4bae-b99e-ab94b728805c None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:28.997096 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51d31d-3d20-4bae-b99e-ab94b728805c None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:28.997096 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51d31d-3d20-4bae-b99e-ab94b728805c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:29.005019 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b51d31d-3d20-4bae-b99e-ab94b728805c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:29.006559 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b51d31d-3d20-4bae-b99e-ab94b728805c None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:29.009149 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:29.022536 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-5b51d31d-3d20-4bae-b99e-ab94b728805c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:29.022536 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:29.022536 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:29.022536 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:29.022536 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:29.022536 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:29.022536 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:29.022536 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:29.022536 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:29.022536 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:29.022536 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:29.022536 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:29.022536 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:31:29.022536 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:31:29.022536 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:31:29.022536 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:31:29.023741 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:29.023741 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:29.023741 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:29.023741 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:29.023741 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:29.023741 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:29.023741 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:29.023741 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:29.023741 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:29.023741 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:29.023741 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:29.023741 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:29.023741 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:29.023741 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:29.023741 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:29.023741 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:29.023741 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:31:29.024661 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:31:29.024661 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:29.024661 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:29.024661 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 426/839] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:31:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:29.029526 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51d31d-3d20-4bae-b99e-ab94b728805c None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:29.078435 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b36c94-ea3b-4f51-94eb-c4ba6c7aa102 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:29.128911 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3c0ed-751a-4bc2-ba99-48f321c63723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:29.129828 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3c0ed-751a-4bc2-ba99-48f321c63723 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:29.130118 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3c0ed-751a-4bc2-ba99-48f321c63723 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:29.130389 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3c0ed-751a-4bc2-ba99-48f321c63723 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:29.130974 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca3c0ed-751a-4bc2-ba99-48f321c63723 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:29.132447 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca3c0ed-751a-4bc2-ba99-48f321c63723 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:29.144937 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-eca3c0ed-751a-4bc2-ba99-48f321c63723 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 07:31:29.144937 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:29.144937 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 07:31:29.144937 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 07:31:29.144937 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 07:31:29.144937 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 07:31:29.144937 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 07:31:29.144937 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:31:29.144937 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 07:31:29.144937 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:29.144937 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 07:31:29.144937 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:29.144937 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:29.144937 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:29.144937 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:29.144937 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:29.144937 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:29.146055 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:29.146055 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:29.146055 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:29.146055 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:29.146055 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:29.146055 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:29.146055 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 07:31:29.146055 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 07:31:29.146055 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 07:31:29.146055 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 07:31:29.146055 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:29.146055 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:29.146055 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:29.146055 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:29.146055 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:29.146055 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:29.146893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:29.146893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:29.146893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:29.146893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:29.146893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:29.146893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:29.146893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:29.146893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:29.146893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:29.146893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:29.146893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 07:31:29.146893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:31:29.146893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 07:31:29.146893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:29.146893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 414/840] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 26 07:31:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:29.151806 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51d31d-3d20-4bae-b99e-ab94b728805c None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:29.151954 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3c0ed-751a-4bc2-ba99-48f321c63723 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:29.195477 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c41ad6-306c-417b-9c62-52105100a4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:29.196089 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c41ad6-306c-417b-9c62-52105100a4f0 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:29.196520 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c41ad6-306c-417b-9c62-52105100a4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:29.196800 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c41ad6-306c-417b-9c62-52105100a4f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:29.198250 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c41ad6-306c-417b-9c62-52105100a4f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:29.198553 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c41ad6-306c-417b-9c62-52105100a4f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:29.199949 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c41ad6-306c-417b-9c62-52105100a4f0 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:29.213702 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 427/841] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:31:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:29.215772 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cd564-62d9-423b-b8a5-f518c72e6fa5 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:29.216055 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cd564-62d9-423b-b8a5-f518c72e6fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:29.216334 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cd564-62d9-423b-b8a5-f518c72e6fa5 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:29.218357 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 428/842] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:31:29.223562 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756cd564-62d9-423b-b8a5-f518c72e6fa5 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:29.272055 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:29.287164 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3c0ed-751a-4bc2-ba99-48f321c63723 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:29.309373 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:29.324855 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8cec4-e119-4ba5-aa1f-ea656a29168d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:29.325547 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8cec4-e119-4ba5-aa1f-ea656a29168d None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:29.325836 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8cec4-e119-4ba5-aa1f-ea656a29168d None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:29.326107 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8cec4-e119-4ba5-aa1f-ea656a29168d None admin] PATH_INFO: `/v3/services` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:29.327411 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d8cec4-e119-4ba5-aa1f-ea656a29168d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:29.332098 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d8cec4-e119-4ba5-aa1f-ea656a29168d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:29.332098 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d8cec4-e119-4ba5-aa1f-ea656a29168d None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:29.336308 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 415/843] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 26 07:31:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:29.337729 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d602ae-940b-43e4-a23c-2fcfbe1753e5 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:29.338190 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d602ae-940b-43e4-a23c-2fcfbe1753e5 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:29.338468 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d602ae-940b-43e4-a23c-2fcfbe1753e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:29.351560 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756cd564-62d9-423b-b8a5-f518c72e6fa5 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:29.359900 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-54d602ae-940b-43e4-a23c-2fcfbe1753e5 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:29.361132 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-54d602ae-940b-43e4-a23c-2fcfbe1753e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:29.395751 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b2d13-0023-439e-8d0c-5b3bea3629b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:29.396437 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b2d13-0023-439e-8d0c-5b3bea3629b2 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:29.396716 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b2d13-0023-439e-8d0c-5b3bea3629b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:29.396990 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b2d13-0023-439e-8d0c-5b3bea3629b2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:29.404900 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b2d13-0023-439e-8d0c-5b3bea3629b2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:29.410459 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b2d13-0023-439e-8d0c-5b3bea3629b2 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:29.423494 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-245b2d13-0023-439e-8d0c-5b3bea3629b2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 26 07:31:29.423494 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:29.423494 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:29.423494 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:29.423494 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:29.423494 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:29.423494 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:29.423494 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:29.423494 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:29.423494 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:29.423494 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:29.423494 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:29.423494 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 07:31:29.423494 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 07:31:29.423494 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 07:31:29.423494 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 07:31:29.424532 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:29.424532 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:29.424532 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 07:31:29.424532 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:31:29.424532 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 07:31:29.424532 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:31:29.424532 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:29.424532 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:29.424532 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:29.424532 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:29.424532 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:29.424532 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:29.424532 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:29.424532 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:29.424532 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:29.424532 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:29.424532 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:29.424532 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:29.425533 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:29.425533 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:29.425533 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 07:31:29.425533 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 07:31:29.425533 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 07:31:29.425533 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 07:31:29.425533 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 07:31:29.425533 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 07:31:29.425533 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 26 07:31:29.425533 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:29.425533 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 429/844] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 26 07:31:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:29.426123 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b2d13-0023-439e-8d0c-5b3bea3629b2 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:29.452612 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 416/845] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:31:29.456020 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d602ae-940b-43e4-a23c-2fcfbe1753e5 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:29.570100 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:29.575538 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b2d13-0023-439e-8d0c-5b3bea3629b2 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:29.581621 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d602ae-940b-43e4-a23c-2fcfbe1753e5 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:29.600273 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:29.627319 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd045b-b877-48ea-9a66-4a73dc28c1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:29.628336 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd045b-b877-48ea-9a66-4a73dc28c1aa None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:29.628882 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd045b-b877-48ea-9a66-4a73dc28c1aa None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:29.629357 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd045b-b877-48ea-9a66-4a73dc28c1aa None admin] PATH_INFO: `/v3/services` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:29.629808 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8bbee-1897-4be2-a7f5-5186e6de984d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:29.630430 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8bbee-1897-4be2-a7f5-5186e6de984d None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:29.630710 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8bbee-1897-4be2-a7f5-5186e6de984d None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:29.630907 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd045b-b877-48ea-9a66-4a73dc28c1aa None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:29.631025 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8bbee-1897-4be2-a7f5-5186e6de984d None admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:29.631520 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd045b-b877-48ea-9a66-4a73dc28c1aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:29.631740 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c8bbee-1897-4be2-a7f5-5186e6de984d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:29.632060 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c8bbee-1897-4be2-a7f5-5186e6de984d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:29.633543 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c8bbee-1897-4be2-a7f5-5186e6de984d None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:29.633658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd045b-b877-48ea-9a66-4a73dc28c1aa None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:29.640060 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 430/846] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 26 07:31:29 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:29.659872 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 417/847] 10.222.0.42 () {56 vars in 1135 bytes} [Fri Aug 26 07:31:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:29.665425 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd045b-b877-48ea-9a66-4a73dc28c1aa None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:29.738643 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8bbee-1897-4be2-a7f5-5186e6de984d None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:29.818867 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd045b-b877-48ea-9a66-4a73dc28c1aa None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:29.863273 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6f696-97bb-40d2-b163-191fe40e62e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:29.863886 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6f696-97bb-40d2-b163-191fe40e62e0 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:29.864178 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6f696-97bb-40d2-b163-191fe40e62e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:29.864451 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6f696-97bb-40d2-b163-191fe40e62e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:29.892376 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8bbee-1897-4be2-a7f5-5186e6de984d None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:29.905988 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:29.936568 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7c0b1-9f13-42b9-bfdc-96108f0eaeab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:29.937610 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7c0b1-9f13-42b9-bfdc-96108f0eaeab None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:29.938093 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7c0b1-9f13-42b9-bfdc-96108f0eaeab None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:29.938581 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7c0b1-9f13-42b9-bfdc-96108f0eaeab None admin] PATH_INFO: `/v3/roles/service` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:29.955085 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee6f696-97bb-40d2-b163-191fe40e62e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:29.956560 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee6f696-97bb-40d2-b163-191fe40e62e0 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:29.956979 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f7c0b1-9f13-42b9-bfdc-96108f0eaeab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:31:29.963855 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-17f7c0b1-9f13-42b9-bfdc-96108f0eaeab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 07:31:29.963855 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:29.963855 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:29.963855 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:29.963855 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:29.963855 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:29.963855 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:29.963855 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:29.963855 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:29.963855 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:29.963855 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:29.963855 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:29.963855 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:31:29.963855 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:31:29.963855 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:31:29.963855 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:31:29.964835 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:31:29.964835 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:31:29.964835 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:31:29.964835 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:31:29.964835 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:29.964835 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:29.964835 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:29.964835 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:29.964835 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:29.964835 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:29.964835 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:29.964835 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:29.964835 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:29.964835 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:29.964835 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:29.964835 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:29.965698 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:29.965698 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:29.965698 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:29.965698 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:29.965698 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:31:29.965698 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:31:29.965698 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:31:29.965698 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:31:29.965698 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:31:29.965698 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:31:29.965698 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 07:31:29.965698 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:29.974223 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 418/848] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 26 07:31:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 07:31:29.975637 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7c0b1-9f13-42b9-bfdc-96108f0eaeab None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:30.019351 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:30.081365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 431/849] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:31:29 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 26 07:31:30.086862 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6f696-97bb-40d2-b163-191fe40e62e0 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:30.111388 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7c0b1-9f13-42b9-bfdc-96108f0eaeab None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:30.152150 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45d608-924c-4b85-bc77-b474cf32fd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:30.152752 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45d608-924c-4b85-bc77-b474cf32fd11 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:30.158480 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45d608-924c-4b85-bc77-b474cf32fd11 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:30.158480 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45d608-924c-4b85-bc77-b474cf32fd11 None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:30.158480 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45d608-924c-4b85-bc77-b474cf32fd11 None admin] RBAC: Adding query filter params (name=service) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:30.158480 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45d608-924c-4b85-bc77-b474cf32fd11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:30.158480 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45d608-924c-4b85-bc77-b474cf32fd11 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:30.167927 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 419/850] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 26 07:31:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:30.174819 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45d608-924c-4b85-bc77-b474cf32fd11 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:30.175668 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:30.231441 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6f696-97bb-40d2-b163-191fe40e62e0 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:30.279807 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41c475-8800-4626-abdf-3b52b4376ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:30.281545 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41c475-8800-4626-abdf-3b52b4376ab1 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:30.282025 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41c475-8800-4626-abdf-3b52b4376ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:30.282492 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41c475-8800-4626-abdf-3b52b4376ab1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:30.292686 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:30.300803 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f41c475-8800-4626-abdf-3b52b4376ab1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:30.302560 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f41c475-8800-4626-abdf-3b52b4376ab1 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:30.306777 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45d608-924c-4b85-bc77-b474cf32fd11 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:30.321796 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-5f41c475-8800-4626-abdf-3b52b4376ab1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:30.321796 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:30.321796 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:30.321796 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:30.321796 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:30.321796 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:30.321796 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:30.321796 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:30.321796 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:30.321796 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:30.321796 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:30.321796 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:30.321796 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:31:30.321796 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:31:30.321796 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:31:30.321796 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:31:30.322791 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:30.322791 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:30.322791 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:30.322791 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:30.322791 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:30.322791 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:30.322791 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:30.322791 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:30.322791 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:30.322791 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:30.322791 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:30.322791 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:30.322791 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:30.322791 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:30.322791 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:30.322791 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:30.322791 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:31:30.323716 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:31:30.323716 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:30.323716 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:30.327124 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 432/851] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:31:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:30.330568 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41c475-8800-4626-abdf-3b52b4376ab1 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:30.362224 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7534c31-6ca5-4c5d-ad25-d4af0e42531c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:30.363529 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7534c31-6ca5-4c5d-ad25-d4af0e42531c None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:30.364402 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7534c31-6ca5-4c5d-ad25-d4af0e42531c None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:30.364895 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7534c31-6ca5-4c5d-ad25-d4af0e42531c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:30.381157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7534c31-6ca5-4c5d-ad25-d4af0e42531c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:30.383889 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7534c31-6ca5-4c5d-ad25-d4af0e42531c None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:30.403930 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-e7534c31-6ca5-4c5d-ad25-d4af0e42531c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:30.403930 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:30.403930 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:30.403930 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:30.403930 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:30.403930 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:30.403930 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:30.403930 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:30.403930 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:30.403930 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:30.403930 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:30.403930 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:30.403930 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:31:30.403930 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:31:30.403930 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:31:30.403930 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:31:30.405684 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:30.405684 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:30.405684 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:30.405684 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:30.405684 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:30.405684 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:30.405684 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:30.405684 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:30.405684 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:30.405684 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:30.405684 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:30.405684 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:30.405684 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:30.405684 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:30.405684 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:30.405684 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:30.405684 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:31:30.406672 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:31:30.406672 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:30.406672 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:30.410593 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 420/852] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:31:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:30.411966 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7534c31-6ca5-4c5d-ad25-d4af0e42531c None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:30.462670 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41c475-8800-4626-abdf-3b52b4376ab1 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:30.481484 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:30.502522 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a01aa-6fe3-4615-9a6e-84b0a1514f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:30.503282 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a01aa-6fe3-4615-9a6e-84b0a1514f76 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:30.503556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a01aa-6fe3-4615-9a6e-84b0a1514f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:30.503828 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a01aa-6fe3-4615-9a6e-84b0a1514f76 None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:30.504474 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7a01aa-6fe3-4615-9a6e-84b0a1514f76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:30.504777 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7a01aa-6fe3-4615-9a6e-84b0a1514f76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:30.506259 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7a01aa-6fe3-4615-9a6e-84b0a1514f76 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:30.525945 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 433/853] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:30.525945 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3bb5e-bdc9-4ae4-9b71-fb8752af55fa None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:30.525945 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3bb5e-bdc9-4ae4-9b71-fb8752af55fa None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:30.525945 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3bb5e-bdc9-4ae4-9b71-fb8752af55fa None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:30.525945 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 434/854] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:31:30.530669 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3bb5e-bdc9-4ae4-9b71-fb8752af55fa None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:30.539773 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7534c31-6ca5-4c5d-ad25-d4af0e42531c None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:30.580322 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41fc85-6e01-41a8-8117-409158b84466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:30.580943 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41fc85-6e01-41a8-8117-409158b84466 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:30.581208 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41fc85-6e01-41a8-8117-409158b84466 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:30.581484 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41fc85-6e01-41a8-8117-409158b84466 None admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:30.582160 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da41fc85-6e01-41a8-8117-409158b84466 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:30.582431 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da41fc85-6e01-41a8-8117-409158b84466 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:30.584438 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da41fc85-6e01-41a8-8117-409158b84466 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:30.603652 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 421/855] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:30.603652 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f03ec1-3bd1-4361-b85e-d441fdf90295 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:30.603652 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f03ec1-3bd1-4361-b85e-d441fdf90295 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:30.603652 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f03ec1-3bd1-4361-b85e-d441fdf90295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:30.615613 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:30.623197 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-94f03ec1-3bd1-4361-b85e-d441fdf90295 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:30.624458 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-94f03ec1-3bd1-4361-b85e-d441fdf90295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:30.653200 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3bb5e-bdc9-4ae4-9b71-fb8752af55fa None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:30.692787 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d05cd-4ba7-42ad-9b19-13836172bbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:30.693693 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d05cd-4ba7-42ad-9b19-13836172bbb5 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:30.693976 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d05cd-4ba7-42ad-9b19-13836172bbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:30.694250 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d05cd-4ba7-42ad-9b19-13836172bbb5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:30.707090 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 422/856] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:30 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:31:30.707090 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f03ec1-3bd1-4361-b85e-d441fdf90295 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:30.708514 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9d05cd-4ba7-42ad-9b19-13836172bbb5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:30.709982 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9d05cd-4ba7-42ad-9b19-13836172bbb5 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:30.723147 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-de9d05cd-4ba7-42ad-9b19-13836172bbb5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:31:30.723147 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:30.723147 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:30.723147 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:30.723147 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:30.723147 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:30.723147 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:30.723147 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:30.723147 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:30.723147 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:30.723147 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:30.723147 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:30.723147 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 07:31:30.723147 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 07:31:30.723147 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 07:31:30.724099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 07:31:30.724099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:30.724099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:30.724099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:30.724099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:30.724099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:30.724099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:30.724099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:30.724099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:30.724099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:30.724099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:30.724099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:30.724099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:30.724099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:30.724099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:30.724099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:30.724099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:30.725002 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 07:31:30.725002 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 07:31:30.725002 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 07:31:30.725002 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 07:31:30.725002 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 07:31:30.725002 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 07:31:30.725002 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:31:30.725002 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:30.729282 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 435/857] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:31:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:30.730206 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d05cd-4ba7-42ad-9b19-13836172bbb5 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:30.772812 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:30.838843 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f03ec1-3bd1-4361-b85e-d441fdf90295 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:30.859914 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d05cd-4ba7-42ad-9b19-13836172bbb5 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:30.881511 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5845e9-db05-459e-b7d8-027a5785526f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:30.882737 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5845e9-db05-459e-b7d8-027a5785526f None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:30.883251 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5845e9-db05-459e-b7d8-027a5785526f None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:30.884114 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5845e9-db05-459e-b7d8-027a5785526f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:30.888207 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:30.895300 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5845e9-db05-459e-b7d8-027a5785526f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:30.899492 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5845e9-db05-459e-b7d8-027a5785526f None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:30.906692 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56766b1-aed1-4411-a67e-7b79243459a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:30.907490 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56766b1-aed1-4411-a67e-7b79243459a1 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:30.907948 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56766b1-aed1-4411-a67e-7b79243459a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:30.908563 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56766b1-aed1-4411-a67e-7b79243459a1 None admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:30.909786 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56766b1-aed1-4411-a67e-7b79243459a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:30.910197 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56766b1-aed1-4411-a67e-7b79243459a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:30.912125 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56766b1-aed1-4411-a67e-7b79243459a1 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:30.917534 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-fb5845e9-db05-459e-b7d8-027a5785526f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 07:31:30.917534 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:30.917534 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:30.917534 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:30.917534 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:30.917534 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:30.917534 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:30.917534 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:30.917534 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:30.917534 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:30.917534 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:30.917534 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:30.917534 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 07:31:30.917534 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 07:31:30.917534 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 07:31:30.917534 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 07:31:30.918669 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:30.918669 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:30.918669 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 07:31:30.918669 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:31:30.918669 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 07:31:30.918669 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:31:30.918669 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:30.918669 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:30.918669 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:30.918669 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:30.918669 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:30.918669 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:30.918669 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:30.918669 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:30.918669 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:30.918669 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:30.918669 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:30.918669 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:30.919908 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:30.919908 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:30.919908 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 07:31:30.919908 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 07:31:30.919908 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 07:31:30.919908 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 07:31:30.919908 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 07:31:30.919908 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 07:31:30.919908 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 07:31:30.919908 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:30.922672 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 423/858] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Aug 26 07:31:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:30.931113 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5845e9-db05-459e-b7d8-027a5785526f None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:30.934676 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 436/859] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 26 07:31:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:30.937596 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56766b1-aed1-4411-a67e-7b79243459a1 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:31.045633 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5845e9-db05-459e-b7d8-027a5785526f None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:31.065325 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:31.072234 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56766b1-aed1-4411-a67e-7b79243459a1 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:31.082206 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980bd6e-9bd0-46c0-840a-957464ca5733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:31.082831 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980bd6e-9bd0-46c0-840a-957464ca5733 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:31.083229 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980bd6e-9bd0-46c0-840a-957464ca5733 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:31.083518 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980bd6e-9bd0-46c0-840a-957464ca5733 None admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:31.084263 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980bd6e-9bd0-46c0-840a-957464ca5733 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:31.084568 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980bd6e-9bd0-46c0-840a-957464ca5733 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:31.086032 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980bd6e-9bd0-46c0-840a-957464ca5733 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:31.112580 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 424/860] 10.222.0.42 () {56 vars in 1149 bytes} [Fri Aug 26 07:31:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:31:31.112580 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980bd6e-9bd0-46c0-840a-957464ca5733 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:31.118847 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52af84-8145-4244-9ee3-66f660c06984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:31.119512 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52af84-8145-4244-9ee3-66f660c06984 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:31.119790 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52af84-8145-4244-9ee3-66f660c06984 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:31.120219 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52af84-8145-4244-9ee3-66f660c06984 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:31.120950 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52af84-8145-4244-9ee3-66f660c06984 None admin] RBAC: Adding query filter params (role.id=07ed857b2feb472f9fa9e7fe0b08582b, scope.project.id=becbf57e91454d499dec313ff9eadfae, user.id=3142255c263e44a189db82c621f87e7d) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:31.121305 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52af84-8145-4244-9ee3-66f660c06984 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:31.122858 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52af84-8145-4244-9ee3-66f660c06984 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:31.135033 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 437/861] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:31:30 2022] GET /identity/v3/role_assignments?user.id=3142255c263e44a189db82c621f87e7d&scope.project.id=becbf57e91454d499dec313ff9eadfae&role.id=07ed857b2feb472f9fa9e7fe0b08582b => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:31:31.135033 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52af84-8145-4244-9ee3-66f660c06984 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:31.227466 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:31.257093 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980bd6e-9bd0-46c0-840a-957464ca5733 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:31.286311 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52af84-8145-4244-9ee3-66f660c06984 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:31.314546 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d435066-b812-4be0-9d77-f3003ebe0af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:31.315262 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d435066-b812-4be0-9d77-f3003ebe0af2 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:31.315615 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d435066-b812-4be0-9d77-f3003ebe0af2 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:31.315983 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d435066-b812-4be0-9d77-f3003ebe0af2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:31.317810 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d435066-b812-4be0-9d77-f3003ebe0af2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:31.320369 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d435066-b812-4be0-9d77-f3003ebe0af2 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:31.332089 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-4d435066-b812-4be0-9d77-f3003ebe0af2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 07:31:31.332089 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:31.332089 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 07:31:31.332089 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 07:31:31.332089 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 07:31:31.332089 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 07:31:31.332089 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 07:31:31.332089 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:31:31.332089 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 07:31:31.332089 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:31.332089 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 07:31:31.332089 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:31.332089 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:31.332089 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:31.332089 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:31.332089 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:31.333172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:31.333172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:31.333172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:31.333172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:31.333172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:31.333172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:31.333172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:31.333172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 07:31:31.333172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 07:31:31.333172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 07:31:31.333172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 07:31:31.333172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:31.333172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:31.333172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:31.333172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:31.333172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:31.333172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:31.334069 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:31.334069 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:31.334069 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:31.334069 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:31.334069 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:31.334069 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:31.334069 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:31.334069 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:31.334069 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:31.334069 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:31.334069 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 07:31:31.334069 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:31:31.334069 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 07:31:31.334069 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:31.334069 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 425/862] 10.222.0.42 () {56 vars in 1132 bytes} [Fri Aug 26 07:31:31 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:31.340368 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d435066-b812-4be0-9d77-f3003ebe0af2 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:31.344695 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f9862-2d40-47a1-86e3-8898d0e5cd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:31.345323 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f9862-2d40-47a1-86e3-8898d0e5cd73 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:31.345603 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f9862-2d40-47a1-86e3-8898d0e5cd73 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:31.345873 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f9862-2d40-47a1-86e3-8898d0e5cd73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:31.385649 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:31.454773 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f9862-2d40-47a1-86e3-8898d0e5cd73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:31.456445 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f9862-2d40-47a1-86e3-8898d0e5cd73 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:31.496689 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d435066-b812-4be0-9d77-f3003ebe0af2 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:31.517234 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:31.538777 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612245b7-e98e-4d36-8033-3da4eb878576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:31.540434 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612245b7-e98e-4d36-8033-3da4eb878576 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:31.540821 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612245b7-e98e-4d36-8033-3da4eb878576 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:31.541287 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612245b7-e98e-4d36-8033-3da4eb878576 None admin] PATH_INFO: `/v3/services` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:31.542339 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612245b7-e98e-4d36-8033-3da4eb878576 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:31.542747 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612245b7-e98e-4d36-8033-3da4eb878576 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:31.545176 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612245b7-e98e-4d36-8033-3da4eb878576 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:31.555382 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 426/863] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Aug 26 07:31:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:31.560000 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612245b7-e98e-4d36-8033-3da4eb878576 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:31.617414 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 438/864] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:31:31 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 07:31:31.623317 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f9862-2d40-47a1-86e3-8898d0e5cd73 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:31.680678 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612245b7-e98e-4d36-8033-3da4eb878576 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:31.711019 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:31.722132 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4fd11f-3e91-4c41-b5f5-94ef0e17b649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:31.723647 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4fd11f-3e91-4c41-b5f5-94ef0e17b649 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:31.723926 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4fd11f-3e91-4c41-b5f5-94ef0e17b649 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:31.725539 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4fd11f-3e91-4c41-b5f5-94ef0e17b649 None admin] PATH_INFO: `/v3/services` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:31.725539 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4fd11f-3e91-4c41-b5f5-94ef0e17b649 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:31.725539 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4fd11f-3e91-4c41-b5f5-94ef0e17b649 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:31.726710 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4fd11f-3e91-4c41-b5f5-94ef0e17b649 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:31.735163 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 427/865] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Aug 26 07:31:31 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:31:31.737598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe15a85-a259-4cb5-a707-494955b4634d None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:31.738417 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe15a85-a259-4cb5-a707-494955b4634d None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:31.738890 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe15a85-a259-4cb5-a707-494955b4634d None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:31.740859 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 428/866] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:31:31.747519 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420697b-d74c-451d-850a-4e737089ffbe None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:31.748035 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420697b-d74c-451d-850a-4e737089ffbe None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:31.748481 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420697b-d74c-451d-850a-4e737089ffbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:31.774800 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-5420697b-d74c-451d-850a-4e737089ffbe None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:31.776071 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-5420697b-d74c-451d-850a-4e737089ffbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:31.781294 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f9862-2d40-47a1-86e3-8898d0e5cd73 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:31.821659 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de930e-28da-4cd9-8096-18639c26b995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:31.822730 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de930e-28da-4cd9-8096-18639c26b995 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:31.823258 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de930e-28da-4cd9-8096-18639c26b995 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:31.823731 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de930e-28da-4cd9-8096-18639c26b995 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:31.837860 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de930e-28da-4cd9-8096-18639c26b995 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:31.840511 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de930e-28da-4cd9-8096-18639c26b995 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:31.844358 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:31.861673 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-a5de930e-28da-4cd9-8096-18639c26b995 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:31.861673 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:31.861673 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:31.861673 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:31.861673 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:31.861673 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:31.861673 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:31.861673 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:31.861673 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:31.861673 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:31.861673 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:31.861673 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:31.861673 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:31:31.861673 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:31:31.861673 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:31:31.861673 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:31:31.869626 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:31.869626 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:31.869626 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:31.869626 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:31.869626 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:31.869626 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:31.869626 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:31.869626 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:31.869626 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:31.869626 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:31.869626 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:31.869626 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:31.869626 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:31.869626 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:31.869626 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:31.869626 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:31.869626 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:31:31.870564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:31:31.870564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:31.870564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:31.870564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 439/867] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:31:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:31.875701 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 429/868] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:31 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:31:31.876339 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de930e-28da-4cd9-8096-18639c26b995 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:32.006049 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de930e-28da-4cd9-8096-18639c26b995 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:32.022440 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:32.045573 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6bf3c-4d6f-429e-bad0-2846574aedcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:32.047695 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6bf3c-4d6f-429e-bad0-2846574aedcc None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:32.048403 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6bf3c-4d6f-429e-bad0-2846574aedcc None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:32.049268 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6bf3c-4d6f-429e-bad0-2846574aedcc None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:32.050151 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a6bf3c-4d6f-429e-bad0-2846574aedcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:32.050922 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a6bf3c-4d6f-429e-bad0-2846574aedcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:32.053161 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a6bf3c-4d6f-429e-bad0-2846574aedcc None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:32.069646 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 440/869] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:31:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:32.075628 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420697b-d74c-451d-850a-4e737089ffbe None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:32.188785 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6bf3c-4d6f-429e-bad0-2846574aedcc None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:32.192306 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420697b-d74c-451d-850a-4e737089ffbe None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:32.239425 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf408d-45e7-470f-aa23-6e584006afc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:32.240072 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf408d-45e7-470f-aa23-6e584006afc6 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:32.240350 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf408d-45e7-470f-aa23-6e584006afc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:32.240621 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf408d-45e7-470f-aa23-6e584006afc6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:32.248175 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf408d-45e7-470f-aa23-6e584006afc6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:32.249692 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf408d-45e7-470f-aa23-6e584006afc6 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:32.261993 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-e4cf408d-45e7-470f-aa23-6e584006afc6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:31:32.261993 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:32.261993 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:32.261993 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:32.261993 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:32.261993 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:32.261993 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:32.261993 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:32.261993 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:32.261993 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:32.261993 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:32.261993 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:32.261993 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 07:31:32.261993 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 07:31:32.261993 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 07:31:32.263367 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 07:31:32.263367 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:32.263367 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:32.263367 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:32.263367 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:32.263367 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:32.263367 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:32.263367 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:32.263367 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:32.263367 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:32.263367 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:32.263367 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:32.263367 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:32.263367 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:32.263367 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:32.263367 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:32.263367 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:32.264816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 07:31:32.264816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 07:31:32.264816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 07:31:32.264816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 07:31:32.264816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 07:31:32.264816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 07:31:32.264816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:31:32.264816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:32.264816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 430/870] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:31:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:32.270075 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf408d-45e7-470f-aa23-6e584006afc6 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:32.312329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6bf3c-4d6f-429e-bad0-2846574aedcc None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:32.317151 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:32.358686 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3bfe7b-ee36-42f2-8482-5584fe7ba36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:32.359359 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bfe7b-ee36-42f2-8482-5584fe7ba36d None admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:32.359695 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bfe7b-ee36-42f2-8482-5584fe7ba36d None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:32.359968 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bfe7b-ee36-42f2-8482-5584fe7ba36d None admin] PATH_INFO: `/v3/services` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:32.360633 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3bfe7b-ee36-42f2-8482-5584fe7ba36d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:32.362707 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3bfe7b-ee36-42f2-8482-5584fe7ba36d None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:32.401647 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf408d-45e7-470f-aa23-6e584006afc6 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:32.431031 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 441/871] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Aug 26 07:31:32 2022] POST /identity/v3/services => generated 251 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 07:31:32.459711 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd16be4-7c51-4fd1-aee2-8dc9de164803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:32.460852 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd16be4-7c51-4fd1-aee2-8dc9de164803 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:32.461370 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd16be4-7c51-4fd1-aee2-8dc9de164803 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:32.461865 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd16be4-7c51-4fd1-aee2-8dc9de164803 None admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:32.462915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd16be4-7c51-4fd1-aee2-8dc9de164803 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:32.463470 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd16be4-7c51-4fd1-aee2-8dc9de164803 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:32.465488 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd16be4-7c51-4fd1-aee2-8dc9de164803 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:32.482228 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 431/872] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 26 07:31:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:32.489260 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3bfe7b-ee36-42f2-8482-5584fe7ba36d None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:32.531481 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:32.629109 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3bfe7b-ee36-42f2-8482-5584fe7ba36d None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:32.666742 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e631d7-277a-4223-9be4-d0ef5ca9dddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:32.667659 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e631d7-277a-4223-9be4-d0ef5ca9dddd None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:32.668060 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e631d7-277a-4223-9be4-d0ef5ca9dddd None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:32.668656 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e631d7-277a-4223-9be4-d0ef5ca9dddd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:32.669761 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e631d7-277a-4223-9be4-d0ef5ca9dddd None admin] RBAC: Adding query filter params (role.id=aad163eaa5c8447ca5d5a7d5d861395a, scope.project.id=becbf57e91454d499dec313ff9eadfae, user.id=30dc2621143f4604b53bb44b82e8efbb) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:32.670211 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e631d7-277a-4223-9be4-d0ef5ca9dddd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:32.673037 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e631d7-277a-4223-9be4-d0ef5ca9dddd None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:32.682214 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 442/873] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:31:32 2022] GET /identity/v3/role_assignments?user.id=30dc2621143f4604b53bb44b82e8efbb&scope.project.id=becbf57e91454d499dec313ff9eadfae&role.id=aad163eaa5c8447ca5d5a7d5d861395a => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:33.322887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af489f09-e192-47aa-82ef-6078d3d9ddf0 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:33.323449 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af489f09-e192-47aa-82ef-6078d3d9ddf0 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:33.323449 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af489f09-e192-47aa-82ef-6078d3d9ddf0 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:33.325046 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 432/874] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:31:33.330899 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d20e7-ccad-4c84-956c-e7fffd61a102 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:33.331586 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d20e7-ccad-4c84-956c-e7fffd61a102 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:33.331586 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d20e7-ccad-4c84-956c-e7fffd61a102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:33.350570 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-399d20e7-ccad-4c84-956c-e7fffd61a102 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:33.351804 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-399d20e7-ccad-4c84-956c-e7fffd61a102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:33.424321 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 443/875] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:33 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:31:33.697969 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af489f09-e192-47aa-82ef-6078d3d9ddf0 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:33.801099 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:33.813003 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af489f09-e192-47aa-82ef-6078d3d9ddf0 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:33.852588 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9abc38-607f-4d45-8458-778aa336cd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:33.853219 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9abc38-607f-4d45-8458-778aa336cd19 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:33.853496 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9abc38-607f-4d45-8458-778aa336cd19 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:33.853761 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9abc38-607f-4d45-8458-778aa336cd19 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:33.854346 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9abc38-607f-4d45-8458-778aa336cd19 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:33.855750 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9abc38-607f-4d45-8458-778aa336cd19 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:33.866329 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-db9abc38-607f-4d45-8458-778aa336cd19 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 07:31:33.866329 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:33.866329 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 07:31:33.866329 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 07:31:33.866329 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 07:31:33.866329 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 07:31:33.866329 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 07:31:33.866329 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:31:33.866329 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 07:31:33.866329 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:33.866329 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 07:31:33.866329 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:33.866329 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:33.866329 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:33.866329 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:33.866329 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:33.866329 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:33.868871 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:33.868871 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:33.868871 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:33.868871 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:33.868871 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:33.868871 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:33.868871 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 07:31:33.868871 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 07:31:33.868871 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 07:31:33.868871 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 07:31:33.868871 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:33.868871 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:33.868871 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:33.868871 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:33.868871 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:33.868871 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:33.870841 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:33.870841 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:33.870841 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:33.870841 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:33.870841 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:33.870841 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:33.870841 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:33.870841 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:33.870841 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:33.870841 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:33.870841 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 07:31:33.870841 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:31:33.870841 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 07:31:33.870841 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:33.870841 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 433/876] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Aug 26 07:31:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:33.875333 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d20e7-ccad-4c84-956c-e7fffd61a102 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:33.907660 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:33.979865 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885d25a-1e37-4972-9f6d-8e4c0b1569db None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:33.980197 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885d25a-1e37-4972-9f6d-8e4c0b1569db None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:33.980361 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885d25a-1e37-4972-9f6d-8e4c0b1569db None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:33.981925 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 434/877] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 07:31:33.985389 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d20e7-ccad-4c84-956c-e7fffd61a102 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:33.987666 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14304f4-a100-45d5-9e20-16eb63f6fe63 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:33.987950 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14304f4-a100-45d5-9e20-16eb63f6fe63 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:33.988222 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14304f4-a100-45d5-9e20-16eb63f6fe63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:34.009743 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-e14304f4-a100-45d5-9e20-16eb63f6fe63 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:34.010965 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-e14304f4-a100-45d5-9e20-16eb63f6fe63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:34.042976 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa26f71-a76e-463f-b6fb-cc98e73e2e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:34.044042 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa26f71-a76e-463f-b6fb-cc98e73e2e3b None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:34.044585 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa26f71-a76e-463f-b6fb-cc98e73e2e3b None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:34.044863 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa26f71-a76e-463f-b6fb-cc98e73e2e3b None admin] PATH_INFO: `/v3/services` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:34.045943 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa26f71-a76e-463f-b6fb-cc98e73e2e3b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:34.046251 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa26f71-a76e-463f-b6fb-cc98e73e2e3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:34.048411 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa26f71-a76e-463f-b6fb-cc98e73e2e3b None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:34.055264 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 444/878] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Aug 26 07:31:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:34.062518 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa26f71-a76e-463f-b6fb-cc98e73e2e3b None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:34.115532 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 435/879] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:33 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 07:31:34.181750 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:34.193146 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa26f71-a76e-463f-b6fb-cc98e73e2e3b None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:34.232345 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7006a8-0c04-43cb-9f83-dfb55322561c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:34.233028 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7006a8-0c04-43cb-9f83-dfb55322561c None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:34.233239 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7006a8-0c04-43cb-9f83-dfb55322561c None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:34.234137 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7006a8-0c04-43cb-9f83-dfb55322561c None admin] PATH_INFO: `/v3/services` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:34.234793 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7006a8-0c04-43cb-9f83-dfb55322561c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:34.235126 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7006a8-0c04-43cb-9f83-dfb55322561c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:34.236524 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7006a8-0c04-43cb-9f83-dfb55322561c None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:34.241996 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 445/880] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Aug 26 07:31:34 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:34.407669 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14304f4-a100-45d5-9e20-16eb63f6fe63 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:34.507502 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:34.525120 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14304f4-a100-45d5-9e20-16eb63f6fe63 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:34.567886 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05d674-024e-4203-a704-5d27aa03a729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:34.568779 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05d674-024e-4203-a704-5d27aa03a729 None admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:34.569060 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05d674-024e-4203-a704-5d27aa03a729 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:34.569333 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05d674-024e-4203-a704-5d27aa03a729 None admin] PATH_INFO: `/v3/services` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:34.570013 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05d674-024e-4203-a704-5d27aa03a729 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:34.571505 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05d674-024e-4203-a704-5d27aa03a729 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:34.681985 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 436/881] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Aug 26 07:31:34 2022] POST /identity/v3/services => generated 269 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:31:34.729734 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2bc671-2783-4b6f-a2ee-ac10849f8c27 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:34.730420 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2bc671-2783-4b6f-a2ee-ac10849f8c27 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:34.730420 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2bc671-2783-4b6f-a2ee-ac10849f8c27 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:34.732010 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 446/882] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:31:34.738567 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920ce11-54cf-44b5-aa69-f2a88f3370e7 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:34.739303 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920ce11-54cf-44b5-aa69-f2a88f3370e7 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:34.739808 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920ce11-54cf-44b5-aa69-f2a88f3370e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:34.760907 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-3920ce11-54cf-44b5-aa69-f2a88f3370e7 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:34.762682 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-3920ce11-54cf-44b5-aa69-f2a88f3370e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:34.857002 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 437/883] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:34 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:31:34.993413 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a6d09-a601-42e6-a692-45a9d1b4280a None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:34.993413 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a6d09-a601-42e6-a692-45a9d1b4280a None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:34.993413 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a6d09-a601-42e6-a692-45a9d1b4280a None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:34.993413 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 447/884] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:31:35.003020 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fdb66-4849-428a-bf5f-1b7ec3533483 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:35.003020 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fdb66-4849-428a-bf5f-1b7ec3533483 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:35.003020 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fdb66-4849-428a-bf5f-1b7ec3533483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:35.019897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-749fdb66-4849-428a-bf5f-1b7ec3533483 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:35.021392 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-749fdb66-4849-428a-bf5f-1b7ec3533483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:35.102403 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 438/885] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:34 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:31:35.159491 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a6d09-a601-42e6-a692-45a9d1b4280a None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:35.279488 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a6d09-a601-42e6-a692-45a9d1b4280a None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:35.320670 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9ba52-a7f2-490e-a049-620b29b2a4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:35.321676 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9ba52-a7f2-490e-a049-620b29b2a4f9 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:35.322188 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9ba52-a7f2-490e-a049-620b29b2a4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:35.322715 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9ba52-a7f2-490e-a049-620b29b2a4f9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:35.323554 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec9ba52-a7f2-490e-a049-620b29b2a4f9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:35.325192 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec9ba52-a7f2-490e-a049-620b29b2a4f9 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:35.335703 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-9ec9ba52-a7f2-490e-a049-620b29b2a4f9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 07:31:35.335703 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:35.335703 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 07:31:35.335703 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 07:31:35.335703 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 07:31:35.335703 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 07:31:35.335703 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 07:31:35.335703 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:31:35.335703 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 07:31:35.335703 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:35.335703 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 07:31:35.335703 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:35.335703 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:35.335703 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:35.335703 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:35.335703 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:35.335703 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:35.336751 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:35.336751 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:35.336751 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:35.336751 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:35.336751 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:35.336751 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:35.336751 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 07:31:35.336751 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 07:31:35.336751 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 07:31:35.336751 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 07:31:35.336751 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:35.336751 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:35.336751 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:35.336751 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:35.336751 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:35.336751 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:35.337600 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:35.337600 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:35.337600 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:35.337600 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:35.337600 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:35.337600 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:35.337600 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:35.337600 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:35.337600 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:35.337600 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:35.337600 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 07:31:35.337600 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:31:35.337600 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 07:31:35.337600 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:35.340394 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 448/886] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 26 07:31:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:35.347376 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749fdb66-4849-428a-bf5f-1b7ec3533483 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:35.350486 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:35.389758 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9ba52-a7f2-490e-a049-620b29b2a4f9 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:35.424094 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:35.479689 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749fdb66-4849-428a-bf5f-1b7ec3533483 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:35.525558 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65e761-49d3-4510-adcb-c28f86c09b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:35.526639 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65e761-49d3-4510-adcb-c28f86c09b84 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:35.527218 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65e761-49d3-4510-adcb-c28f86c09b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:35.527734 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65e761-49d3-4510-adcb-c28f86c09b84 None admin] PATH_INFO: `/v3/services` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:35.528403 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9ba52-a7f2-490e-a049-620b29b2a4f9 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:35.528809 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65e761-49d3-4510-adcb-c28f86c09b84 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:35.529318 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65e761-49d3-4510-adcb-c28f86c09b84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:35.532406 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65e761-49d3-4510-adcb-c28f86c09b84 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:35.543094 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 439/887] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 26 07:31:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:31:35.544534 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65e761-49d3-4510-adcb-c28f86c09b84 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:35.571690 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf9d76-ef73-4c27-ad96-5458caa39aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:35.572333 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf9d76-ef73-4c27-ad96-5458caa39aa6 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:35.572609 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf9d76-ef73-4c27-ad96-5458caa39aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:35.572875 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf9d76-ef73-4c27-ad96-5458caa39aa6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:35.600101 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf9d76-ef73-4c27-ad96-5458caa39aa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:31:35.605740 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-32bf9d76-ef73-4c27-ad96-5458caa39aa6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 07:31:35.605740 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:35.605740 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:35.605740 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:35.605740 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:35.605740 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:35.605740 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:35.605740 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:35.605740 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:35.605740 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:35.605740 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:35.605740 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:35.605740 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:31:35.605740 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:31:35.605740 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:31:35.605740 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:31:35.606784 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:31:35.606784 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:31:35.606784 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:31:35.606784 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:31:35.606784 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:35.606784 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:35.606784 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:35.606784 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:35.606784 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:35.606784 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:35.606784 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:35.606784 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:35.606784 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:35.606784 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:35.606784 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:35.606784 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:35.608127 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:35.608127 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:35.608127 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:35.608127 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:35.608127 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:31:35.608127 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:31:35.608127 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:31:35.608127 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:31:35.608127 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:31:35.608127 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:31:35.608127 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 07:31:35.608127 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:35.610723 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 449/888] 10.222.0.42 () {56 vars in 1120 bytes} [Fri Aug 26 07:31:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 07:31:35.619708 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf9d76-ef73-4c27-ad96-5458caa39aa6 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:35.660137 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:35.708310 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65e761-49d3-4510-adcb-c28f86c09b84 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:35.737300 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:35.758885 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd751d89-e4f0-4245-b061-87e37dfef51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:35.759522 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd751d89-e4f0-4245-b061-87e37dfef51c None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:35.763159 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd751d89-e4f0-4245-b061-87e37dfef51c None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:35.763159 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd751d89-e4f0-4245-b061-87e37dfef51c None admin] PATH_INFO: `/v3/services` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:35.763159 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd751d89-e4f0-4245-b061-87e37dfef51c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:35.763159 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd751d89-e4f0-4245-b061-87e37dfef51c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:35.763159 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd751d89-e4f0-4245-b061-87e37dfef51c None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:35.770558 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 440/889] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 26 07:31:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:35.774443 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf9d76-ef73-4c27-ad96-5458caa39aa6 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:35.776357 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd751d89-e4f0-4245-b061-87e37dfef51c None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:35.827326 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ae5f6-2978-4c49-a473-e5de5e1396ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:35.828162 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ae5f6-2978-4c49-a473-e5de5e1396ee None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:35.828588 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ae5f6-2978-4c49-a473-e5de5e1396ee None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:35.828870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ae5f6-2978-4c49-a473-e5de5e1396ee None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:35.829564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ae5f6-2978-4c49-a473-e5de5e1396ee None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:35.829873 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ae5f6-2978-4c49-a473-e5de5e1396ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:35.831321 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ae5f6-2978-4c49-a473-e5de5e1396ee None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:35.846271 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 450/890] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Aug 26 07:31:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:35.847287 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ae5f6-2978-4c49-a473-e5de5e1396ee None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:35.921254 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd751d89-e4f0-4245-b061-87e37dfef51c None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:35.954856 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:35.968456 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65ce85-a309-40e0-a49d-83d88c9c6ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:35.977051 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65ce85-a309-40e0-a49d-83d88c9c6ebe None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:35.977051 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65ce85-a309-40e0-a49d-83d88c9c6ebe None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:35.977051 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65ce85-a309-40e0-a49d-83d88c9c6ebe None admin] PATH_INFO: `/v3/endpoints` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:35.977051 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b65ce85-a309-40e0-a49d-83d88c9c6ebe None admin] RBAC: Adding query filter params (interface=public, service_id=447e9897ce3d4bd591dab5eaf65bf88f, region_id=RegionOne) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:35.977051 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b65ce85-a309-40e0-a49d-83d88c9c6ebe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:35.977051 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b65ce85-a309-40e0-a49d-83d88c9c6ebe None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:35.989215 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ae5f6-2978-4c49-a473-e5de5e1396ee None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:35.993271 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 441/891] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Aug 26 07:31:35 2022] GET /identity/v3/endpoints?service_id=447e9897ce3d4bd591dab5eaf65bf88f&interface=public®ion_id=RegionOne => generated 194 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:36.001621 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65ce85-a309-40e0-a49d-83d88c9c6ebe None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:36.074680 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb37e78-64fe-4478-a614-e4806e9ee9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:36.075551 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb37e78-64fe-4478-a614-e4806e9ee9d5 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:36.075896 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb37e78-64fe-4478-a614-e4806e9ee9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:36.076234 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb37e78-64fe-4478-a614-e4806e9ee9d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:36.088563 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:36.091202 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb37e78-64fe-4478-a614-e4806e9ee9d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:36.093364 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb37e78-64fe-4478-a614-e4806e9ee9d5 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:36.110449 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-4bb37e78-64fe-4478-a614-e4806e9ee9d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:36.110449 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:36.110449 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:36.110449 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:36.110449 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:36.110449 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:36.110449 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:36.110449 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:36.110449 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:36.110449 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:36.110449 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:36.110449 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:36.110449 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:31:36.110449 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:31:36.110449 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:31:36.110449 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:31:36.111687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:36.111687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:36.111687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:36.111687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:36.111687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:36.111687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:36.111687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:36.111687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:36.111687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:36.111687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:36.111687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:36.111687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:36.111687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:36.111687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:36.111687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:36.111687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:36.111687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:31:36.113309 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:31:36.113309 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:36.113309 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:36.115341 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 451/892] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:31:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:36.117213 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb37e78-64fe-4478-a614-e4806e9ee9d5 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:36.152119 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65ce85-a309-40e0-a49d-83d88c9c6ebe None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:36.200934 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8b2db-4fec-437a-b590-bb5f16a42d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:36.202487 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8b2db-4fec-437a-b590-bb5f16a42d57 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:36.203113 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8b2db-4fec-437a-b590-bb5f16a42d57 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:36.203611 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8b2db-4fec-437a-b590-bb5f16a42d57 None admin] PATH_INFO: `/v3/services` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:36.204405 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa8b2db-4fec-437a-b590-bb5f16a42d57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:36.206509 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa8b2db-4fec-437a-b590-bb5f16a42d57 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:36.215636 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 442/893] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Aug 26 07:31:35 2022] GET /identity/v3/services => generated 1268 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:31:36.256156 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb37e78-64fe-4478-a614-e4806e9ee9d5 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:36.302473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c0d3d-4cfd-47b2-a325-236097acce04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:36.303528 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c0d3d-4cfd-47b2-a325-236097acce04 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:36.304021 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c0d3d-4cfd-47b2-a325-236097acce04 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:36.304522 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c0d3d-4cfd-47b2-a325-236097acce04 None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:36.305480 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c0d3d-4cfd-47b2-a325-236097acce04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:36.306061 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c0d3d-4cfd-47b2-a325-236097acce04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:36.307875 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c0d3d-4cfd-47b2-a325-236097acce04 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:36.309041 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f5ad6-bef6-48e8-a700-957f76b21d21 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:36.309323 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f5ad6-bef6-48e8-a700-957f76b21d21 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:36.309598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f5ad6-bef6-48e8-a700-957f76b21d21 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:36.315921 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 443/894] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 07:31:36.317293 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d8153-14d6-4c83-8159-1c72b7cad17d None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:36.317579 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d8153-14d6-4c83-8159-1c72b7cad17d None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:36.317853 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d8153-14d6-4c83-8159-1c72b7cad17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:36.328109 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 452/895] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:31:36.333406 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c0d3d-4cfd-47b2-a325-236097acce04 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:36.343428 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-523d8153-14d6-4c83-8159-1c72b7cad17d None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:36.344591 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-523d8153-14d6-4c83-8159-1c72b7cad17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:36.419141 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:36.440103 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:36.457899 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 444/896] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:36 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:31:36.484201 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c0d3d-4cfd-47b2-a325-236097acce04 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:36.523662 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c166b-ea58-448c-bc0e-075da26444ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:36.524625 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c166b-ea58-448c-bc0e-075da26444ed None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:36.525065 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c166b-ea58-448c-bc0e-075da26444ed None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:36.525493 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c166b-ea58-448c-bc0e-075da26444ed None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:36.534536 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c166b-ea58-448c-bc0e-075da26444ed None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:36.536411 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c166b-ea58-448c-bc0e-075da26444ed None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:36.549380 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-bd5c166b-ea58-448c-bc0e-075da26444ed None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 07:31:36.549380 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:36.549380 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:36.549380 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:36.549380 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:36.549380 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:36.549380 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:36.549380 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:36.549380 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:36.549380 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:36.549380 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:36.549380 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:36.549380 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 07:31:36.549380 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 07:31:36.549380 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 07:31:36.549380 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 07:31:36.550645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:36.550645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:36.550645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 07:31:36.550645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:31:36.550645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 07:31:36.550645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:31:36.550645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:36.550645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:36.550645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:36.550645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:36.550645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:36.550645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:36.550645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:36.550645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:36.550645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:36.550645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:36.550645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:36.550645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:36.551868 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:36.551868 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:36.551868 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 07:31:36.551868 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 07:31:36.551868 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 07:31:36.551868 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 07:31:36.551868 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 07:31:36.551868 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 07:31:36.551868 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 07:31:36.551868 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:36.554182 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 453/897] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Aug 26 07:31:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 07:31:36.560141 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d8153-14d6-4c83-8159-1c72b7cad17d None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:36.677298 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d8153-14d6-4c83-8159-1c72b7cad17d None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:36.715287 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87387d77-dcb2-460a-91f6-abb0bf35c156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:36.716165 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87387d77-dcb2-460a-91f6-abb0bf35c156 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:36.716624 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87387d77-dcb2-460a-91f6-abb0bf35c156 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:36.717050 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87387d77-dcb2-460a-91f6-abb0bf35c156 None admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:36.718157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87387d77-dcb2-460a-91f6-abb0bf35c156 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:36.718622 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87387d77-dcb2-460a-91f6-abb0bf35c156 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:36.720278 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87387d77-dcb2-460a-91f6-abb0bf35c156 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:36.741674 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 445/898] 10.222.0.42 () {56 vars in 1149 bytes} [Fri Aug 26 07:31:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:31:36.746760 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c166b-ea58-448c-bc0e-075da26444ed None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:36.750499 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87387d77-dcb2-460a-91f6-abb0bf35c156 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:36.815354 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:36.874756 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c166b-ea58-448c-bc0e-075da26444ed None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:36.880966 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87387d77-dcb2-460a-91f6-abb0bf35c156 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:36.891829 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:36.916629 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41fe5e-a6c0-4591-8a57-c1747e69e671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:36.917342 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41fe5e-a6c0-4591-8a57-c1747e69e671 None admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:36.917623 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41fe5e-a6c0-4591-8a57-c1747e69e671 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:36.917901 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41fe5e-a6c0-4591-8a57-c1747e69e671 None admin] PATH_INFO: `/v3/services` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:36.918583 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41fe5e-a6c0-4591-8a57-c1747e69e671 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:36.920007 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41fe5e-a6c0-4591-8a57-c1747e69e671 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:36.923520 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3244c9-00be-4f2b-ab8e-e69e9e846727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:36.924608 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3244c9-00be-4f2b-ab8e-e69e9e846727 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:36.925049 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3244c9-00be-4f2b-ab8e-e69e9e846727 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:36.925936 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3244c9-00be-4f2b-ab8e-e69e9e846727 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:37.000353 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3244c9-00be-4f2b-ab8e-e69e9e846727 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:37.001725 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3244c9-00be-4f2b-ab8e-e69e9e846727 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:37.012904 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 454/899] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Aug 26 07:31:36 2022] POST /identity/v3/services => generated 241 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:31:37.016619 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83b3dc-ff2f-4a0e-917f-ba7c7012c399 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:37.016901 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83b3dc-ff2f-4a0e-917f-ba7c7012c399 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:37.017169 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83b3dc-ff2f-4a0e-917f-ba7c7012c399 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:37.018735 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 455/900] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:31:37.024627 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d16f0-58a0-457c-9d00-18c7e4fe1d7f None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:37.024967 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d16f0-58a0-457c-9d00-18c7e4fe1d7f None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:37.025172 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d16f0-58a0-457c-9d00-18c7e4fe1d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:37.047093 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-1e2d16f0-58a0-457c-9d00-18c7e4fe1d7f None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:37.048360 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-1e2d16f0-58a0-457c-9d00-18c7e4fe1d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:37.086748 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:37.157475 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 446/901] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:31:36 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 07:31:37.165009 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3244c9-00be-4f2b-ab8e-e69e9e846727 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:37.168826 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 456/902] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:31:37.291952 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3244c9-00be-4f2b-ab8e-e69e9e846727 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:37.329997 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2312c-e564-4e45-9e7b-3341d1d3ecd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:37.330649 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2312c-e564-4e45-9e7b-3341d1d3ecd4 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:37.330925 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2312c-e564-4e45-9e7b-3341d1d3ecd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:37.331228 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2312c-e564-4e45-9e7b-3341d1d3ecd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:37.342442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c2312c-e564-4e45-9e7b-3341d1d3ecd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:37.344342 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c2312c-e564-4e45-9e7b-3341d1d3ecd4 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:37.352146 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:37.361264 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-98c2312c-e564-4e45-9e7b-3341d1d3ecd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:37.361264 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:37.361264 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:37.361264 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:37.361264 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:37.361264 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:37.361264 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:37.361264 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:37.361264 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:37.361264 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:37.361264 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:37.361264 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:37.361264 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:31:37.361264 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:31:37.361264 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:31:37.361264 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:31:37.365229 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:37.365229 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:37.365229 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:37.365229 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:37.365229 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:37.365229 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:37.365229 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:37.365229 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:37.365229 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:37.365229 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:37.365229 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:37.365229 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:37.365229 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:37.365229 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:37.365229 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:37.365229 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:37.365229 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:31:37.366346 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:31:37.366346 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:37.366346 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:37.366346 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 447/903] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:31:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:37.368459 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d16f0-58a0-457c-9d00-18c7e4fe1d7f None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:37.443717 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2312c-e564-4e45-9e7b-3341d1d3ecd4 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:37.492417 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:37.498305 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d16f0-58a0-457c-9d00-18c7e4fe1d7f None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:37.547502 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a644cc-aaaf-442d-ac25-cb9faab77412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:37.548384 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a644cc-aaaf-442d-ac25-cb9faab77412 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:37.548814 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a644cc-aaaf-442d-ac25-cb9faab77412 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:37.549244 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a644cc-aaaf-442d-ac25-cb9faab77412 None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:37.550106 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a644cc-aaaf-442d-ac25-cb9faab77412 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:37.550564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a644cc-aaaf-442d-ac25-cb9faab77412 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:37.552267 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a644cc-aaaf-442d-ac25-cb9faab77412 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:37.569107 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 457/904] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:31:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:37.575054 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a644cc-aaaf-442d-ac25-cb9faab77412 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:37.584897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2312c-e564-4e45-9e7b-3341d1d3ecd4 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:37.625495 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d7129-4537-4193-935f-e51b9c9a484e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:37.626450 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d7129-4537-4193-935f-e51b9c9a484e None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:37.626866 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d7129-4537-4193-935f-e51b9c9a484e None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:37.627364 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d7129-4537-4193-935f-e51b9c9a484e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:37.628399 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d7129-4537-4193-935f-e51b9c9a484e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:37.630740 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d7129-4537-4193-935f-e51b9c9a484e None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:37.641427 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-641d7129-4537-4193-935f-e51b9c9a484e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 07:31:37.641427 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:37.641427 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 07:31:37.641427 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 07:31:37.641427 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 07:31:37.641427 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 07:31:37.641427 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 07:31:37.641427 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:31:37.641427 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 07:31:37.641427 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:37.641427 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 07:31:37.641427 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:37.641427 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:37.641427 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:37.641427 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:37.641427 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:37.642439 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:37.642439 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:37.642439 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:37.642439 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:37.642439 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:37.642439 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:37.642439 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:37.642439 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 07:31:37.642439 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 07:31:37.642439 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 07:31:37.642439 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 07:31:37.642439 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:37.642439 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:37.642439 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:37.642439 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:37.642439 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:37.642439 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:37.643381 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:37.643381 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:37.643381 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:37.643381 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:37.643381 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:37.643381 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:37.643381 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:37.643381 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:37.643381 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:37.643381 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:37.643381 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 07:31:37.643381 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:31:37.643381 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 07:31:37.643381 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:37.643381 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 448/905] 10.222.0.42 () {56 vars in 1132 bytes} [Fri Aug 26 07:31:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 07:31:37.650001 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d7129-4537-4193-935f-e51b9c9a484e None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:37.727706 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:37.732754 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a644cc-aaaf-442d-ac25-cb9faab77412 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:37.790628 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d7129-4537-4193-935f-e51b9c9a484e None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:37.790949 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417fceb-3e5e-49b0-a419-be07bdc2a7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:37.791608 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417fceb-3e5e-49b0-a419-be07bdc2a7a5 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:37.791888 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417fceb-3e5e-49b0-a419-be07bdc2a7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:37.792160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417fceb-3e5e-49b0-a419-be07bdc2a7a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:37.802049 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d417fceb-3e5e-49b0-a419-be07bdc2a7a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:37.804047 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d417fceb-3e5e-49b0-a419-be07bdc2a7a5 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:37.820702 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-d417fceb-3e5e-49b0-a419-be07bdc2a7a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:31:37.820702 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:37.820702 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:37.820702 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:37.820702 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:37.820702 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:37.820702 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:37.820702 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:37.820702 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:37.820702 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:37.820702 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:37.820702 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:37.820702 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 07:31:37.820702 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 07:31:37.820702 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 07:31:37.821688 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 07:31:37.821688 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:37.821688 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:37.821688 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:37.821688 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:37.821688 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:37.821688 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:37.821688 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:37.821688 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:37.821688 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:37.821688 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:37.821688 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:37.821688 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:37.821688 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:37.821688 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:37.821688 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:37.821688 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:37.822576 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 07:31:37.822576 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 07:31:37.822576 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 07:31:37.822576 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 07:31:37.822576 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 07:31:37.822576 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 07:31:37.822576 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:31:37.822576 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:37.827904 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 458/906] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:31:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:37.828904 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417fceb-3e5e-49b0-a419-be07bdc2a7a5 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:37.841894 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b10642-fccb-41e5-9642-0d80f3f3f0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:37.843502 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b10642-fccb-41e5-9642-0d80f3f3f0a3 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:37.843784 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b10642-fccb-41e5-9642-0d80f3f3f0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:37.844349 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b10642-fccb-41e5-9642-0d80f3f3f0a3 None admin] PATH_INFO: `/v3/services` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:37.844995 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b10642-fccb-41e5-9642-0d80f3f3f0a3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:37.845301 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b10642-fccb-41e5-9642-0d80f3f3f0a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:37.847295 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b10642-fccb-41e5-9642-0d80f3f3f0a3 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:37.850386 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:37.853664 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 449/907] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Aug 26 07:31:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:31:37.861166 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b10642-fccb-41e5-9642-0d80f3f3f0a3 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:37.962910 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417fceb-3e5e-49b0-a419-be07bdc2a7a5 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:38.000566 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b10642-fccb-41e5-9642-0d80f3f3f0a3 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:38.014805 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e24f1e-5c7e-4547-b530-0935161b8f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:38.015934 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e24f1e-5c7e-4547-b530-0935161b8f37 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:38.016319 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e24f1e-5c7e-4547-b530-0935161b8f37 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:38.017209 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e24f1e-5c7e-4547-b530-0935161b8f37 None admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:38.018210 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e24f1e-5c7e-4547-b530-0935161b8f37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:38.018687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e24f1e-5c7e-4547-b530-0935161b8f37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:38.020569 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e24f1e-5c7e-4547-b530-0935161b8f37 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:38.034556 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:38.039338 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 459/908] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 26 07:31:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:38.045152 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e24f1e-5c7e-4547-b530-0935161b8f37 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:38.050554 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181135b-f3e0-4413-83c3-e13066a68a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:38.051492 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181135b-f3e0-4413-83c3-e13066a68a10 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:38.051952 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181135b-f3e0-4413-83c3-e13066a68a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:38.052528 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181135b-f3e0-4413-83c3-e13066a68a10 None admin] PATH_INFO: `/v3/services` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:38.053398 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f181135b-f3e0-4413-83c3-e13066a68a10 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:38.053884 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f181135b-f3e0-4413-83c3-e13066a68a10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:38.055508 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f181135b-f3e0-4413-83c3-e13066a68a10 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:38.061570 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 450/909] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Aug 26 07:31:37 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:38.067488 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181135b-f3e0-4413-83c3-e13066a68a10 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:38.147268 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:38.186927 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e24f1e-5c7e-4547-b530-0935161b8f37 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:38.224404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181135b-f3e0-4413-83c3-e13066a68a10 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:38.237637 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ea9c6-63ba-4ba6-a354-5bdd6fa8c85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:38.238801 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ea9c6-63ba-4ba6-a354-5bdd6fa8c85e None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:38.239356 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ea9c6-63ba-4ba6-a354-5bdd6fa8c85e None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:38.239792 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ea9c6-63ba-4ba6-a354-5bdd6fa8c85e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:38.240949 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ea9c6-63ba-4ba6-a354-5bdd6fa8c85e None admin] RBAC: Adding query filter params (role.id=dc39243380ac40299d78581303d95252, scope.project.id=becbf57e91454d499dec313ff9eadfae, user.id=30dc2621143f4604b53bb44b82e8efbb) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:38.241939 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ea9c6-63ba-4ba6-a354-5bdd6fa8c85e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:38.243837 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ea9c6-63ba-4ba6-a354-5bdd6fa8c85e None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:38.259798 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 460/910] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:31:38 2022] GET /identity/v3/role_assignments?user.id=30dc2621143f4604b53bb44b82e8efbb&scope.project.id=becbf57e91454d499dec313ff9eadfae&role.id=dc39243380ac40299d78581303d95252 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:31:38.275897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35531fa3-2bdf-432e-9528-4dd9ac2f8847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:38.276968 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35531fa3-2bdf-432e-9528-4dd9ac2f8847 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:38.277415 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35531fa3-2bdf-432e-9528-4dd9ac2f8847 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:38.277897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35531fa3-2bdf-432e-9528-4dd9ac2f8847 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:38.279153 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35531fa3-2bdf-432e-9528-4dd9ac2f8847 None admin] RBAC: Adding query filter params (interface=public, service_id=78a6aa664df94881825ac50bc01bc93a, region_id=RegionOne) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:38.279849 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35531fa3-2bdf-432e-9528-4dd9ac2f8847 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:38.282620 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35531fa3-2bdf-432e-9528-4dd9ac2f8847 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:38.291053 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 451/911] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Aug 26 07:31:38 2022] GET /identity/v3/endpoints?service_id=78a6aa664df94881825ac50bc01bc93a&interface=public®ion_id=RegionOne => generated 194 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:38.300651 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ea9c6-63ba-4ba6-a354-5bdd6fa8c85e None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:38.432732 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ea9c6-63ba-4ba6-a354-5bdd6fa8c85e None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:38.453341 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93298a-28b2-46c6-ada6-65a48c6ced25 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:38.453672 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93298a-28b2-46c6-ada6-65a48c6ced25 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:38.453920 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93298a-28b2-46c6-ada6-65a48c6ced25 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:38.459966 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 452/912] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:31:38.462674 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db462f4-ccbf-4608-9cfb-d4de7c207e28 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:38.463139 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db462f4-ccbf-4608-9cfb-d4de7c207e28 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:38.463542 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db462f4-ccbf-4608-9cfb-d4de7c207e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:38.471268 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9822867c-6785-43aa-b17f-c3d7dc0c0e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:38.471894 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822867c-6785-43aa-b17f-c3d7dc0c0e68 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:38.472199 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822867c-6785-43aa-b17f-c3d7dc0c0e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:38.472770 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822867c-6785-43aa-b17f-c3d7dc0c0e68 None admin] PATH_INFO: `/v3/services` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:38.474393 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9822867c-6785-43aa-b17f-c3d7dc0c0e68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:38.475819 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9822867c-6785-43aa-b17f-c3d7dc0c0e68 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:38.483582 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 461/913] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Aug 26 07:31:38 2022] GET /identity/v3/services => generated 1497 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:31:38.492373 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-8db462f4-ccbf-4608-9cfb-d4de7c207e28 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:38.493700 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-8db462f4-ccbf-4608-9cfb-d4de7c207e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:38.557245 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:38.579744 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 453/914] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:31:38.889946 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9822867c-6785-43aa-b17f-c3d7dc0c0e68 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:38.900387 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:39.000942 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9822867c-6785-43aa-b17f-c3d7dc0c0e68 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:39.040921 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e41a4f-80df-4912-bb0f-ed0424b08b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:39.041508 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e41a4f-80df-4912-bb0f-ed0424b08b39 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:39.041788 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e41a4f-80df-4912-bb0f-ed0424b08b39 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:39.042066 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e41a4f-80df-4912-bb0f-ed0424b08b39 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:39.042663 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e41a4f-80df-4912-bb0f-ed0424b08b39 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:39.044063 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e41a4f-80df-4912-bb0f-ed0424b08b39 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:39.053966 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-84e41a4f-80df-4912-bb0f-ed0424b08b39 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 07:31:39.053966 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:39.053966 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 07:31:39.053966 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 07:31:39.053966 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 07:31:39.053966 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 07:31:39.053966 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 07:31:39.053966 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:31:39.053966 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 07:31:39.053966 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:39.053966 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 07:31:39.053966 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:39.053966 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:39.053966 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:39.053966 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:39.053966 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:39.053966 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:39.055019 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:39.055019 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:39.055019 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:39.055019 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:39.055019 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:39.055019 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:39.055019 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 07:31:39.055019 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 07:31:39.055019 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 07:31:39.055019 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 07:31:39.055019 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:39.055019 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:39.055019 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:39.055019 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:39.055019 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:39.055019 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:39.055871 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:39.055871 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:39.055871 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:39.055871 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:39.055871 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:39.055871 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:39.055871 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:39.055871 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:39.055871 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:39.055871 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:39.055871 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 07:31:39.055871 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:31:39.055871 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 07:31:39.055871 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:39.059100 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 462/915] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 26 07:31:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:39.062291 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db462f4-ccbf-4608-9cfb-d4de7c207e28 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:39.174750 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db462f4-ccbf-4608-9cfb-d4de7c207e28 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:39.212559 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21b925-0ef3-4c57-a86d-0e7858a71cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:39.213214 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21b925-0ef3-4c57-a86d-0e7858a71cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:39.213489 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21b925-0ef3-4c57-a86d-0e7858a71cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:39.213760 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21b925-0ef3-4c57-a86d-0e7858a71cc0 None admin] PATH_INFO: `/v3/services` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:39.214396 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21b925-0ef3-4c57-a86d-0e7858a71cc0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:39.214752 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21b925-0ef3-4c57-a86d-0e7858a71cc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:39.216171 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21b925-0ef3-4c57-a86d-0e7858a71cc0 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:39.222347 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 454/916] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 26 07:31:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:31:39.228098 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e41a4f-80df-4912-bb0f-ed0424b08b39 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:39.297056 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d783cc0-0027-4795-89f0-c1b0eef61039 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:39.297666 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d783cc0-0027-4795-89f0-c1b0eef61039 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:39.298161 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d783cc0-0027-4795-89f0-c1b0eef61039 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:39.300020 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 455/917] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:31:39.305604 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188de017-4020-45b6-9d6d-ba1d978b377e None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:39.306127 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188de017-4020-45b6-9d6d-ba1d978b377e None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:39.306613 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188de017-4020-45b6-9d6d-ba1d978b377e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:39.323029 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:39.327723 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-188de017-4020-45b6-9d6d-ba1d978b377e None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:39.329121 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-188de017-4020-45b6-9d6d-ba1d978b377e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:39.364299 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e41a4f-80df-4912-bb0f-ed0424b08b39 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:39.394919 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:39.409374 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ba2a4-7dc9-459d-adcf-6f789a70ac1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:39.410467 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ba2a4-7dc9-459d-adcf-6f789a70ac1c None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:39.411261 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ba2a4-7dc9-459d-adcf-6f789a70ac1c None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:39.411975 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ba2a4-7dc9-459d-adcf-6f789a70ac1c None admin] PATH_INFO: `/v3/services` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:39.412798 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ba2a4-7dc9-459d-adcf-6f789a70ac1c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:39.413415 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ba2a4-7dc9-459d-adcf-6f789a70ac1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:39.416406 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ba2a4-7dc9-459d-adcf-6f789a70ac1c None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:39.423035 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 456/918] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 07:31:39.433555 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 463/919] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Aug 26 07:31:39 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:39.441916 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188de017-4020-45b6-9d6d-ba1d978b377e None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:39.555118 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188de017-4020-45b6-9d6d-ba1d978b377e None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:39.592430 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f27c97-4e00-445c-964c-adcff3ccee59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:39.593097 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f27c97-4e00-445c-964c-adcff3ccee59 None admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:39.593369 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f27c97-4e00-445c-964c-adcff3ccee59 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:39.593642 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f27c97-4e00-445c-964c-adcff3ccee59 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:39.594322 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f27c97-4e00-445c-964c-adcff3ccee59 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:39.595724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f27c97-4e00-445c-964c-adcff3ccee59 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:39.679454 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 457/920] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:31:39 2022] POST /identity/v3/endpoints => generated 346 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:31:39.735847 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ba2a4-7dc9-459d-adcf-6f789a70ac1c None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:39.876535 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ba2a4-7dc9-459d-adcf-6f789a70ac1c None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:39.923705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:39.930660 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8790e4-f520-4fb2-b937-d60e0b3a67e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:39.931348 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8790e4-f520-4fb2-b937-d60e0b3a67e6 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:39.931955 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8790e4-f520-4fb2-b937-d60e0b3a67e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:39.932233 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8790e4-f520-4fb2-b937-d60e0b3a67e6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:39.932824 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8790e4-f520-4fb2-b937-d60e0b3a67e6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:39.934211 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8790e4-f520-4fb2-b937-d60e0b3a67e6 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:39.959114 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-cf8790e4-f520-4fb2-b937-d60e0b3a67e6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 07:31:39.959114 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:39.959114 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 07:31:39.959114 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 07:31:39.959114 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 07:31:39.959114 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 07:31:39.959114 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 07:31:39.959114 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:31:39.959114 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 07:31:39.959114 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:39.959114 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 07:31:39.959114 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:39.959114 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:39.959114 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:39.959114 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:39.959114 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:39.959114 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:39.960181 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:39.960181 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:39.960181 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:39.960181 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:39.960181 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:39.960181 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:39.960181 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 07:31:39.960181 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 07:31:39.960181 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 07:31:39.960181 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 07:31:39.960181 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:39.960181 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:39.960181 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:39.960181 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:39.960181 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:39.960181 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:39.961010 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:39.961010 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:39.961010 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:39.961010 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:39.961010 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:39.961010 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:39.961010 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:39.961010 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:39.961010 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:39.961010 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:39.961010 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 07:31:39.961010 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:31:39.961010 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 07:31:39.961010 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:39.961010 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 464/921] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Aug 26 07:31:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:39.969122 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f27c97-4e00-445c-964c-adcff3ccee59 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:40.010015 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:40.104216 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f27c97-4e00-445c-964c-adcff3ccee59 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:40.149880 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50027e1d-edc5-452c-bf44-89426ad05859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:40.150898 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50027e1d-edc5-452c-bf44-89426ad05859 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:40.151410 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50027e1d-edc5-452c-bf44-89426ad05859 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:40.151874 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50027e1d-edc5-452c-bf44-89426ad05859 None admin] PATH_INFO: `/v3/services` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:40.152718 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50027e1d-edc5-452c-bf44-89426ad05859 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:40.153472 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50027e1d-edc5-452c-bf44-89426ad05859 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:40.157190 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50027e1d-edc5-452c-bf44-89426ad05859 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:40.167015 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 458/922] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Aug 26 07:31:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:40.176418 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8790e4-f520-4fb2-b937-d60e0b3a67e6 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:40.293991 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8790e4-f520-4fb2-b937-d60e0b3a67e6 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:40.333094 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144b979-b93e-4fed-9945-6cec8824cd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:40.333716 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144b979-b93e-4fed-9945-6cec8824cd85 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:40.333993 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144b979-b93e-4fed-9945-6cec8824cd85 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:40.334266 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144b979-b93e-4fed-9945-6cec8824cd85 None admin] PATH_INFO: `/v3/services` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:40.334905 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144b979-b93e-4fed-9945-6cec8824cd85 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:40.335235 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144b979-b93e-4fed-9945-6cec8824cd85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:40.336644 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144b979-b93e-4fed-9945-6cec8824cd85 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:40.342682 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 465/923] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Aug 26 07:31:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:40.348590 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50027e1d-edc5-452c-bf44-89426ad05859 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:40.423039 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51529e05-05a2-4ace-8f7d-a4a5e44d74c0 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:40.423359 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51529e05-05a2-4ace-8f7d-a4a5e44d74c0 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:40.423546 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51529e05-05a2-4ace-8f7d-a4a5e44d74c0 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:40.424980 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 466/924] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 07:31:40.431698 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc27405-df5e-4a0b-b0df-474b40c5cd2a None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:40.432250 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc27405-df5e-4a0b-b0df-474b40c5cd2a None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:40.433282 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc27405-df5e-4a0b-b0df-474b40c5cd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:40.458465 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:40.460686 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-6bc27405-df5e-4a0b-b0df-474b40c5cd2a None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:40.462208 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-6bc27405-df5e-4a0b-b0df-474b40c5cd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:40.462322 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50027e1d-edc5-452c-bf44-89426ad05859 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:40.509758 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ffe28-9730-472b-a7b4-095bc410b03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:40.510439 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ffe28-9730-472b-a7b4-095bc410b03c None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:40.510704 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ffe28-9730-472b-a7b4-095bc410b03c None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:40.511038 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ffe28-9730-472b-a7b4-095bc410b03c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:40.511761 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ffe28-9730-472b-a7b4-095bc410b03c None admin] RBAC: Adding query filter params (interface=public, service_id=b031190d44b945f89467cc4cb710d983, region_id=RegionOne) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:40.512175 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ffe28-9730-472b-a7b4-095bc410b03c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:40.513669 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ffe28-9730-472b-a7b4-095bc410b03c None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:40.520957 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 459/925] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Aug 26 07:31:40 2022] GET /identity/v3/endpoints?service_id=b031190d44b945f89467cc4cb710d983&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:40.526649 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ffe28-9730-472b-a7b4-095bc410b03c None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:40.547377 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:40.563104 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 467/926] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 07:31:40.564570 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12557c7d-40fe-4919-8c94-6ee6c7348f5b None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:40.564976 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12557c7d-40fe-4919-8c94-6ee6c7348f5b None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:40.565323 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12557c7d-40fe-4919-8c94-6ee6c7348f5b None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:40.566810 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 468/927] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:31:40.572435 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5d389-c21a-4e23-bc33-ab75c0bced2c None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:40.572786 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5d389-c21a-4e23-bc33-ab75c0bced2c None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:40.573331 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5d389-c21a-4e23-bc33-ab75c0bced2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:40.595111 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-01c5d389-c21a-4e23-bc33-ab75c0bced2c None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:40.596427 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-01c5d389-c21a-4e23-bc33-ab75c0bced2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:40.660537 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ffe28-9730-472b-a7b4-095bc410b03c None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:40.695232 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 469/928] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 07:31:40.711773 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84201f51-db3b-4582-a8e0-7837718c12db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:40.712440 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84201f51-db3b-4582-a8e0-7837718c12db None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:40.712720 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84201f51-db3b-4582-a8e0-7837718c12db None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:40.712990 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84201f51-db3b-4582-a8e0-7837718c12db None admin] PATH_INFO: `/v3/services` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:40.713599 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84201f51-db3b-4582-a8e0-7837718c12db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:40.715119 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84201f51-db3b-4582-a8e0-7837718c12db None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:40.728064 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 460/929] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Aug 26 07:31:40 2022] GET /identity/v3/services => generated 1497 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 07:31:40.852618 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5d389-c21a-4e23-bc33-ab75c0bced2c None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:40.979345 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5d389-c21a-4e23-bc33-ab75c0bced2c None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:40.990810 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84201f51-db3b-4582-a8e0-7837718c12db None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:41.001935 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:41.024408 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ea4ff-e69a-4010-8752-ae5bbb381137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:41.025059 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ea4ff-e69a-4010-8752-ae5bbb381137 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:41.025340 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ea4ff-e69a-4010-8752-ae5bbb381137 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:41.025610 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ea4ff-e69a-4010-8752-ae5bbb381137 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:41.032296 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:41.042422 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ea4ff-e69a-4010-8752-ae5bbb381137 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:31:41.048024 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-217ea4ff-e69a-4010-8752-ae5bbb381137 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 07:31:41.048024 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:41.048024 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:41.048024 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:41.048024 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:41.048024 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:41.048024 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:41.048024 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:41.048024 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:41.048024 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:41.048024 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:41.048024 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:41.048024 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:31:41.048024 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:31:41.048024 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:31:41.048024 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:31:41.050232 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:31:41.050232 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:31:41.050232 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:31:41.050232 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:31:41.050232 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:41.050232 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:41.050232 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:41.050232 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:41.050232 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:41.050232 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:41.050232 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:41.050232 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:41.050232 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:41.050232 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:41.050232 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:41.050232 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:41.055495 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:41.055495 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:41.055495 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:41.055495 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:41.055495 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:31:41.055495 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:31:41.055495 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:31:41.055495 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:31:41.055495 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:31:41.055495 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:31:41.055495 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 07:31:41.055495 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:41.055495 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 470/930] 10.222.0.42 () {56 vars in 1120 bytes} [Fri Aug 26 07:31:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:41.055495 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ea4ff-e69a-4010-8752-ae5bbb381137 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:41.142925 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84201f51-db3b-4582-a8e0-7837718c12db None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:41.186923 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ea4ff-e69a-4010-8752-ae5bbb381137 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:41.188985 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b295a1-078c-4941-9971-6786c6e5e20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:41.190647 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b295a1-078c-4941-9971-6786c6e5e20b None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:41.190933 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b295a1-078c-4941-9971-6786c6e5e20b None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:41.191246 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b295a1-078c-4941-9971-6786c6e5e20b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:41.191848 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b295a1-078c-4941-9971-6786c6e5e20b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:41.193249 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b295a1-078c-4941-9971-6786c6e5e20b None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:41.206749 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-52b295a1-078c-4941-9971-6786c6e5e20b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 07:31:41.206749 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:41.206749 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 07:31:41.206749 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 07:31:41.206749 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 07:31:41.206749 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 07:31:41.206749 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 07:31:41.206749 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:31:41.206749 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 07:31:41.206749 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:41.206749 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 07:31:41.206749 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:41.206749 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:41.206749 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:41.206749 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:41.206749 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:41.208739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:41.208739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:41.208739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:41.208739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:41.208739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:41.208739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:41.208739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:41.208739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 07:31:41.208739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 07:31:41.208739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 07:31:41.208739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 07:31:41.208739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:41.208739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:41.208739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:41.208739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:41.208739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:41.208739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:41.210023 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:41.210023 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:41.210023 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:41.210023 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:41.210023 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:41.210023 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:41.210023 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:41.210023 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:41.210023 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:41.210023 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:41.210023 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 07:31:41.210023 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:31:41.210023 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 07:31:41.210023 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:41.210023 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 461/931] 10.222.0.42 () {56 vars in 1132 bytes} [Fri Aug 26 07:31:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 07:31:41.214630 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b295a1-078c-4941-9971-6786c6e5e20b None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:41.229974 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4bead-535f-4fe2-926a-7b333749ffd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:41.230596 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4bead-535f-4fe2-926a-7b333749ffd8 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:41.230939 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4bead-535f-4fe2-926a-7b333749ffd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:41.231299 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4bead-535f-4fe2-926a-7b333749ffd8 None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:41.232038 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4bead-535f-4fe2-926a-7b333749ffd8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:41.232402 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4bead-535f-4fe2-926a-7b333749ffd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:41.234414 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4bead-535f-4fe2-926a-7b333749ffd8 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:41.248564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 471/932] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Aug 26 07:31:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:31:41.249672 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4bead-535f-4fe2-926a-7b333749ffd8 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:41.309573 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:41.361606 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b295a1-078c-4941-9971-6786c6e5e20b None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:41.369934 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:41.382075 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4bead-535f-4fe2-926a-7b333749ffd8 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:41.402512 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be1e19-28a0-4fab-80d0-79cdbd814e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:41.403313 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be1e19-28a0-4fab-80d0-79cdbd814e77 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:41.403662 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be1e19-28a0-4fab-80d0-79cdbd814e77 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:41.404125 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be1e19-28a0-4fab-80d0-79cdbd814e77 None admin] PATH_INFO: `/v3/services` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:41.405051 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68be1e19-28a0-4fab-80d0-79cdbd814e77 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:41.405426 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68be1e19-28a0-4fab-80d0-79cdbd814e77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:41.406903 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68be1e19-28a0-4fab-80d0-79cdbd814e77 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:41.417864 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 462/933] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Aug 26 07:31:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:41.419047 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be1e19-28a0-4fab-80d0-79cdbd814e77 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:41.425611 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a8aa5-eb53-42df-9327-f733ce66c1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:41.426264 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a8aa5-eb53-42df-9327-f733ce66c1a4 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:41.426542 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a8aa5-eb53-42df-9327-f733ce66c1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:41.426813 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a8aa5-eb53-42df-9327-f733ce66c1a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:41.442166 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a8aa5-eb53-42df-9327-f733ce66c1a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:41.444565 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a8aa5-eb53-42df-9327-f733ce66c1a4 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:41.465033 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-187a8aa5-eb53-42df-9327-f733ce66c1a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:41.465033 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:41.465033 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:41.465033 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:41.465033 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:41.465033 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:41.465033 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:41.465033 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:41.465033 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:41.465033 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:41.465033 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:41.465033 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:41.465033 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:31:41.465033 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:31:41.465033 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:31:41.465033 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:31:41.467554 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:41.467554 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:41.467554 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:41.467554 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:41.467554 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:41.467554 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:41.467554 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:41.467554 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:41.467554 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:41.467554 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:41.467554 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:41.467554 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:41.467554 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:41.467554 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:41.467554 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:41.467554 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:41.467554 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:31:41.469672 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:31:41.469672 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:41.469672 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:41.469672 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 472/934] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:31:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:41.478186 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a8aa5-eb53-42df-9327-f733ce66c1a4 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:41.553036 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be1e19-28a0-4fab-80d0-79cdbd814e77 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:41.593778 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4489a934-4c5b-4dc8-a6b8-42999f7a5ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:41.594666 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489a934-4c5b-4dc8-a6b8-42999f7a5ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:41.595030 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489a934-4c5b-4dc8-a6b8-42999f7a5ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:41.595405 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489a934-4c5b-4dc8-a6b8-42999f7a5ab8 None admin] PATH_INFO: `/v3/services` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:41.596135 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4489a934-4c5b-4dc8-a6b8-42999f7a5ab8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:41.596605 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4489a934-4c5b-4dc8-a6b8-42999f7a5ab8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:41.598273 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4489a934-4c5b-4dc8-a6b8-42999f7a5ab8 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:41.608972 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 463/935] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Aug 26 07:31:41 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:41.610305 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:41.619338 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4489a934-4c5b-4dc8-a6b8-42999f7a5ab8 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:41.629163 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a8aa5-eb53-42df-9327-f733ce66c1a4 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:41.658233 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:41.676841 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec26fae-6c00-48e1-8048-3bc4a5db7212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:41.677532 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec26fae-6c00-48e1-8048-3bc4a5db7212 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:41.677814 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec26fae-6c00-48e1-8048-3bc4a5db7212 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:41.678089 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec26fae-6c00-48e1-8048-3bc4a5db7212 None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:41.679463 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec26fae-6c00-48e1-8048-3bc4a5db7212 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:41.679776 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec26fae-6c00-48e1-8048-3bc4a5db7212 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:41.681195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec26fae-6c00-48e1-8048-3bc4a5db7212 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:41.704290 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 473/936] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:31:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:41.705255 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec26fae-6c00-48e1-8048-3bc4a5db7212 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:41.779331 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4489a934-4c5b-4dc8-a6b8-42999f7a5ab8 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:41.822670 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8f2e7-6561-4921-a3b2-649f45e60b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:41.823680 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8f2e7-6561-4921-a3b2-649f45e60b85 None admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:41.824167 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8f2e7-6561-4921-a3b2-649f45e60b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:41.824669 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8f2e7-6561-4921-a3b2-649f45e60b85 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:41.825667 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8f2e7-6561-4921-a3b2-649f45e60b85 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:41.827984 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8f2e7-6561-4921-a3b2-649f45e60b85 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:41.843441 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec26fae-6c00-48e1-8048-3bc4a5db7212 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:41.884280 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0d4c8-ce81-4e90-b923-12502b851554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:41.884926 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0d4c8-ce81-4e90-b923-12502b851554 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:41.885216 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0d4c8-ce81-4e90-b923-12502b851554 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:41.885506 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0d4c8-ce81-4e90-b923-12502b851554 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:41.894499 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea0d4c8-ce81-4e90-b923-12502b851554 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:41.896032 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea0d4c8-ce81-4e90-b923-12502b851554 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:41.907424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-cea0d4c8-ce81-4e90-b923-12502b851554 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 07:31:41.907424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:41.907424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:41.907424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:41.907424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:41.907424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:41.907424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:41.907424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:41.907424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:41.907424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:41.907424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:41.907424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:41.907424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 07:31:41.907424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 07:31:41.907424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 07:31:41.907424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 07:31:41.910448 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:41.910448 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:41.910448 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 07:31:41.910448 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:31:41.910448 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 07:31:41.910448 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:31:41.910448 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:41.910448 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:41.910448 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:41.910448 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:41.910448 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:41.910448 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:41.910448 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:41.910448 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:41.910448 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:41.910448 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:41.910448 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:41.910448 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:41.916931 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:41.916931 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:41.916931 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 07:31:41.916931 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 07:31:41.916931 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 07:31:41.916931 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 07:31:41.916931 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 07:31:41.916931 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 07:31:41.916931 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 07:31:41.916931 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:41.916931 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 474/937] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Aug 26 07:31:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:41.916931 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f790749-f5d8-44b6-8450-9b29526d34b8 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:41.916931 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f790749-f5d8-44b6-8450-9b29526d34b8 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:41.918377 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f790749-f5d8-44b6-8450-9b29526d34b8 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:41.918377 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 475/938] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:31:41.918377 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f790749-f5d8-44b6-8450-9b29526d34b8 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:41.934171 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:41.948424 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 464/939] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:31:41 2022] POST /identity/v3/endpoints => generated 347 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:31:41.949919 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80027af6-d348-46a0-be7f-04db1edbc6e4 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:41.953577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80027af6-d348-46a0-be7f-04db1edbc6e4 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:41.953577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80027af6-d348-46a0-be7f-04db1edbc6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:41.976911 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-80027af6-d348-46a0-be7f-04db1edbc6e4 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:41.978267 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-80027af6-d348-46a0-be7f-04db1edbc6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:42.080708 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f790749-f5d8-44b6-8450-9b29526d34b8 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:42.082579 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:42.096275 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 465/940] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:31:42.134917 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b566f6-58cb-48e2-8f21-2b4643c55f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:42.140745 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b566f6-58cb-48e2-8f21-2b4643c55f0f None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:42.140745 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b566f6-58cb-48e2-8f21-2b4643c55f0f None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:42.140745 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b566f6-58cb-48e2-8f21-2b4643c55f0f None admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:42.140745 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b566f6-58cb-48e2-8f21-2b4643c55f0f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:42.140745 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b566f6-58cb-48e2-8f21-2b4643c55f0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:42.140745 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b566f6-58cb-48e2-8f21-2b4643c55f0f None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:42.160429 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 476/941] 10.222.0.42 () {56 vars in 1149 bytes} [Fri Aug 26 07:31:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:31:42.166310 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80027af6-d348-46a0-be7f-04db1edbc6e4 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:42.300609 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80027af6-d348-46a0-be7f-04db1edbc6e4 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:42.343210 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a628ae-b15e-4820-b212-79669e006bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:42.343782 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a628ae-b15e-4820-b212-79669e006bb7 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:42.344062 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a628ae-b15e-4820-b212-79669e006bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:42.344337 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a628ae-b15e-4820-b212-79669e006bb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:42.360126 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a628ae-b15e-4820-b212-79669e006bb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:42.361623 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a628ae-b15e-4820-b212-79669e006bb7 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:42.383441 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-17a628ae-b15e-4820-b212-79669e006bb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:42.383441 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:42.383441 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:42.383441 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:42.383441 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:42.383441 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:42.383441 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:42.383441 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:42.383441 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:42.383441 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:42.383441 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:42.383441 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:42.383441 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:31:42.383441 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:31:42.383441 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:31:42.383441 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:31:42.384448 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:42.384448 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:42.384448 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:42.384448 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:42.384448 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:42.384448 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:42.384448 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:42.384448 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:42.384448 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:42.384448 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:42.384448 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:42.384448 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:42.384448 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:42.384448 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:42.384448 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:42.384448 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:42.384448 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:31:42.385321 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:31:42.385321 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:42.385321 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:42.385321 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 466/942] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:31:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:42.391194 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b566f6-58cb-48e2-8f21-2b4643c55f0f None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:42.401162 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a628ae-b15e-4820-b212-79669e006bb7 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:42.460945 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:42.471417 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:42.504295 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b566f6-58cb-48e2-8f21-2b4643c55f0f None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:42.517117 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a628ae-b15e-4820-b212-79669e006bb7 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:42.541057 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f13c65-567d-4a53-a7a7-77cfcdb24576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:42.541671 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f13c65-567d-4a53-a7a7-77cfcdb24576 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:42.541947 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f13c65-567d-4a53-a7a7-77cfcdb24576 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:42.542293 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f13c65-567d-4a53-a7a7-77cfcdb24576 None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:42.542857 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f13c65-567d-4a53-a7a7-77cfcdb24576 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:42.543191 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f13c65-567d-4a53-a7a7-77cfcdb24576 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:42.544568 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f13c65-567d-4a53-a7a7-77cfcdb24576 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:42.559263 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f80373-b2a3-4d70-b552-138f92eef8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:42.559516 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 477/943] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:31:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:42.560278 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f80373-b2a3-4d70-b552-138f92eef8b7 None admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:42.560561 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f80373-b2a3-4d70-b552-138f92eef8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:42.560923 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f80373-b2a3-4d70-b552-138f92eef8b7 None admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:42.562168 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f80373-b2a3-4d70-b552-138f92eef8b7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:42.563795 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f80373-b2a3-4d70-b552-138f92eef8b7 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:42.564211 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f13c65-567d-4a53-a7a7-77cfcdb24576 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:42.566460 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: WARNING keystone.server.flask.common [None req-05f80373-b2a3-4d70-b552-138f92eef8b7 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 26 07:31:42.621053 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.sql.core [None req-05f80373-b2a3-4d70-b552-138f92eef8b7 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 26 07:31:42.621053 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 26 07:31:42.621053 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [parameters: {'id': 'be19dab1b62a4b709d7aac18367203ad', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 26 07:31:42.621053 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81927) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 26 07:31:42.628893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-05f80373-b2a3-4d70-b552-138f92eef8b7 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id be19dab1b62a4b709d7aac18367203ad.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id be19dab1b62a4b709d7aac18367203ad. Aug 26 07:31:42.628893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:42.628893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 07:31:42.628893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 07:31:42.628893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 07:31:42.628893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 07:31:42.628893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 07:31:42.628893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 07:31:42.628893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 07:31:42.628893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application conn.query(q) Aug 26 07:31:42.628893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 07:31:42.628893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 07:31:42.628893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 07:31:42.629906 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application result.read() Aug 26 07:31:42.629906 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 07:31:42.629906 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 07:31:42.629906 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 07:31:42.629906 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 07:31:42.629906 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 07:31:42.629906 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 07:31:42.629906 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 07:31:42.629906 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 07:31:42.629906 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 26 07:31:42.629906 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:42.629906 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 26 07:31:42.629906 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:42.629906 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:42.629906 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 26 07:31:42.629906 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 26 07:31:42.629906 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 26 07:31:42.629906 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 26 07:31:42.631065 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 07:31:42.631065 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application next(self.gen) Aug 26 07:31:42.631065 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 26 07:31:42.631065 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application yield resource Aug 26 07:31:42.631065 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 07:31:42.631065 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application next(self.gen) Aug 26 07:31:42.631065 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 26 07:31:42.631065 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self.session.rollback() Aug 26 07:31:42.631065 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 26 07:31:42.631065 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self.force_reraise() Aug 26 07:31:42.631065 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 26 07:31:42.631065 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise self.value Aug 26 07:31:42.631065 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 26 07:31:42.631065 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 26 07:31:42.631065 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 26 07:31:42.631065 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application session.commit() Aug 26 07:31:42.631065 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 26 07:31:42.632151 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 26 07:31:42.632151 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 26 07:31:42.632151 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self._prepare_impl() Aug 26 07:31:42.632151 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 26 07:31:42.632151 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self.session.flush() Aug 26 07:31:42.632151 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 26 07:31:42.632151 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self._flush(objects) Aug 26 07:31:42.632151 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 26 07:31:42.632151 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 26 07:31:42.632151 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 26 07:31:42.632151 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application compat.raise_( Aug 26 07:31:42.632151 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 07:31:42.632151 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception Aug 26 07:31:42.632151 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 26 07:31:42.632151 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application flush_context.execute() Aug 26 07:31:42.632151 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 26 07:31:42.632151 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rec.execute(self) Aug 26 07:31:42.633361 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 26 07:31:42.633361 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 26 07:31:42.633361 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 26 07:31:42.633361 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 26 07:31:42.633361 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 26 07:31:42.633361 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 26 07:31:42.633361 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 26 07:31:42.633361 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 26 07:31:42.633361 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 26 07:31:42.633361 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 26 07:31:42.633361 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 26 07:31:42.633361 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 26 07:31:42.633361 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 26 07:31:42.633361 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 26 07:31:42.633361 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 26 07:31:42.634873 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 26 07:31:42.634873 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 07:31:42.634873 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception Aug 26 07:31:42.634873 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 07:31:42.634873 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 07:31:42.634873 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 07:31:42.634873 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 07:31:42.634873 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 07:31:42.634873 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 07:31:42.634873 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 07:31:42.634873 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application conn.query(q) Aug 26 07:31:42.634873 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 07:31:42.634873 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 07:31:42.634873 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 07:31:42.634873 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application result.read() Aug 26 07:31:42.634873 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 07:31:42.634873 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 07:31:42.637219 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 07:31:42.637219 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 07:31:42.637219 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 07:31:42.637219 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 07:31:42.637219 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 07:31:42.637219 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 07:31:42.637219 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 26 07:31:42.637219 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 26 07:31:42.637219 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [parameters: {'id': 'be19dab1b62a4b709d7aac18367203ad', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 26 07:31:42.637219 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 26 07:31:42.637219 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:42.637219 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 07:31:42.637219 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:42.637219 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:42.637219 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 26 07:31:42.639344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 26 07:31:42.639344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 26 07:31:42.639344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 26 07:31:42.639344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 26 07:31:42.639344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:42.639344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 07:31:42.639344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:42.639344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:42.639344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:42.639344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:42.639344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:42.639344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:42.639344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:42.639344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:42.639344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:42.639344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:42.639344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:42.642369 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:42.642369 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 26 07:31:42.642369 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 26 07:31:42.642369 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:42.642369 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:42.642369 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 26 07:31:42.642369 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 26 07:31:42.642369 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id be19dab1b62a4b709d7aac18367203ad. Aug 26 07:31:42.642369 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:42.642369 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 467/944] 10.222.0.42 () {60 vars in 1140 bytes} [Fri Aug 26 07:31:42 2022] POST /identity/v3/projects => generated 262 bytes in 230 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:42.642369 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f80373-b2a3-4d70-b552-138f92eef8b7 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:42.714140 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f13c65-567d-4a53-a7a7-77cfcdb24576 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:42.753127 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:42.768686 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f80373-b2a3-4d70-b552-138f92eef8b7 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:42.769984 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d5f3e-12bd-44a3-a99a-e861d8ba17da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:42.770894 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d5f3e-12bd-44a3-a99a-e861d8ba17da None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:42.771445 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d5f3e-12bd-44a3-a99a-e861d8ba17da None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:42.771920 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d5f3e-12bd-44a3-a99a-e861d8ba17da None admin] PATH_INFO: `/v3/projects/service` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:42.780871 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5d5f3e-12bd-44a3-a99a-e861d8ba17da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:42.781582 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:42.784026 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5d5f3e-12bd-44a3-a99a-e861d8ba17da None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:42.797298 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-de5d5f3e-12bd-44a3-a99a-e861d8ba17da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:31:42.797298 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:42.797298 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:42.797298 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:42.797298 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:42.797298 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:42.797298 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:42.797298 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:42.797298 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:42.797298 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:42.797298 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:42.797298 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:42.797298 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 07:31:42.797298 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 07:31:42.797298 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 07:31:42.804331 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 07:31:42.804331 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:42.804331 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:42.804331 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:42.804331 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:42.804331 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:42.804331 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:42.804331 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:42.804331 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:42.804331 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:42.804331 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:42.804331 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:42.804331 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:42.804331 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:42.804331 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:42.804331 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:42.804331 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:42.805430 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 07:31:42.805430 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 07:31:42.805430 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 07:31:42.805430 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 07:31:42.805430 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 07:31:42.805430 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 07:31:42.805430 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:31:42.805430 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:42.806032 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 478/945] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:31:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:42.807684 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d5f3e-12bd-44a3-a99a-e861d8ba17da None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:42.813986 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a6a26-18e2-494a-9091-eceedd14b46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:42.815092 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a6a26-18e2-494a-9091-eceedd14b46c None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:42.815479 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a6a26-18e2-494a-9091-eceedd14b46c None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:42.815852 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a6a26-18e2-494a-9091-eceedd14b46c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:42.825098 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3a6a26-18e2-494a-9091-eceedd14b46c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:42.827589 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3a6a26-18e2-494a-9091-eceedd14b46c None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:42.840321 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-9f3a6a26-18e2-494a-9091-eceedd14b46c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:31:42.840321 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:42.840321 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:42.840321 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:42.840321 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:42.840321 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:42.840321 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:42.840321 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:42.840321 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:42.840321 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:42.840321 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:42.840321 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:42.840321 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 07:31:42.840321 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 07:31:42.840321 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 07:31:42.841392 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 07:31:42.841392 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:42.841392 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:42.841392 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:42.841392 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:42.841392 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:42.841392 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:42.841392 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:42.841392 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:42.841392 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:42.841392 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:42.841392 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:42.841392 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:42.841392 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:42.841392 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:42.841392 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:42.841392 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:42.842858 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 07:31:42.842858 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 07:31:42.842858 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 07:31:42.842858 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 07:31:42.842858 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 07:31:42.842858 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 07:31:42.842858 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:31:42.842858 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:42.843332 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 468/946] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:31:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:42.852677 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a6a26-18e2-494a-9091-eceedd14b46c None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:42.929423 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d5f3e-12bd-44a3-a99a-e861d8ba17da None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:42.971017 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a6a26-18e2-494a-9091-eceedd14b46c None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:42.973039 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8898909-5716-41f4-b558-7bc34ce53c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:42.973798 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8898909-5716-41f4-b558-7bc34ce53c8b None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:42.974381 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8898909-5716-41f4-b558-7bc34ce53c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:42.974821 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8898909-5716-41f4-b558-7bc34ce53c8b None admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:42.975841 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8898909-5716-41f4-b558-7bc34ce53c8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:42.976272 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8898909-5716-41f4-b558-7bc34ce53c8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:42.978124 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8898909-5716-41f4-b558-7bc34ce53c8b None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:42.994167 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 479/947] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 26 07:31:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:31:42.995535 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7e949-d803-4eed-bf4c-0ae5bbe1acf8 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:42.995819 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7e949-d803-4eed-bf4c-0ae5bbe1acf8 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:42.996089 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7e949-d803-4eed-bf4c-0ae5bbe1acf8 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:42.999939 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 480/948] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:31:43.000240 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7e949-d803-4eed-bf4c-0ae5bbe1acf8 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:43.023818 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11dad9-e7b6-4fea-9956-12186a7024c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:43.024448 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11dad9-e7b6-4fea-9956-12186a7024c0 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:43.024731 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11dad9-e7b6-4fea-9956-12186a7024c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:43.025006 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11dad9-e7b6-4fea-9956-12186a7024c0 None admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:43.025682 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11dad9-e7b6-4fea-9956-12186a7024c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:43.025989 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11dad9-e7b6-4fea-9956-12186a7024c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:43.027467 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11dad9-e7b6-4fea-9956-12186a7024c0 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:43.059020 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 469/949] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Aug 26 07:31:42 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:43.059020 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d4c0b-122f-44c7-b090-1af7308b4f29 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:43.059020 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d4c0b-122f-44c7-b090-1af7308b4f29 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:43.059020 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d4c0b-122f-44c7-b090-1af7308b4f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:43.060569 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:43.089597 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-856d4c0b-122f-44c7-b090-1af7308b4f29 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:43.091487 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-856d4c0b-122f-44c7-b090-1af7308b4f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:43.116509 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7e949-d803-4eed-bf4c-0ae5bbe1acf8 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:43.121540 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:43.164324 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a671a-ce45-453f-91b1-0db144fb8b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:43.165428 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a671a-ce45-453f-91b1-0db144fb8b4e None admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:43.165859 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a671a-ce45-453f-91b1-0db144fb8b4e None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:43.166341 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a671a-ce45-453f-91b1-0db144fb8b4e None admin] PATH_INFO: `/v3/projects/becbf57e91454d499dec313ff9eadfae/users/30dc2621143f4604b53bb44b82e8efbb/roles/dc39243380ac40299d78581303d95252` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:43.169595 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a671a-ce45-453f-91b1-0db144fb8b4e None admin] RBAC: Authorizing `identity:create_grant(project_id=becbf57e91454d499dec313ff9eadfae, user_id=30dc2621143f4604b53bb44b82e8efbb, role_id=dc39243380ac40299d78581303d95252)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:43.172822 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a671a-ce45-453f-91b1-0db144fb8b4e None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:43.187882 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 470/950] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:31:43.239805 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 481/951] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 26 07:31:42 2022] PUT /identity/v3/projects/becbf57e91454d499dec313ff9eadfae/users/30dc2621143f4604b53bb44b82e8efbb/roles/dc39243380ac40299d78581303d95252 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:31:43.454755 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d4c0b-122f-44c7-b090-1af7308b4f29 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:43.573794 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d4c0b-122f-44c7-b090-1af7308b4f29 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:43.617624 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befcb003-0aac-446b-aa97-99e80feb2da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:43.618698 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befcb003-0aac-446b-aa97-99e80feb2da0 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:43.619291 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befcb003-0aac-446b-aa97-99e80feb2da0 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:43.619770 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befcb003-0aac-446b-aa97-99e80feb2da0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:43.620823 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befcb003-0aac-446b-aa97-99e80feb2da0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:43.622670 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befcb003-0aac-446b-aa97-99e80feb2da0 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:43.634396 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-befcb003-0aac-446b-aa97-99e80feb2da0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 07:31:43.634396 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:43.634396 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 07:31:43.634396 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 07:31:43.634396 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 07:31:43.634396 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 07:31:43.634396 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 07:31:43.634396 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:31:43.634396 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 07:31:43.634396 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:43.634396 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 07:31:43.634396 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:43.634396 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:43.634396 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:43.634396 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:43.634396 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:43.634396 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:43.635596 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:43.635596 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:43.635596 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:43.635596 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:43.635596 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:43.635596 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:43.635596 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 07:31:43.635596 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 07:31:43.635596 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 07:31:43.635596 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 07:31:43.635596 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:43.635596 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:43.635596 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:43.635596 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:43.635596 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:43.635596 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:43.636807 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:43.636807 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:43.636807 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:43.636807 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:43.636807 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:43.636807 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:43.636807 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:43.636807 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:43.636807 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:43.636807 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:43.636807 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 07:31:43.636807 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:31:43.636807 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 07:31:43.636807 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:43.636807 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 471/952] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Aug 26 07:31:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:43.646547 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a671a-ce45-453f-91b1-0db144fb8b4e None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:43.786062 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a671a-ce45-453f-91b1-0db144fb8b4e None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:43.794410 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:43.825854 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39485657-4614-45f0-9eca-c3043ffa3bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:43.827517 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39485657-4614-45f0-9eca-c3043ffa3bb5 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:43.828121 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39485657-4614-45f0-9eca-c3043ffa3bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:43.828560 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39485657-4614-45f0-9eca-c3043ffa3bb5 None admin] PATH_INFO: `/v3/services` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:43.829356 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39485657-4614-45f0-9eca-c3043ffa3bb5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:43.829801 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39485657-4614-45f0-9eca-c3043ffa3bb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:43.831353 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39485657-4614-45f0-9eca-c3043ffa3bb5 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:43.837105 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 482/953] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Aug 26 07:31:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:43.843160 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befcb003-0aac-446b-aa97-99e80feb2da0 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:43.871034 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:43.964485 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befcb003-0aac-446b-aa97-99e80feb2da0 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:44.007743 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f195a1-bc69-450d-9e48-dcf700a09e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:44.008359 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f195a1-bc69-450d-9e48-dcf700a09e05 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:44.008640 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f195a1-bc69-450d-9e48-dcf700a09e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:44.008977 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f195a1-bc69-450d-9e48-dcf700a09e05 None admin] PATH_INFO: `/v3/services` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:44.009626 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f195a1-bc69-450d-9e48-dcf700a09e05 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:44.009932 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f195a1-bc69-450d-9e48-dcf700a09e05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:44.011361 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f195a1-bc69-450d-9e48-dcf700a09e05 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:44.019578 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 472/954] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Aug 26 07:31:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:44.025164 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39485657-4614-45f0-9eca-c3043ffa3bb5 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:44.184880 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc996932-7f5c-4438-b1db-0b1d27427326 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:44.186378 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc996932-7f5c-4438-b1db-0b1d27427326 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:44.187207 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc996932-7f5c-4438-b1db-0b1d27427326 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:44.195434 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 473/955] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:44 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:31:44.200880 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429d34c-b3d5-482f-8eba-7c6d5175781d None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:44.201937 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429d34c-b3d5-482f-8eba-7c6d5175781d None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:44.203074 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429d34c-b3d5-482f-8eba-7c6d5175781d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:44.205058 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39485657-4614-45f0-9eca-c3043ffa3bb5 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:44.235870 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-c429d34c-b3d5-482f-8eba-7c6d5175781d None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:44.238252 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-c429d34c-b3d5-482f-8eba-7c6d5175781d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:44.271812 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f49235-aefe-47a6-a2dc-908738e65c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:44.272647 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f49235-aefe-47a6-a2dc-908738e65c8c None admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:44.273112 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f49235-aefe-47a6-a2dc-908738e65c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:44.273574 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f49235-aefe-47a6-a2dc-908738e65c8c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:44.274717 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f49235-aefe-47a6-a2dc-908738e65c8c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:44.277188 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f49235-aefe-47a6-a2dc-908738e65c8c None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:44.351868 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 474/956] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:31:44.410060 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 483/957] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:31:44 2022] POST /identity/v3/endpoints => generated 349 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:31:44.648868 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429d34c-b3d5-482f-8eba-7c6d5175781d None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:44.668399 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:44.765682 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429d34c-b3d5-482f-8eba-7c6d5175781d None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:44.810004 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0abbf-9f15-456f-a813-5212084934e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:44.810761 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0abbf-9f15-456f-a813-5212084934e4 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:44.811555 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0abbf-9f15-456f-a813-5212084934e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:44.811800 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0abbf-9f15-456f-a813-5212084934e4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:44.812391 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0abbf-9f15-456f-a813-5212084934e4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:44.813848 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0abbf-9f15-456f-a813-5212084934e4 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:44.823833 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-e1f0abbf-9f15-456f-a813-5212084934e4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 07:31:44.823833 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:44.823833 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 07:31:44.823833 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 07:31:44.823833 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 07:31:44.823833 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 07:31:44.823833 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 07:31:44.823833 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:31:44.823833 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 07:31:44.823833 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:44.823833 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 07:31:44.823833 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:44.823833 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:44.823833 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:44.823833 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:44.823833 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:44.823833 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:44.824976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:44.824976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:44.824976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:44.824976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:44.824976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:44.824976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:44.824976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 07:31:44.824976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 07:31:44.824976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 07:31:44.824976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 07:31:44.824976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:44.824976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:44.824976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:44.824976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:44.824976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:44.824976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:44.825838 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:44.825838 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:44.825838 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:44.825838 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:44.825838 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:44.825838 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:44.825838 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:44.825838 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:44.825838 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:44.825838 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:44.825838 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 07:31:44.825838 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:31:44.825838 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 07:31:44.825838 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:44.825838 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 475/958] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:31:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:44.833532 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f49235-aefe-47a6-a2dc-908738e65c8c None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:44.868640 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:44.962539 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f49235-aefe-47a6-a2dc-908738e65c8c None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:45.001830 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f401627-15d9-4190-aba3-d739b0bd3920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:45.002814 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f401627-15d9-4190-aba3-d739b0bd3920 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:45.003351 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f401627-15d9-4190-aba3-d739b0bd3920 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:45.003819 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f401627-15d9-4190-aba3-d739b0bd3920 None admin] PATH_INFO: `/v3/services` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:45.004653 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f401627-15d9-4190-aba3-d739b0bd3920 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:45.005170 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f401627-15d9-4190-aba3-d739b0bd3920 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:45.006727 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f401627-15d9-4190-aba3-d739b0bd3920 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:45.012719 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 484/959] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Aug 26 07:31:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:45.019213 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0abbf-9f15-456f-a813-5212084934e4 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:45.119228 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:45.146246 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0abbf-9f15-456f-a813-5212084934e4 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:45.186021 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b5287-43d0-4c96-b64e-d92a19f6714a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:45.187093 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b5287-43d0-4c96-b64e-d92a19f6714a None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:45.187371 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b5287-43d0-4c96-b64e-d92a19f6714a None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:45.187650 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b5287-43d0-4c96-b64e-d92a19f6714a None admin] PATH_INFO: `/v3/services` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:45.188292 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b5287-43d0-4c96-b64e-d92a19f6714a None admin] RBAC: Adding query filter params (type=compute) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:45.188597 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b5287-43d0-4c96-b64e-d92a19f6714a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:45.189974 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b5287-43d0-4c96-b64e-d92a19f6714a None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:45.195611 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 476/960] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Aug 26 07:31:45 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:45.289020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794c60e-3f87-4a3f-8dc2-14c2fe1397fe None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:45.289534 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794c60e-3f87-4a3f-8dc2-14c2fe1397fe None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:45.289534 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794c60e-3f87-4a3f-8dc2-14c2fe1397fe None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:45.291113 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 485/961] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:31:45.297507 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49ee56-0f9b-42b4-8aa8-f168003fefa8 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:45.297507 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49ee56-0f9b-42b4-8aa8-f168003fefa8 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:45.297718 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49ee56-0f9b-42b4-8aa8-f168003fefa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:45.318365 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-ad49ee56-0f9b-42b4-8aa8-f168003fefa8 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:45.319870 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-ad49ee56-0f9b-42b4-8aa8-f168003fefa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:45.390408 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a2e1b-f51d-4afe-9008-2b5cf2081791 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:45.390752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a2e1b-f51d-4afe-9008-2b5cf2081791 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:45.390951 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a2e1b-f51d-4afe-9008-2b5cf2081791 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:45.392578 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 486/962] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 07:31:45.398564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932392dc-164f-4491-b489-76d7ea4c5ec9 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:45.399152 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932392dc-164f-4491-b489-76d7ea4c5ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:45.399661 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932392dc-164f-4491-b489-76d7ea4c5ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:45.401311 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 477/963] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:31:45.424879 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-932392dc-164f-4491-b489-76d7ea4c5ec9 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:45.426119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-932392dc-164f-4491-b489-76d7ea4c5ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:45.501166 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 487/964] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:31:45.692689 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49ee56-0f9b-42b4-8aa8-f168003fefa8 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:45.769040 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:45.801428 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49ee56-0f9b-42b4-8aa8-f168003fefa8 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:45.806156 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932392dc-164f-4491-b489-76d7ea4c5ec9 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:45.835381 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:45.838236 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6fe1ef-a219-4c58-b778-4dfdeee0b04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:45.838848 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fe1ef-a219-4c58-b778-4dfdeee0b04e None admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:45.839188 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fe1ef-a219-4c58-b778-4dfdeee0b04e None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:45.839427 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fe1ef-a219-4c58-b778-4dfdeee0b04e None admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:45.840066 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6fe1ef-a219-4c58-b778-4dfdeee0b04e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:45.841501 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6fe1ef-a219-4c58-b778-4dfdeee0b04e None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:45.901168 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.sql.core [None req-6f6fe1ef-a219-4c58-b778-4dfdeee0b04e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 26 07:31:45.901168 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 26 07:31:45.901168 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [parameters: {'user_id': '91fbd756f5ef4743ae20c1bb17b80bfc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 26 07:31:45.901168 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81927) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 26 07:31:45.910410 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-6f6fe1ef-a219-4c58-b778-4dfdeee0b04e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 26 07:31:45.910410 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:45.910410 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 07:31:45.910410 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 07:31:45.910410 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 07:31:45.910410 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 07:31:45.910410 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 07:31:45.910410 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 07:31:45.910410 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 07:31:45.910410 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application conn.query(q) Aug 26 07:31:45.910410 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 07:31:45.910410 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 07:31:45.910410 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 07:31:45.910410 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application result.read() Aug 26 07:31:45.910410 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 07:31:45.911401 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 07:31:45.911401 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 07:31:45.911401 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 07:31:45.911401 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 07:31:45.911401 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 07:31:45.911401 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 07:31:45.911401 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 07:31:45.911401 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 26 07:31:45.911401 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:45.911401 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 26 07:31:45.911401 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:45.911401 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:45.911401 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 26 07:31:45.911401 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 26 07:31:45.911401 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 26 07:31:45.911401 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 26 07:31:45.911401 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 07:31:45.911401 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application next(self.gen) Aug 26 07:31:45.912404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 26 07:31:45.912404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application yield resource Aug 26 07:31:45.912404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 07:31:45.912404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application next(self.gen) Aug 26 07:31:45.912404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 26 07:31:45.912404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self.session.rollback() Aug 26 07:31:45.912404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 26 07:31:45.912404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self.force_reraise() Aug 26 07:31:45.912404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 26 07:31:45.912404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise self.value Aug 26 07:31:45.912404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 26 07:31:45.912404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 26 07:31:45.912404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 26 07:31:45.912404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application session.commit() Aug 26 07:31:45.912404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 26 07:31:45.912404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 26 07:31:45.912404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 26 07:31:45.913313 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self._prepare_impl() Aug 26 07:31:45.913313 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 26 07:31:45.913313 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self.session.flush() Aug 26 07:31:45.913313 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 26 07:31:45.913313 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self._flush(objects) Aug 26 07:31:45.913313 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 26 07:31:45.913313 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 26 07:31:45.913313 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 26 07:31:45.913313 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application compat.raise_( Aug 26 07:31:45.913313 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 07:31:45.913313 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception Aug 26 07:31:45.913313 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 26 07:31:45.913313 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application flush_context.execute() Aug 26 07:31:45.913313 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 26 07:31:45.913313 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rec.execute(self) Aug 26 07:31:45.913313 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 26 07:31:45.913313 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 26 07:31:45.914214 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 26 07:31:45.914214 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 26 07:31:45.914214 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 26 07:31:45.914214 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 26 07:31:45.914214 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 26 07:31:45.914214 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 26 07:31:45.914214 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 26 07:31:45.914214 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 26 07:31:45.914214 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 26 07:31:45.914214 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 26 07:31:45.914214 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 26 07:31:45.914214 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 26 07:31:45.914214 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 26 07:31:45.914214 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 26 07:31:45.914214 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 07:31:45.914214 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception Aug 26 07:31:45.915097 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 07:31:45.915097 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 07:31:45.915097 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 07:31:45.915097 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 07:31:45.915097 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 07:31:45.915097 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 07:31:45.915097 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 07:31:45.915097 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application conn.query(q) Aug 26 07:31:45.915097 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 07:31:45.915097 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 07:31:45.915097 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 07:31:45.915097 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application result.read() Aug 26 07:31:45.915097 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 07:31:45.915097 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 07:31:45.915097 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 07:31:45.915097 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 07:31:45.915960 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 07:31:45.915960 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 07:31:45.915960 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 07:31:45.915960 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 07:31:45.915960 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 26 07:31:45.915960 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 26 07:31:45.915960 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [parameters: {'user_id': '91fbd756f5ef4743ae20c1bb17b80bfc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 26 07:31:45.915960 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 26 07:31:45.915960 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:45.915960 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 07:31:45.915960 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:45.915960 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:45.915960 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:45.915960 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:45.915960 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:45.916826 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:45.916826 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:45.916826 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:45.916826 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:45.916826 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:45.916826 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:45.916826 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:45.916826 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 26 07:31:45.916826 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 26 07:31:45.916826 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:45.916826 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:45.916826 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 07:31:45.916826 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:31:45.916826 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 07:31:45.916826 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:31:45.916826 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 26 07:31:45.916826 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 26 07:31:45.917756 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 26 07:31:45.917756 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 26 07:31:45.917756 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 26 07:31:45.917756 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 26 07:31:45.917756 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 26 07:31:45.917756 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:45.917756 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 478/965] 10.222.0.42 () {60 vars in 1131 bytes} [Fri Aug 26 07:31:45 2022] POST /identity/v3/users => generated 160 bytes in 220 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 26 07:31:45.926643 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6fe1ef-a219-4c58-b778-4dfdeee0b04e None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:45.934557 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932392dc-164f-4491-b489-76d7ea4c5ec9 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:45.998374 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b7185-a31c-4ee6-9e86-ee31828812c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:46.000227 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b7185-a31c-4ee6-9e86-ee31828812c1 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:46.000738 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b7185-a31c-4ee6-9e86-ee31828812c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:46.001274 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b7185-a31c-4ee6-9e86-ee31828812c1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:46.017247 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b7185-a31c-4ee6-9e86-ee31828812c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:31:46.025816 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-d83b7185-a31c-4ee6-9e86-ee31828812c1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 07:31:46.025816 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:46.025816 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:46.025816 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:46.025816 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:46.025816 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:46.025816 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:46.025816 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:46.025816 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:46.025816 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:46.025816 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:46.025816 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:46.025816 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:31:46.025816 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:31:46.025816 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:31:46.025816 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:31:46.026838 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:31:46.026838 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:31:46.026838 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:31:46.026838 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:31:46.026838 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:46.026838 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:46.026838 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:46.026838 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:46.026838 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:46.026838 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:46.026838 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:46.026838 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:46.026838 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:46.026838 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:46.026838 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:46.026838 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:46.027762 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:46.027762 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:46.027762 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:46.027762 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:46.027762 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:31:46.027762 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:31:46.027762 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:31:46.027762 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:31:46.027762 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:31:46.027762 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:31:46.027762 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 07:31:46.027762 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:46.028437 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 488/966] 10.222.0.42 () {56 vars in 1120 bytes} [Fri Aug 26 07:31:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:46.034936 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b7185-a31c-4ee6-9e86-ee31828812c1 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:46.056766 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6fe1ef-a219-4c58-b778-4dfdeee0b04e None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:46.095762 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:46.102333 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b14d62-bb2e-4a52-afad-52573f55605e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:46.103498 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b14d62-bb2e-4a52-afad-52573f55605e None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:46.103869 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b14d62-bb2e-4a52-afad-52573f55605e None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:46.104254 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b14d62-bb2e-4a52-afad-52573f55605e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:46.115857 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b14d62-bb2e-4a52-afad-52573f55605e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:46.117809 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b14d62-bb2e-4a52-afad-52573f55605e None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:46.130395 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:46.133716 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-11b14d62-bb2e-4a52-afad-52573f55605e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 07:31:46.133716 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:46.133716 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:46.133716 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:46.133716 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:46.133716 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:46.133716 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:46.133716 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:46.133716 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:46.133716 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:46.133716 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:46.133716 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:46.133716 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 07:31:46.133716 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 07:31:46.133716 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 07:31:46.133716 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 07:31:46.134856 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:46.134856 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:46.134856 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 07:31:46.134856 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:31:46.134856 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 07:31:46.134856 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:31:46.134856 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:46.134856 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:46.134856 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:46.134856 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:46.134856 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:46.134856 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:46.134856 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:46.134856 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:46.134856 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:46.134856 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:46.134856 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:46.134856 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:46.135825 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:46.135825 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:46.135825 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 07:31:46.135825 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 07:31:46.135825 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 07:31:46.135825 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 07:31:46.135825 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 07:31:46.135825 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 07:31:46.135825 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 07:31:46.135825 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:46.135825 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 479/967] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:31:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 07:31:46.143265 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b14d62-bb2e-4a52-afad-52573f55605e None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:46.156267 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b7185-a31c-4ee6-9e86-ee31828812c1 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:46.193993 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491b064-fbba-4ecb-aa0e-625cc3cb6a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:46.194941 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491b064-fbba-4ecb-aa0e-625cc3cb6a66 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:46.195402 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491b064-fbba-4ecb-aa0e-625cc3cb6a66 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:46.195812 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491b064-fbba-4ecb-aa0e-625cc3cb6a66 None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:46.196626 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491b064-fbba-4ecb-aa0e-625cc3cb6a66 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:46.197070 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491b064-fbba-4ecb-aa0e-625cc3cb6a66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:46.198894 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491b064-fbba-4ecb-aa0e-625cc3cb6a66 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:46.213094 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 489/968] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Aug 26 07:31:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:46.214330 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491b064-fbba-4ecb-aa0e-625cc3cb6a66 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:46.261148 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b14d62-bb2e-4a52-afad-52573f55605e None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:46.303381 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6295e28-025e-4201-9252-0017d4f9f1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:46.304126 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6295e28-025e-4201-9252-0017d4f9f1d7 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:46.304518 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6295e28-025e-4201-9252-0017d4f9f1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:46.305115 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6295e28-025e-4201-9252-0017d4f9f1d7 None admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:46.305825 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6295e28-025e-4201-9252-0017d4f9f1d7 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:46.306126 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6295e28-025e-4201-9252-0017d4f9f1d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:46.307679 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6295e28-025e-4201-9252-0017d4f9f1d7 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:46.336354 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491b064-fbba-4ecb-aa0e-625cc3cb6a66 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:46.359132 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 480/969] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Aug 26 07:31:46 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:31:46.379627 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadab38f-b38e-4d04-a75c-4c41dcc40d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:46.380852 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadab38f-b38e-4d04-a75c-4c41dcc40d55 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:46.381392 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadab38f-b38e-4d04-a75c-4c41dcc40d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:46.381874 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadab38f-b38e-4d04-a75c-4c41dcc40d55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:46.396002 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadab38f-b38e-4d04-a75c-4c41dcc40d55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:46.397839 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadab38f-b38e-4d04-a75c-4c41dcc40d55 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:46.409979 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:46.415678 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-aadab38f-b38e-4d04-a75c-4c41dcc40d55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:46.415678 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:46.415678 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:46.415678 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:46.415678 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:46.415678 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:46.415678 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:46.415678 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:46.415678 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:46.415678 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:46.415678 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:46.415678 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:46.415678 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:31:46.415678 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:31:46.415678 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:31:46.415678 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:31:46.416715 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:46.416715 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:46.416715 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:46.416715 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:46.416715 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:46.416715 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:46.416715 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:46.416715 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:46.416715 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:46.416715 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:46.416715 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:46.416715 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:46.416715 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:46.416715 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:46.416715 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:46.416715 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:46.416715 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:31:46.417624 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:31:46.417624 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:46.417624 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:46.417624 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 490/970] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:31:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:46.424042 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6295e28-025e-4201-9252-0017d4f9f1d7 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:46.494977 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:46.558699 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6295e28-025e-4201-9252-0017d4f9f1d7 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:46.562644 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8b590-9916-425e-ac6b-791d2e3ca934 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:46.563354 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8b590-9916-425e-ac6b-791d2e3ca934 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:46.563844 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8b590-9916-425e-ac6b-791d2e3ca934 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:46.565701 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 491/971] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:31:46.571853 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5f6fd-c797-4db3-a929-02fe638fcde4 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:46.572435 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5f6fd-c797-4db3-a929-02fe638fcde4 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:46.572918 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5f6fd-c797-4db3-a929-02fe638fcde4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:46.594964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-8fc5f6fd-c797-4db3-a929-02fe638fcde4 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:46.596763 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-8fc5f6fd-c797-4db3-a929-02fe638fcde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:46.601984 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d11dc8-9e92-417c-9c9f-96d1a6b5d983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:46.602607 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d11dc8-9e92-417c-9c9f-96d1a6b5d983 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:46.602890 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d11dc8-9e92-417c-9c9f-96d1a6b5d983 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:46.603256 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d11dc8-9e92-417c-9c9f-96d1a6b5d983 None admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:46.603864 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d11dc8-9e92-417c-9c9f-96d1a6b5d983 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:46.604170 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d11dc8-9e92-417c-9c9f-96d1a6b5d983 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:46.606522 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d11dc8-9e92-417c-9c9f-96d1a6b5d983 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:46.624854 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 481/972] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:31:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:31:46.632457 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d11dc8-9e92-417c-9c9f-96d1a6b5d983 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:46.703013 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 492/973] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 07:31:46.773543 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d11dc8-9e92-417c-9c9f-96d1a6b5d983 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:46.786251 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:46.811420 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b772b0a-fd10-451e-a60e-c9ad43c8879e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:46.811420 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b772b0a-fd10-451e-a60e-c9ad43c8879e None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:46.811675 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b772b0a-fd10-451e-a60e-c9ad43c8879e None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:46.811944 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b772b0a-fd10-451e-a60e-c9ad43c8879e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:46.819362 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b772b0a-fd10-451e-a60e-c9ad43c8879e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:46.821043 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b772b0a-fd10-451e-a60e-c9ad43c8879e None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:46.833693 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-8b772b0a-fd10-451e-a60e-c9ad43c8879e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 07:31:46.833693 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:46.833693 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:46.833693 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:46.833693 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:46.833693 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:46.833693 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:46.833693 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:46.833693 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:46.833693 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:46.833693 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:46.833693 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:46.833693 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 07:31:46.833693 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 07:31:46.833693 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 07:31:46.833693 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 07:31:46.834898 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:46.834898 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:46.834898 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 07:31:46.834898 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:31:46.834898 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 07:31:46.834898 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:31:46.834898 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:46.834898 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:46.834898 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:46.834898 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:46.834898 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:46.834898 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:46.834898 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:46.834898 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:46.834898 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:46.834898 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:46.834898 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:46.834898 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:46.836113 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:46.836113 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:46.836113 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 07:31:46.836113 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 07:31:46.836113 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 07:31:46.836113 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 07:31:46.836113 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 07:31:46.836113 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 07:31:46.836113 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 07:31:46.836113 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:46.843076 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 482/974] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Aug 26 07:31:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:46.845392 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5f6fd-c797-4db3-a929-02fe638fcde4 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:46.965507 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5f6fd-c797-4db3-a929-02fe638fcde4 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:46.985772 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b772b0a-fd10-451e-a60e-c9ad43c8879e None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:46.992153 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:47.004023 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26f00a-e96c-4613-a589-3ccd5b32ea96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:47.004638 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26f00a-e96c-4613-a589-3ccd5b32ea96 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:47.004932 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26f00a-e96c-4613-a589-3ccd5b32ea96 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:47.005180 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26f00a-e96c-4613-a589-3ccd5b32ea96 None admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:47.005917 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d26f00a-e96c-4613-a589-3ccd5b32ea96 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:47.006217 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d26f00a-e96c-4613-a589-3ccd5b32ea96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:47.007724 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d26f00a-e96c-4613-a589-3ccd5b32ea96 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:47.032469 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 493/975] 10.222.0.42 () {56 vars in 1149 bytes} [Fri Aug 26 07:31:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:47.033978 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26f00a-e96c-4613-a589-3ccd5b32ea96 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:47.097510 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b772b0a-fd10-451e-a60e-c9ad43c8879e None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:47.136200 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff55cc6-cbad-4dc1-a3f6-8070b0358461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:47.136829 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff55cc6-cbad-4dc1-a3f6-8070b0358461 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:47.137108 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff55cc6-cbad-4dc1-a3f6-8070b0358461 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:47.137410 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff55cc6-cbad-4dc1-a3f6-8070b0358461 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:47.137995 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff55cc6-cbad-4dc1-a3f6-8070b0358461 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:47.139439 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff55cc6-cbad-4dc1-a3f6-8070b0358461 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:47.145646 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26f00a-e96c-4613-a589-3ccd5b32ea96 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:47.148157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-3ff55cc6-cbad-4dc1-a3f6-8070b0358461 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 07:31:47.148157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:47.148157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 07:31:47.148157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 07:31:47.148157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 07:31:47.148157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 07:31:47.148157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 07:31:47.148157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:31:47.148157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 07:31:47.148157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:47.148157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 07:31:47.148157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:47.148157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:47.148157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:47.148157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:47.148157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:47.148157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:47.149211 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:47.149211 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:47.149211 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:47.149211 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:47.149211 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:47.149211 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:47.149211 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 07:31:47.149211 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 07:31:47.149211 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 07:31:47.149211 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 07:31:47.149211 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:47.149211 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:47.149211 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:47.149211 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:47.149211 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:47.149211 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:47.150106 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:47.150106 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:47.150106 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:47.150106 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:47.150106 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:47.150106 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:47.150106 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:47.150106 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:47.150106 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:47.150106 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:47.150106 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 07:31:47.150106 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:31:47.150106 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 07:31:47.150106 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:47.150106 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 483/976] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Aug 26 07:31:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 07:31:47.155529 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff55cc6-cbad-4dc1-a3f6-8070b0358461 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:47.188023 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c774c-ea94-4f21-ba2d-205650a42552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:47.188676 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c774c-ea94-4f21-ba2d-205650a42552 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:47.188987 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c774c-ea94-4f21-ba2d-205650a42552 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:47.189259 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c774c-ea94-4f21-ba2d-205650a42552 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:47.198203 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:47.244478 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:47.266105 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c774c-ea94-4f21-ba2d-205650a42552 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:47.267658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c774c-ea94-4f21-ba2d-205650a42552 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:47.278597 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff55cc6-cbad-4dc1-a3f6-8070b0358461 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:47.315429 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c93de5b-f74d-4185-b361-91aead3df34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:47.316041 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93de5b-f74d-4185-b361-91aead3df34e None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:47.316316 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93de5b-f74d-4185-b361-91aead3df34e None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:47.316592 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93de5b-f74d-4185-b361-91aead3df34e None admin] PATH_INFO: `/v3/services` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:47.317226 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c93de5b-f74d-4185-b361-91aead3df34e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:47.317524 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c93de5b-f74d-4185-b361-91aead3df34e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:47.319182 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c93de5b-f74d-4185-b361-91aead3df34e None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:47.324534 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 484/977] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Aug 26 07:31:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:31:47.325813 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c471559-7307-4fbe-b7d3-7a474a1a1b12 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:47.326093 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c471559-7307-4fbe-b7d3-7a474a1a1b12 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:47.326395 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c471559-7307-4fbe-b7d3-7a474a1a1b12 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:47.331962 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 485/978] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:31:47.331962 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c471559-7307-4fbe-b7d3-7a474a1a1b12 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:47.377988 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 494/979] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:31:47 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 26 07:31:47.379294 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e619e-7651-4669-9115-1a8e1ce0356b None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:47.379575 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e619e-7651-4669-9115-1a8e1ce0356b None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:47.379842 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e619e-7651-4669-9115-1a8e1ce0356b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:47.397869 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-9e3e619e-7651-4669-9115-1a8e1ce0356b None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:47.399073 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-9e3e619e-7651-4669-9115-1a8e1ce0356b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:47.442215 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:47.448327 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c471559-7307-4fbe-b7d3-7a474a1a1b12 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:47.475094 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 495/980] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:31:47.476029 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e619e-7651-4669-9115-1a8e1ce0356b None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:47.490910 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:47.501017 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7c9ed-f049-45e5-b6a0-fcb63e126339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:47.501017 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7c9ed-f049-45e5-b6a0-fcb63e126339 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:47.501017 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7c9ed-f049-45e5-b6a0-fcb63e126339 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:47.501017 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7c9ed-f049-45e5-b6a0-fcb63e126339 None admin] PATH_INFO: `/v3/services` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:47.501624 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b7c9ed-f049-45e5-b6a0-fcb63e126339 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:47.501927 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b7c9ed-f049-45e5-b6a0-fcb63e126339 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:47.503334 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b7c9ed-f049-45e5-b6a0-fcb63e126339 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:47.513596 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 486/981] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Aug 26 07:31:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:47.514777 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7c9ed-f049-45e5-b6a0-fcb63e126339 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:47.604350 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e619e-7651-4669-9115-1a8e1ce0356b None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:47.638138 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7c9ed-f049-45e5-b6a0-fcb63e126339 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:47.644647 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313024e-5efe-4f44-b45e-fafa885c8cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:47.645287 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313024e-5efe-4f44-b45e-fafa885c8cd9 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:47.645566 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313024e-5efe-4f44-b45e-fafa885c8cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:47.646095 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313024e-5efe-4f44-b45e-fafa885c8cd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:47.658530 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2313024e-5efe-4f44-b45e-fafa885c8cd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:47.660218 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2313024e-5efe-4f44-b45e-fafa885c8cd9 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:47.675442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea57cf-d6d6-4c77-97b8-1cd4c3c5e7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:47.676408 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea57cf-d6d6-4c77-97b8-1cd4c3c5e7e6 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:47.676691 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea57cf-d6d6-4c77-97b8-1cd4c3c5e7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:47.676963 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea57cf-d6d6-4c77-97b8-1cd4c3c5e7e6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:47.677674 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ea57cf-d6d6-4c77-97b8-1cd4c3c5e7e6 None admin] RBAC: Adding query filter params (interface=admin, service_id=b031190d44b945f89467cc4cb710d983, region_id=RegionOne) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:47.677982 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ea57cf-d6d6-4c77-97b8-1cd4c3c5e7e6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:47.679371 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ea57cf-d6d6-4c77-97b8-1cd4c3c5e7e6 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:47.682366 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-2313024e-5efe-4f44-b45e-fafa885c8cd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:47.682366 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:47.682366 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:47.682366 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:47.682366 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:47.682366 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:47.682366 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:47.682366 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:47.682366 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:47.682366 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:47.682366 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:47.682366 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:47.682366 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:31:47.682366 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:31:47.682366 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:31:47.682366 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:31:47.683473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:47.683473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:47.683473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:47.683473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:47.683473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:47.683473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:47.683473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:47.683473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:47.683473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:47.683473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:47.683473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:47.683473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:47.683473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:47.683473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:47.683473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:47.683473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:47.683473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:31:47.684373 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:31:47.684373 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:47.684373 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:47.684373 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 496/982] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:31:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:47.690342 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 487/983] 10.222.0.42 () {56 vars in 1249 bytes} [Fri Aug 26 07:31:47 2022] GET /identity/v3/endpoints?service_id=b031190d44b945f89467cc4cb710d983&interface=admin®ion_id=RegionOne => generated 193 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:47.691383 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313024e-5efe-4f44-b45e-fafa885c8cd9 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:47.692006 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea57cf-d6d6-4c77-97b8-1cd4c3c5e7e6 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:47.727744 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:47.770199 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:47.807530 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea57cf-d6d6-4c77-97b8-1cd4c3c5e7e6 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:47.809067 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313024e-5efe-4f44-b45e-fafa885c8cd9 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:47.846157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89238005-acd5-4304-a69b-9410d6769b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:47.846770 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89238005-acd5-4304-a69b-9410d6769b41 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:47.847079 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89238005-acd5-4304-a69b-9410d6769b41 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:47.847353 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89238005-acd5-4304-a69b-9410d6769b41 None admin] PATH_INFO: `/v3/services` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:47.847965 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89238005-acd5-4304-a69b-9410d6769b41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:47.849344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89238005-acd5-4304-a69b-9410d6769b41 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:47.849521 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3581d-48eb-4005-a269-4d03d5390f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:47.850129 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3581d-48eb-4005-a269-4d03d5390f96 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:47.850446 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3581d-48eb-4005-a269-4d03d5390f96 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:47.850720 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3581d-48eb-4005-a269-4d03d5390f96 None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:47.851501 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3581d-48eb-4005-a269-4d03d5390f96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:47.851799 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3581d-48eb-4005-a269-4d03d5390f96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:47.853152 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3581d-48eb-4005-a269-4d03d5390f96 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:47.857124 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 488/984] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Aug 26 07:31:47 2022] GET /identity/v3/services => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:31:47.857968 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89238005-acd5-4304-a69b-9410d6769b41 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:47.874362 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 497/985] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:31:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:31:47.880448 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3581d-48eb-4005-a269-4d03d5390f96 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:47.984059 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:47.995357 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89238005-acd5-4304-a69b-9410d6769b41 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:48.006772 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3581d-48eb-4005-a269-4d03d5390f96 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:48.036796 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05beee-1700-4e41-ae01-57dec69c2975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:48.037412 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05beee-1700-4e41-ae01-57dec69c2975 None admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:48.037692 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05beee-1700-4e41-ae01-57dec69c2975 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:48.038390 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05beee-1700-4e41-ae01-57dec69c2975 None admin] PATH_INFO: `/v3/services` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:48.038614 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a05beee-1700-4e41-ae01-57dec69c2975 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:48.040028 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a05beee-1700-4e41-ae01-57dec69c2975 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:48.043394 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:48.055252 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8cc18f-8a09-44e6-96dc-b854de586874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:48.056118 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8cc18f-8a09-44e6-96dc-b854de586874 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:48.056285 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8cc18f-8a09-44e6-96dc-b854de586874 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:48.056469 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8cc18f-8a09-44e6-96dc-b854de586874 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:48.064166 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8cc18f-8a09-44e6-96dc-b854de586874 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:48.065740 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8cc18f-8a09-44e6-96dc-b854de586874 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:48.078073 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-bd8cc18f-8a09-44e6-96dc-b854de586874 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:31:48.078073 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:48.078073 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:48.078073 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:48.078073 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:48.078073 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:48.078073 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:48.078073 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:48.078073 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:48.078073 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:48.078073 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:48.078073 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:48.078073 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 07:31:48.078073 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 07:31:48.078073 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 07:31:48.083385 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 07:31:48.083385 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:48.083385 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:48.083385 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:48.083385 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:48.083385 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:48.083385 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:48.083385 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:48.083385 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:48.083385 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:48.083385 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:48.083385 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:48.083385 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:48.083385 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:48.083385 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:48.083385 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:48.083385 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:48.084463 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 07:31:48.084463 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 07:31:48.084463 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 07:31:48.084463 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 07:31:48.084463 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 07:31:48.084463 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 07:31:48.084463 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:31:48.084463 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:48.084463 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 498/986] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:31:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:48.085357 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8cc18f-8a09-44e6-96dc-b854de586874 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:48.136937 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 489/987] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Aug 26 07:31:47 2022] POST /identity/v3/services => generated 242 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:31:48.215110 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8cc18f-8a09-44e6-96dc-b854de586874 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:48.261594 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db8a68-1fdb-4cfc-a2e9-12d960b96921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:48.262133 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db8a68-1fdb-4cfc-a2e9-12d960b96921 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:48.262407 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db8a68-1fdb-4cfc-a2e9-12d960b96921 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:48.262672 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db8a68-1fdb-4cfc-a2e9-12d960b96921 None admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:48.263419 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db8a68-1fdb-4cfc-a2e9-12d960b96921 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:48.263900 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db8a68-1fdb-4cfc-a2e9-12d960b96921 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:48.265629 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db8a68-1fdb-4cfc-a2e9-12d960b96921 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:48.284387 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 499/988] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 26 07:31:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:31:48.286560 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05beee-1700-4e41-ae01-57dec69c2975 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:48.398813 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05beee-1700-4e41-ae01-57dec69c2975 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:48.438805 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b760e22-4301-4751-841c-4cf01662168d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:48.439462 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b760e22-4301-4751-841c-4cf01662168d None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:48.439744 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b760e22-4301-4751-841c-4cf01662168d None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:48.440019 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b760e22-4301-4751-841c-4cf01662168d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:48.440761 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b760e22-4301-4751-841c-4cf01662168d None admin] RBAC: Adding query filter params (role.id=dc39243380ac40299d78581303d95252, scope.project.id=becbf57e91454d499dec313ff9eadfae, user.id=30dc2621143f4604b53bb44b82e8efbb) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:48.441073 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b760e22-4301-4751-841c-4cf01662168d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:48.442514 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b760e22-4301-4751-841c-4cf01662168d None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:48.449190 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 490/989] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:31:48 2022] GET /identity/v3/role_assignments?user.id=30dc2621143f4604b53bb44b82e8efbb&scope.project.id=becbf57e91454d499dec313ff9eadfae&role.id=dc39243380ac40299d78581303d95252 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:49.838290 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513f345-0039-48ba-9de6-7eda03603466 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:49.838852 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513f345-0039-48ba-9de6-7eda03603466 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:49.838852 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513f345-0039-48ba-9de6-7eda03603466 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:49.840322 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 500/990] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:31:49.845920 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace66563-68e1-4277-a944-708931860bc0 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:49.846405 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace66563-68e1-4277-a944-708931860bc0 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:49.846496 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace66563-68e1-4277-a944-708931860bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:49.865599 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-ace66563-68e1-4277-a944-708931860bc0 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:49.867177 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-ace66563-68e1-4277-a944-708931860bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:49.878638 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:49.943020 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 491/991] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:49 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:31:50.127925 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581e2b8-aa4b-4b5c-bcc9-69a25376251f None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:50.128213 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581e2b8-aa4b-4b5c-bcc9-69a25376251f None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:50.128601 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581e2b8-aa4b-4b5c-bcc9-69a25376251f None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:50.129989 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 501/992] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:31:50.135588 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f83fae-4e56-43f3-968b-f24d473c6ccb None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:50.136007 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f83fae-4e56-43f3-968b-f24d473c6ccb None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:50.136308 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f83fae-4e56-43f3-968b-f24d473c6ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:50.157255 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-87f83fae-4e56-43f3-968b-f24d473c6ccb None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:50.165033 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-87f83fae-4e56-43f3-968b-f24d473c6ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:50.222684 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a581e2b8-aa4b-4b5c-bcc9-69a25376251f None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:50.239649 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 492/993] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:50 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:31:50.272661 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:50.338751 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a581e2b8-aa4b-4b5c-bcc9-69a25376251f None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:50.377410 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a838e-04c9-4378-b70b-6e2242e0e436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:50.378109 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a838e-04c9-4378-b70b-6e2242e0e436 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:50.378332 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a838e-04c9-4378-b70b-6e2242e0e436 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:50.378605 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a838e-04c9-4378-b70b-6e2242e0e436 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:50.379227 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a838e-04c9-4378-b70b-6e2242e0e436 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:50.380597 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a838e-04c9-4378-b70b-6e2242e0e436 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:50.389970 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-fb5a838e-04c9-4378-b70b-6e2242e0e436 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 07:31:50.389970 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:50.389970 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 07:31:50.389970 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 07:31:50.389970 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 07:31:50.389970 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 07:31:50.389970 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 07:31:50.389970 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:31:50.389970 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 07:31:50.389970 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:50.389970 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 07:31:50.389970 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:50.389970 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:50.389970 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:50.389970 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:50.389970 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:50.389970 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:50.391064 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:50.391064 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:50.391064 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:50.391064 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:50.391064 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:50.391064 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:50.391064 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 07:31:50.391064 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 07:31:50.391064 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 07:31:50.391064 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 07:31:50.391064 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:50.391064 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:50.391064 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:50.391064 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:50.391064 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:50.391064 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:50.391939 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:50.391939 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:50.391939 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:50.391939 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:50.391939 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:50.391939 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:50.391939 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:50.391939 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:50.391939 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:50.391939 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:50.391939 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 07:31:50.391939 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:31:50.391939 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 07:31:50.391939 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:50.395314 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 502/994] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Aug 26 07:31:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 07:31:50.400205 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f83fae-4e56-43f3-968b-f24d473c6ccb None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:50.404161 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa028b-9f60-4410-a39a-c5a5ca95ad7b None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:50.405034 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa028b-9f60-4410-a39a-c5a5ca95ad7b None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:50.405256 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa028b-9f60-4410-a39a-c5a5ca95ad7b None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:50.406625 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 503/995] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 07:31:50.412086 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20d0ae-7af3-41a3-b298-c0e7a298d45a None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:50.412372 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20d0ae-7af3-41a3-b298-c0e7a298d45a None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:50.412641 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20d0ae-7af3-41a3-b298-c0e7a298d45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:50.431540 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-ef20d0ae-7af3-41a3-b298-c0e7a298d45a None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:50.432745 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-ef20d0ae-7af3-41a3-b298-c0e7a298d45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:50.485466 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:50.510392 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 504/996] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:50 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 07:31:50.517184 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f83fae-4e56-43f3-968b-f24d473c6ccb None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:50.518375 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20d0ae-7af3-41a3-b298-c0e7a298d45a None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:50.553335 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e9cff-26e1-4cd0-a8c5-86cb83134acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:50.553951 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e9cff-26e1-4cd0-a8c5-86cb83134acf None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:50.554229 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e9cff-26e1-4cd0-a8c5-86cb83134acf None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:50.554499 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e9cff-26e1-4cd0-a8c5-86cb83134acf None admin] PATH_INFO: `/v3/services` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:50.555155 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e9cff-26e1-4cd0-a8c5-86cb83134acf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:50.555457 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e9cff-26e1-4cd0-a8c5-86cb83134acf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:50.557092 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e9cff-26e1-4cd0-a8c5-86cb83134acf None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:50.559686 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:50.567040 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 493/997] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Aug 26 07:31:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:50.570876 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e9cff-26e1-4cd0-a8c5-86cb83134acf None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:50.636760 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20d0ae-7af3-41a3-b298-c0e7a298d45a None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:50.674922 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb56c6-973a-4c9e-b8c6-3eaac33a4424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:50.675705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb56c6-973a-4c9e-b8c6-3eaac33a4424 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:50.675988 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb56c6-973a-4c9e-b8c6-3eaac33a4424 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:50.676261 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb56c6-973a-4c9e-b8c6-3eaac33a4424 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:50.676965 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb56c6-973a-4c9e-b8c6-3eaac33a4424 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:50.678344 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb56c6-973a-4c9e-b8c6-3eaac33a4424 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:50.682511 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e9cff-26e1-4cd0-a8c5-86cb83134acf None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:50.689032 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-7cfb56c6-973a-4c9e-b8c6-3eaac33a4424 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 07:31:50.689032 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:50.689032 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 07:31:50.689032 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 07:31:50.689032 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 07:31:50.689032 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 07:31:50.689032 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 07:31:50.689032 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:31:50.689032 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 07:31:50.689032 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:50.689032 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 07:31:50.689032 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:50.689032 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:50.689032 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:50.689032 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:50.689032 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:50.689032 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:50.690082 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:50.690082 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:50.690082 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:50.690082 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:50.690082 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:50.690082 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:50.690082 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 07:31:50.690082 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 07:31:50.690082 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 07:31:50.690082 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 07:31:50.690082 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:50.690082 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:50.690082 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:50.690082 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:50.690082 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:50.690082 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:50.690958 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:50.690958 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:50.690958 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:50.690958 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:50.690958 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:50.690958 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:50.690958 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:50.690958 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:50.690958 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:50.690958 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:50.690958 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 07:31:50.690958 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:31:50.690958 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 07:31:50.690958 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:50.695714 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 505/998] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:31:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:50.696621 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb56c6-973a-4c9e-b8c6-3eaac33a4424 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:50.727983 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003faf6c-ee1e-4e4c-b2b8-bbbc3e56e075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:50.728613 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003faf6c-ee1e-4e4c-b2b8-bbbc3e56e075 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:50.728899 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003faf6c-ee1e-4e4c-b2b8-bbbc3e56e075 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:50.729165 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003faf6c-ee1e-4e4c-b2b8-bbbc3e56e075 None admin] PATH_INFO: `/v3/services` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:50.729835 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003faf6c-ee1e-4e4c-b2b8-bbbc3e56e075 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:50.730141 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003faf6c-ee1e-4e4c-b2b8-bbbc3e56e075 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:50.731557 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003faf6c-ee1e-4e4c-b2b8-bbbc3e56e075 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:50.737665 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 494/999] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Aug 26 07:31:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:31:50.743553 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003faf6c-ee1e-4e4c-b2b8-bbbc3e56e075 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:50.746496 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:50.807190 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:50.811545 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb56c6-973a-4c9e-b8c6-3eaac33a4424 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:50.846942 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2608804d-58d9-4062-bf5a-be714f37e20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:50.847669 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608804d-58d9-4062-bf5a-be714f37e20e None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:50.847844 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608804d-58d9-4062-bf5a-be714f37e20e None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:50.848122 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608804d-58d9-4062-bf5a-be714f37e20e None admin] PATH_INFO: `/v3/services` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:50.848755 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2608804d-58d9-4062-bf5a-be714f37e20e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:50.849063 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2608804d-58d9-4062-bf5a-be714f37e20e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:50.850438 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2608804d-58d9-4062-bf5a-be714f37e20e None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:50.856753 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 506/1000] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Aug 26 07:31:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:31:50.857922 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2608804d-58d9-4062-bf5a-be714f37e20e None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:50.864730 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003faf6c-ee1e-4e4c-b2b8-bbbc3e56e075 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:50.902358 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f743e25-3000-4498-9802-b95c433b934b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:50.902890 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f743e25-3000-4498-9802-b95c433b934b None admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:50.903226 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f743e25-3000-4498-9802-b95c433b934b None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:50.903497 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f743e25-3000-4498-9802-b95c433b934b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:50.904196 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f743e25-3000-4498-9802-b95c433b934b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:50.905839 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f743e25-3000-4498-9802-b95c433b934b None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:50.963280 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2608804d-58d9-4062-bf5a-be714f37e20e None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:50.996903 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2939b3-17da-4941-a309-7e6d131b4d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:50.997582 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2939b3-17da-4941-a309-7e6d131b4d90 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:50.997853 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2939b3-17da-4941-a309-7e6d131b4d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:50.998664 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2939b3-17da-4941-a309-7e6d131b4d90 None admin] PATH_INFO: `/v3/services/image` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:50.999267 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2939b3-17da-4941-a309-7e6d131b4d90 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:51.000626 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2939b3-17da-4941-a309-7e6d131b4d90 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:51.003776 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 495/1001] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:31:50 2022] POST /identity/v3/endpoints => generated 325 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 07:31:51.004763 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f743e25-3000-4498-9802-b95c433b934b None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:51.014254 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-9e2939b3-17da-4941-a309-7e6d131b4d90 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 07:31:51.014254 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:51.014254 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 07:31:51.014254 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 07:31:51.014254 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 07:31:51.014254 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 07:31:51.014254 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 07:31:51.014254 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:31:51.014254 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 07:31:51.014254 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:51.014254 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 07:31:51.014254 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:51.014254 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:51.014254 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:51.014254 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:51.014254 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:51.014254 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:51.016357 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:51.016357 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:51.016357 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:51.016357 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:51.016357 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:51.016357 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:51.016357 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 07:31:51.016357 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 07:31:51.016357 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 07:31:51.016357 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 07:31:51.016357 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:51.016357 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:51.016357 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:51.016357 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:51.016357 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:51.016357 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:51.017364 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:51.017364 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:51.017364 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:51.017364 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:51.017364 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:51.017364 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:51.017364 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:51.017364 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:51.017364 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:51.017364 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:51.017364 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 07:31:51.017364 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:31:51.017364 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 07:31:51.017364 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:51.017364 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 507/1002] 10.222.0.42 () {56 vars in 1105 bytes} [Fri Aug 26 07:31:50 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:51.021921 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2939b3-17da-4941-a309-7e6d131b4d90 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:51.064723 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:51.108722 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:51.170610 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f743e25-3000-4498-9802-b95c433b934b None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:51.179673 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2939b3-17da-4941-a309-7e6d131b4d90 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:51.218415 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b1231-0eb6-433a-b59a-89baa32da390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:51.219360 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b1231-0eb6-433a-b59a-89baa32da390 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:51.219738 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b1231-0eb6-433a-b59a-89baa32da390 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:51.220136 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b1231-0eb6-433a-b59a-89baa32da390 None admin] PATH_INFO: `/v3/services` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:51.220868 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220b1231-0eb6-433a-b59a-89baa32da390 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:51.221312 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220b1231-0eb6-433a-b59a-89baa32da390 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:51.222837 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220b1231-0eb6-433a-b59a-89baa32da390 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:51.222973 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac49e6-e375-4282-9fdd-c30d5135b187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:51.223603 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac49e6-e375-4282-9fdd-c30d5135b187 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:51.223883 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac49e6-e375-4282-9fdd-c30d5135b187 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:51.224155 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac49e6-e375-4282-9fdd-c30d5135b187 None admin] PATH_INFO: `/v3/services` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:51.224964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac49e6-e375-4282-9fdd-c30d5135b187 None admin] RBAC: Adding query filter params (name=image) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:51.225264 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac49e6-e375-4282-9fdd-c30d5135b187 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:51.227344 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac49e6-e375-4282-9fdd-c30d5135b187 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:51.229058 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 496/1003] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Aug 26 07:31:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:51.239041 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b1231-0eb6-433a-b59a-89baa32da390 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:51.239233 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 508/1004] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:31:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:31:51.242616 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac49e6-e375-4282-9fdd-c30d5135b187 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:51.353198 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:51.354250 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b1231-0eb6-433a-b59a-89baa32da390 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:51.364075 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac49e6-e375-4282-9fdd-c30d5135b187 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:51.380561 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:51.394012 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95bc316-ac31-416a-93ae-b80356da045c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:51.401009 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95bc316-ac31-416a-93ae-b80356da045c None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:51.401009 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95bc316-ac31-416a-93ae-b80356da045c None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:51.401009 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95bc316-ac31-416a-93ae-b80356da045c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:51.401009 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95bc316-ac31-416a-93ae-b80356da045c None admin] RBAC: Adding query filter params (interface=public, service_id=a9cdf414eaf34207bf0cc5788675aa9b, region_id=RegionOne) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:51.401009 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95bc316-ac31-416a-93ae-b80356da045c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:51.401009 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95bc316-ac31-416a-93ae-b80356da045c None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:51.405120 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba521284-b00d-468b-994e-17af120940b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:51.405120 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba521284-b00d-468b-994e-17af120940b9 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:51.405120 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba521284-b00d-468b-994e-17af120940b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:51.405120 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba521284-b00d-468b-994e-17af120940b9 None admin] PATH_INFO: `/v3/services` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:51.405584 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba521284-b00d-468b-994e-17af120940b9 None admin] RBAC: Adding query filter params (type=image) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:51.405584 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba521284-b00d-468b-994e-17af120940b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:51.405927 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba521284-b00d-468b-994e-17af120940b9 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:51.408437 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 497/1005] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Aug 26 07:31:51 2022] GET /identity/v3/endpoints?service_id=a9cdf414eaf34207bf0cc5788675aa9b&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:31:51.409370 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95bc316-ac31-416a-93ae-b80356da045c None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:51.414846 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 509/1006] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:31:51 2022] GET /identity/v3/services?type=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:31:51.548677 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95bc316-ac31-416a-93ae-b80356da045c None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:51.594729 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9807830-c70e-44b7-8221-8f85c69310ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:51.595775 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9807830-c70e-44b7-8221-8f85c69310ed None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:51.596246 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9807830-c70e-44b7-8221-8f85c69310ed None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:51.596698 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9807830-c70e-44b7-8221-8f85c69310ed None admin] PATH_INFO: `/v3/services` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:51.597734 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9807830-c70e-44b7-8221-8f85c69310ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:51.600176 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9807830-c70e-44b7-8221-8f85c69310ed None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:51.617184 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 498/1007] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Aug 26 07:31:51 2022] GET /identity/v3/services => generated 1727 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:31:53.044812 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2f52c-d0e7-4bd5-912e-a50d5dd89ddd None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:53.045398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2f52c-d0e7-4bd5-912e-a50d5dd89ddd None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:53.045497 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2f52c-d0e7-4bd5-912e-a50d5dd89ddd None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:53.047154 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 510/1008] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:31:53.052841 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3bf00-1cb7-4baa-9f50-6074ef265bfb None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:53.053299 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3bf00-1cb7-4baa-9f50-6074ef265bfb None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:53.053393 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3bf00-1cb7-4baa-9f50-6074ef265bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:53.073568 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-edd3bf00-1cb7-4baa-9f50-6074ef265bfb None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:53.074773 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-edd3bf00-1cb7-4baa-9f50-6074ef265bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:53.127022 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:53.149104 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 499/1009] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:53 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:31:53.406009 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f833f-ca4d-4b67-ac47-8575b47dcbd5 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:53.406407 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f833f-ca4d-4b67-ac47-8575b47dcbd5 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:53.406630 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f833f-ca4d-4b67-ac47-8575b47dcbd5 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:53.408180 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 511/1010] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:31:53.413833 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045df8a-c648-44cc-8532-59f17dca9ec3 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:53.414122 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045df8a-c648-44cc-8532-59f17dca9ec3 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:53.414396 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045df8a-c648-44cc-8532-59f17dca9ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:53.425794 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f833f-ca4d-4b67-ac47-8575b47dcbd5 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:53.433476 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-e045df8a-c648-44cc-8532-59f17dca9ec3 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:53.434696 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-e045df8a-c648-44cc-8532-59f17dca9ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:53.513352 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 500/1011] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:53 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:31:53.540254 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f833f-ca4d-4b67-ac47-8575b47dcbd5 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:53.579390 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b7f5da-46ea-4108-bc9d-081ec7c83fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:53.580362 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7f5da-46ea-4108-bc9d-081ec7c83fbc None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:53.580829 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7f5da-46ea-4108-bc9d-081ec7c83fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:53.581276 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7f5da-46ea-4108-bc9d-081ec7c83fbc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:53.583510 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b7f5da-46ea-4108-bc9d-081ec7c83fbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:53.585134 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b7f5da-46ea-4108-bc9d-081ec7c83fbc None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:53.587208 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 512/1012] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:31:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:31:53.593009 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045df8a-c648-44cc-8532-59f17dca9ec3 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:53.662000 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb8c2b-f8f4-4557-94a7-23be02732f38 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:53.662316 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb8c2b-f8f4-4557-94a7-23be02732f38 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:53.662475 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb8c2b-f8f4-4557-94a7-23be02732f38 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:53.663837 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 513/1013] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:31:53.670706 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399112a-498e-4c2f-a664-e1769a0a4f78 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:53.671012 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399112a-498e-4c2f-a664-e1769a0a4f78 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:53.671303 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399112a-498e-4c2f-a664-e1769a0a4f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:53.689906 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-f399112a-498e-4c2f-a664-e1769a0a4f78 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:53.691156 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-f399112a-498e-4c2f-a664-e1769a0a4f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:53.708948 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:53.711556 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045df8a-c648-44cc-8532-59f17dca9ec3 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:53.725477 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:53.756675 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3938dcee-b048-4dc2-b251-523d00c9c494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:53.757348 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938dcee-b048-4dc2-b251-523d00c9c494 None admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:53.757628 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938dcee-b048-4dc2-b251-523d00c9c494 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:53.757902 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938dcee-b048-4dc2-b251-523d00c9c494 None admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:53.758557 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3938dcee-b048-4dc2-b251-523d00c9c494 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:53.760118 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3938dcee-b048-4dc2-b251-523d00c9c494 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:53.776551 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 514/1014] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:53 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:31:53.802846 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399112a-498e-4c2f-a664-e1769a0a4f78 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:53.879997 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 501/1015] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Aug 26 07:31:53 2022] POST /identity/v3/projects => generated 311 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:31:53.921402 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399112a-498e-4c2f-a664-e1769a0a4f78 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:53.964484 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8605b69-9413-4e3b-bb3e-62420f563cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:53.967097 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8605b69-9413-4e3b-bb3e-62420f563cb1 None admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:53.967097 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8605b69-9413-4e3b-bb3e-62420f563cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:53.967097 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8605b69-9413-4e3b-bb3e-62420f563cb1 None admin] PATH_INFO: `/v3/services` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:53.967097 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8605b69-9413-4e3b-bb3e-62420f563cb1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:53.968565 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8605b69-9413-4e3b-bb3e-62420f563cb1 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:54.058371 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3938dcee-b048-4dc2-b251-523d00c9c494 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:54.086876 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 515/1016] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Aug 26 07:31:53 2022] POST /identity/v3/services => generated 242 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 07:31:54.227057 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3938dcee-b048-4dc2-b251-523d00c9c494 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:54.274885 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6bdd3-3505-4739-91fa-e7ea85d24edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:54.275566 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6bdd3-3505-4739-91fa-e7ea85d24edb None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:54.275847 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6bdd3-3505-4739-91fa-e7ea85d24edb None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:54.276118 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6bdd3-3505-4739-91fa-e7ea85d24edb None admin] PATH_INFO: `/v3/services/compute` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:54.276700 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6bdd3-3505-4739-91fa-e7ea85d24edb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:54.278207 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6bdd3-3505-4739-91fa-e7ea85d24edb None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:54.290033 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-b1a6bdd3-3505-4739-91fa-e7ea85d24edb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 07:31:54.290033 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:54.290033 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 07:31:54.290033 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 07:31:54.290033 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 07:31:54.290033 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 07:31:54.290033 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 07:31:54.290033 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:31:54.290033 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 07:31:54.290033 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:54.290033 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 07:31:54.290033 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:54.290033 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:54.290033 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:54.290033 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:54.290033 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:54.290033 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:54.301024 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:54.301024 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:54.301024 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:54.301024 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:54.301024 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:54.301024 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:54.301024 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 07:31:54.301024 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 07:31:54.301024 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 07:31:54.301024 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 07:31:54.301024 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:54.301024 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:54.301024 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:54.301024 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:54.301024 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:54.301024 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:54.302349 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:54.302349 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:54.302349 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:54.302349 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:54.302349 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:54.302349 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:54.302349 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:54.302349 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:54.302349 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:54.302349 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:54.302349 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 07:31:54.302349 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:31:54.302349 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 07:31:54.302349 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:54.302349 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 502/1017] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:31:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 07:31:54.304146 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8605b69-9413-4e3b-bb3e-62420f563cb1 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:54.320372 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:54.426046 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8605b69-9413-4e3b-bb3e-62420f563cb1 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:54.470057 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4fb87-a892-4991-923e-1d3e451b27c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:54.471148 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4fb87-a892-4991-923e-1d3e451b27c8 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:54.471653 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4fb87-a892-4991-923e-1d3e451b27c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:54.472112 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4fb87-a892-4991-923e-1d3e451b27c8 None admin] PATH_INFO: `/v3/services` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:54.473292 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4fb87-a892-4991-923e-1d3e451b27c8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:54.473805 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4fb87-a892-4991-923e-1d3e451b27c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:54.476159 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4fb87-a892-4991-923e-1d3e451b27c8 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:54.482328 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 516/1018] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Aug 26 07:31:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:54.490283 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6bdd3-3505-4739-91fa-e7ea85d24edb None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:54.520037 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:54.614433 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6bdd3-3505-4739-91fa-e7ea85d24edb None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:54.651567 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296a2d3-a7f1-4a7e-a706-5a7aa6a7d026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:54.652647 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296a2d3-a7f1-4a7e-a706-5a7aa6a7d026 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:54.653137 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296a2d3-a7f1-4a7e-a706-5a7aa6a7d026 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:54.653640 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296a2d3-a7f1-4a7e-a706-5a7aa6a7d026 None admin] PATH_INFO: `/v3/services` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:54.654545 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a296a2d3-a7f1-4a7e-a706-5a7aa6a7d026 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:54.655143 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a296a2d3-a7f1-4a7e-a706-5a7aa6a7d026 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:54.656786 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a296a2d3-a7f1-4a7e-a706-5a7aa6a7d026 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:54.662285 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 503/1019] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Aug 26 07:31:54 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:31:54.668262 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4fb87-a892-4991-923e-1d3e451b27c8 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:54.758645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:54.786053 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4fb87-a892-4991-923e-1d3e451b27c8 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:54.832118 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd5261-c652-4395-ba99-8622a7f3d050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:54.832735 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd5261-c652-4395-ba99-8622a7f3d050 None admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:54.833011 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd5261-c652-4395-ba99-8622a7f3d050 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:54.833279 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd5261-c652-4395-ba99-8622a7f3d050 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:54.833940 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fd5261-c652-4395-ba99-8622a7f3d050 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:54.835345 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fd5261-c652-4395-ba99-8622a7f3d050 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:54.913939 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 517/1020] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:31:54 2022] POST /identity/v3/endpoints => generated 334 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 07:31:55.947527 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8df736-e50f-40b9-8041-887a17542db0 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:55.948082 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8df736-e50f-40b9-8041-887a17542db0 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:55.948082 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8df736-e50f-40b9-8041-887a17542db0 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:55.949877 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 504/1021] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:31:55.956338 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222517bb-4f60-4b32-9f02-ff59dd11ef08 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:55.957020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222517bb-4f60-4b32-9f02-ff59dd11ef08 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:55.957020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222517bb-4f60-4b32-9f02-ff59dd11ef08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:55.975579 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-222517bb-4f60-4b32-9f02-ff59dd11ef08 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:55.976767 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-222517bb-4f60-4b32-9f02-ff59dd11ef08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:56.069993 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 518/1022] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:55 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:31:56.123121 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0cf6f6-d0a8-4902-9a4f-1cde6246554d None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:56.123674 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0cf6f6-d0a8-4902-9a4f-1cde6246554d None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:56.124150 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0cf6f6-d0a8-4902-9a4f-1cde6246554d None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:56.126509 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 505/1023] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:31:56.132265 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06afde9-dd4c-4ce4-b461-53b4b1a32ee3 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:56.132545 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06afde9-dd4c-4ce4-b461-53b4b1a32ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:56.132818 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06afde9-dd4c-4ce4-b461-53b4b1a32ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:56.151426 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-d06afde9-dd4c-4ce4-b461-53b4b1a32ee3 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:56.152773 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-d06afde9-dd4c-4ce4-b461-53b4b1a32ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:56.220039 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:56.241468 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 519/1024] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:56 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:31:56.355671 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0cf6f6-d0a8-4902-9a4f-1cde6246554d None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:56.459447 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:56.477843 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0cf6f6-d0a8-4902-9a4f-1cde6246554d None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:56.518455 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae520da-f4af-49cc-8144-caacc0cddd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:56.518816 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06afde9-dd4c-4ce4-b461-53b4b1a32ee3 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:56.519127 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae520da-f4af-49cc-8144-caacc0cddd8e None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:56.519417 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae520da-f4af-49cc-8144-caacc0cddd8e None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:56.519691 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae520da-f4af-49cc-8144-caacc0cddd8e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:56.520826 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae520da-f4af-49cc-8144-caacc0cddd8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:56.522264 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae520da-f4af-49cc-8144-caacc0cddd8e None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:56.523908 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 506/1025] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:31:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:56.531848 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae520da-f4af-49cc-8144-caacc0cddd8e None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:56.653191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae520da-f4af-49cc-8144-caacc0cddd8e None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:56.654596 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06afde9-dd4c-4ce4-b461-53b4b1a32ee3 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:56.694722 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc84a4f-d33b-448f-857c-ece6404228ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:56.695389 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc84a4f-d33b-448f-857c-ece6404228ef None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:56.695665 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc84a4f-d33b-448f-857c-ece6404228ef None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:56.695919 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7906c71-9a38-46cb-b426-c9b07f674ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:56.696035 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc84a4f-d33b-448f-857c-ece6404228ef None admin] PATH_INFO: `/v3/services/image` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:56.696503 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc84a4f-d33b-448f-857c-ece6404228ef None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:56.696611 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7906c71-9a38-46cb-b426-c9b07f674ad1 None admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:56.696793 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7906c71-9a38-46cb-b426-c9b07f674ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:56.697063 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7906c71-9a38-46cb-b426-c9b07f674ad1 None admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:56.697719 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7906c71-9a38-46cb-b426-c9b07f674ad1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:56.697891 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc84a4f-d33b-448f-857c-ece6404228ef None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:56.699338 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7906c71-9a38-46cb-b426-c9b07f674ad1 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:56.708140 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-6fc84a4f-d33b-448f-857c-ece6404228ef None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 07:31:56.708140 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:56.708140 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 07:31:56.708140 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 07:31:56.708140 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 07:31:56.708140 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 07:31:56.708140 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 07:31:56.708140 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:31:56.708140 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 07:31:56.708140 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:56.708140 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 07:31:56.708140 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:56.708140 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:56.708140 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:56.708140 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:56.708140 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:56.708140 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:56.709317 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:56.709317 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:56.709317 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:56.709317 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:56.709317 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:56.709317 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:56.709317 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 07:31:56.709317 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 07:31:56.709317 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 07:31:56.709317 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 07:31:56.709317 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:56.709317 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:56.709317 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:56.709317 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:56.709317 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:56.709317 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:56.710801 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:56.710801 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:56.710801 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:56.710801 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:56.710801 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:56.710801 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:56.710801 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:56.710801 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:56.710801 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:56.710801 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:56.710801 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 07:31:56.710801 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:31:56.710801 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 07:31:56.710801 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:56.710801 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 520/1026] 10.222.0.42 () {56 vars in 1105 bytes} [Fri Aug 26 07:31:56 2022] GET /identity/v3/services/image => generated 86 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:56.715424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc84a4f-d33b-448f-857c-ece6404228ef None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:56.776855 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:56.827577 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc84a4f-d33b-448f-857c-ece6404228ef None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:56.843999 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 507/1027] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 26 07:31:56 2022] POST /identity/v3/users => generated 285 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 07:31:56.873851 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13307dac-6c74-4434-8b84-75f4c2361882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:56.874654 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13307dac-6c74-4434-8b84-75f4c2361882 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:56.875114 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13307dac-6c74-4434-8b84-75f4c2361882 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:56.877965 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13307dac-6c74-4434-8b84-75f4c2361882 None admin] PATH_INFO: `/v3/services` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:56.877965 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13307dac-6c74-4434-8b84-75f4c2361882 None admin] RBAC: Adding query filter params (name=image) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:56.877965 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13307dac-6c74-4434-8b84-75f4c2361882 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:56.879591 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13307dac-6c74-4434-8b84-75f4c2361882 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:56.885680 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 521/1028] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:31:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:56.892717 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7906c71-9a38-46cb-b426-c9b07f674ad1 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:56.909353 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:57.025535 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7906c71-9a38-46cb-b426-c9b07f674ad1 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:57.065068 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382d136-de71-4643-8419-5b5f08e649d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:57.065687 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382d136-de71-4643-8419-5b5f08e649d9 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:57.065963 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382d136-de71-4643-8419-5b5f08e649d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:57.066235 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382d136-de71-4643-8419-5b5f08e649d9 None admin] PATH_INFO: `/v3/services` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:57.066874 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382d136-de71-4643-8419-5b5f08e649d9 None admin] RBAC: Adding query filter params (type=image) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:57.067203 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382d136-de71-4643-8419-5b5f08e649d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:57.068587 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382d136-de71-4643-8419-5b5f08e649d9 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:57.074814 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 508/1029] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:31:56 2022] GET /identity/v3/services?type=image => generated 350 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:57.079771 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc32a6e-9bcb-4ec7-ac36-094282872301 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:57.080305 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc32a6e-9bcb-4ec7-ac36-094282872301 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:57.080305 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc32a6e-9bcb-4ec7-ac36-094282872301 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:57.081671 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 522/1030] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:31:57.082135 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382d136-de71-4643-8419-5b5f08e649d9 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:57.089580 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6eddf2-c146-4419-878e-3e16603c4195 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:57.089862 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6eddf2-c146-4419-878e-3e16603c4195 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:57.090138 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6eddf2-c146-4419-878e-3e16603c4195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:57.113391 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-bd6eddf2-c146-4419-878e-3e16603c4195 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:57.114609 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-bd6eddf2-c146-4419-878e-3e16603c4195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:57.177485 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:57.191893 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 523/1031] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:57 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 07:31:57.211819 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382d136-de71-4643-8419-5b5f08e649d9 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:57.249475 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b0876-0563-4167-9b96-9fe632775fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:57.250093 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b0876-0563-4167-9b96-9fe632775fe1 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:57.250368 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b0876-0563-4167-9b96-9fe632775fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:57.250634 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b0876-0563-4167-9b96-9fe632775fe1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:57.251375 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b0876-0563-4167-9b96-9fe632775fe1 None admin] RBAC: Adding query filter params (interface=public, service_id=f0c3a13fe85a4760b18339854953eb96, region_id=RegionOne) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:57.251682 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b0876-0563-4167-9b96-9fe632775fe1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:57.253064 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b0876-0563-4167-9b96-9fe632775fe1 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:57.259271 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 509/1032] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Aug 26 07:31:57 2022] GET /identity/v3/endpoints?service_id=f0c3a13fe85a4760b18339854953eb96&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:57.265467 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6eddf2-c146-4419-878e-3e16603c4195 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:57.332253 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:57.389130 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6eddf2-c146-4419-878e-3e16603c4195 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:57.429778 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f4872-25fa-4d98-9b23-d21c37e54729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:57.430303 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f4872-25fa-4d98-9b23-d21c37e54729 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:57.430585 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f4872-25fa-4d98-9b23-d21c37e54729 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:57.430859 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f4872-25fa-4d98-9b23-d21c37e54729 None admin] PATH_INFO: `/v3/services` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:57.431545 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f4872-25fa-4d98-9b23-d21c37e54729 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:57.432922 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f4872-25fa-4d98-9b23-d21c37e54729 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:57.440759 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 524/1033] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Aug 26 07:31:57 2022] GET /identity/v3/services => generated 1957 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:31:57.471131 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b0876-0563-4167-9b96-9fe632775fe1 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:57.610367 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b0876-0563-4167-9b96-9fe632775fe1 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:57.648154 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375bd3e-8725-41b4-bd88-064dffabe77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:57.648798 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375bd3e-8725-41b4-bd88-064dffabe77f None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:57.649080 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375bd3e-8725-41b4-bd88-064dffabe77f None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:57.649355 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375bd3e-8725-41b4-bd88-064dffabe77f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:57.657567 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:57.664540 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f375bd3e-8725-41b4-bd88-064dffabe77f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:31:57.666976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-f375bd3e-8725-41b4-bd88-064dffabe77f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 07:31:57.666976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:57.666976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:57.666976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:57.666976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:57.666976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:57.666976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:57.666976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:57.666976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:57.666976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:57.666976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:57.666976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:57.666976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:31:57.666976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:31:57.666976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:31:57.666976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:31:57.668101 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:31:57.668101 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:31:57.668101 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:31:57.668101 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:31:57.668101 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:57.668101 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:57.668101 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:57.668101 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:57.668101 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:57.668101 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:57.668101 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:57.668101 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:57.668101 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:57.668101 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:57.668101 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:57.668101 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:57.669080 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:57.669080 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:57.669080 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:57.669080 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:57.669080 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:31:57.669080 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:31:57.669080 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:31:57.669080 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:31:57.669080 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:31:57.669080 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:31:57.669080 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 07:31:57.669080 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:57.671200 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 510/1034] 10.222.0.42 () {56 vars in 1120 bytes} [Fri Aug 26 07:31:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:57.675136 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f4872-25fa-4d98-9b23-d21c37e54729 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:57.802842 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f4872-25fa-4d98-9b23-d21c37e54729 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:57.815740 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:57.844045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee5cbe-93d8-482d-84e0-21789ce3b581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:57.844672 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee5cbe-93d8-482d-84e0-21789ce3b581 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:57.844948 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee5cbe-93d8-482d-84e0-21789ce3b581 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:57.845227 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee5cbe-93d8-482d-84e0-21789ce3b581 None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:57.845906 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee5cbe-93d8-482d-84e0-21789ce3b581 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:57.846214 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee5cbe-93d8-482d-84e0-21789ce3b581 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:57.847661 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee5cbe-93d8-482d-84e0-21789ce3b581 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:57.864202 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 525/1035] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Aug 26 07:31:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:57.865888 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375bd3e-8725-41b4-bd88-064dffabe77f None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:57.992348 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375bd3e-8725-41b4-bd88-064dffabe77f None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:58.033381 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c16c76-092c-4aea-a2a9-7cbb2c96c56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:58.034005 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c16c76-092c-4aea-a2a9-7cbb2c96c56e None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:58.034257 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c16c76-092c-4aea-a2a9-7cbb2c96c56e None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:58.034482 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c16c76-092c-4aea-a2a9-7cbb2c96c56e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:58.046721 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c16c76-092c-4aea-a2a9-7cbb2c96c56e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:58.048241 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c16c76-092c-4aea-a2a9-7cbb2c96c56e None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:58.064273 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-95c16c76-092c-4aea-a2a9-7cbb2c96c56e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:58.064273 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:58.064273 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:58.064273 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:58.064273 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:58.064273 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:58.064273 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:58.064273 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:58.064273 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:58.064273 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:58.064273 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:58.064273 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:58.064273 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:31:58.064273 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:31:58.064273 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:31:58.064273 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:31:58.065505 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:58.065505 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:58.065505 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:58.065505 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:58.065505 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:58.065505 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:58.065505 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:58.065505 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:58.065505 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:58.065505 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:58.065505 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:58.065505 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:58.065505 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:58.065505 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:58.065505 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:58.065505 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:58.065505 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:31:58.066521 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:31:58.066521 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:58.066521 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:58.070877 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 511/1036] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:31:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:58.072402 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee5cbe-93d8-482d-84e0-21789ce3b581 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:58.203540 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee5cbe-93d8-482d-84e0-21789ce3b581 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:58.252541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb55b7d-55cc-4401-a98e-e44ff08fbfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:58.253153 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb55b7d-55cc-4401-a98e-e44ff08fbfbd None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:58.253433 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb55b7d-55cc-4401-a98e-e44ff08fbfbd None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:58.253707 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb55b7d-55cc-4401-a98e-e44ff08fbfbd None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:58.254351 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb55b7d-55cc-4401-a98e-e44ff08fbfbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:58.254652 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb55b7d-55cc-4401-a98e-e44ff08fbfbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:58.256125 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb55b7d-55cc-4401-a98e-e44ff08fbfbd None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:58.282033 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 526/1037] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:31:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:58.283745 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c16c76-092c-4aea-a2a9-7cbb2c96c56e None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:58.345473 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:58.407229 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c16c76-092c-4aea-a2a9-7cbb2c96c56e None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:58.449364 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69957e19-10f5-4434-a8cc-15c9578f8d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:58.449364 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69957e19-10f5-4434-a8cc-15c9578f8d15 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:58.449364 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69957e19-10f5-4434-a8cc-15c9578f8d15 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:58.449702 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69957e19-10f5-4434-a8cc-15c9578f8d15 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:58.461392 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69957e19-10f5-4434-a8cc-15c9578f8d15 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:58.462853 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69957e19-10f5-4434-a8cc-15c9578f8d15 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:58.474419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-69957e19-10f5-4434-a8cc-15c9578f8d15 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 07:31:58.474419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:58.474419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:58.474419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:58.474419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:58.474419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:58.474419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:58.474419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:58.474419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:58.474419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:58.474419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:58.474419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:58.474419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 07:31:58.474419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 07:31:58.474419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 07:31:58.474419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 07:31:58.475538 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:58.475538 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:58.475538 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 07:31:58.475538 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:31:58.475538 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 07:31:58.475538 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:31:58.475538 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:58.475538 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:58.475538 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:58.475538 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:58.475538 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:58.475538 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:58.475538 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:58.475538 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:58.475538 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:58.475538 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:58.475538 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:58.475538 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:58.481804 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:58.481804 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:58.481804 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 07:31:58.481804 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 07:31:58.481804 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 07:31:58.481804 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 07:31:58.481804 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 07:31:58.481804 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 07:31:58.481804 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 07:31:58.481804 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:58.481804 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 512/1038] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Aug 26 07:31:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:58.486785 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb55b7d-55cc-4401-a98e-e44ff08fbfbd None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:58.525769 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:58.612606 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb55b7d-55cc-4401-a98e-e44ff08fbfbd None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:58.653782 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637666f-3796-46c1-8323-0fd49ae40f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:58.654551 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637666f-3796-46c1-8323-0fd49ae40f53 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:58.654926 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637666f-3796-46c1-8323-0fd49ae40f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:58.655234 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637666f-3796-46c1-8323-0fd49ae40f53 None admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:58.655961 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2637666f-3796-46c1-8323-0fd49ae40f53 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:58.656265 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2637666f-3796-46c1-8323-0fd49ae40f53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:58.657675 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2637666f-3796-46c1-8323-0fd49ae40f53 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:58.680191 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 527/1039] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Aug 26 07:31:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:58.681849 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69957e19-10f5-4434-a8cc-15c9578f8d15 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:58.806237 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69957e19-10f5-4434-a8cc-15c9578f8d15 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:58.824232 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:58.849260 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a00566-1103-465a-a4e4-f7e94332ac0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:58.849873 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a00566-1103-465a-a4e4-f7e94332ac0b None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:58.850149 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a00566-1103-465a-a4e4-f7e94332ac0b None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:58.850418 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a00566-1103-465a-a4e4-f7e94332ac0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:58.926355 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a00566-1103-465a-a4e4-f7e94332ac0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:58.928065 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a00566-1103-465a-a4e4-f7e94332ac0b None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:58.953301 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c7062-3886-41ed-be56-8e1bc91c71a2 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:58.953574 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c7062-3886-41ed-be56-8e1bc91c71a2 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:58.953843 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c7062-3886-41ed-be56-8e1bc91c71a2 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:58.955205 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 528/1040] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 07:31:58.961363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b03a6c-c8ab-4cf5-8c1b-322896496faf None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:58.961719 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b03a6c-c8ab-4cf5-8c1b-322896496faf None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:58.961909 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b03a6c-c8ab-4cf5-8c1b-322896496faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:58.980593 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-14b03a6c-c8ab-4cf5-8c1b-322896496faf None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:58.981803 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-14b03a6c-c8ab-4cf5-8c1b-322896496faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:59.049212 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 513/1041] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:31:58 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 07:31:59.054859 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a00566-1103-465a-a4e4-f7e94332ac0b None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:59.063754 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 529/1042] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:58 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:31:59.072764 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:59.178754 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a00566-1103-465a-a4e4-f7e94332ac0b None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:59.215361 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655e91c-7874-4b48-9319-4fecafa2803e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:59.216047 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655e91c-7874-4b48-9319-4fecafa2803e None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:59.216930 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655e91c-7874-4b48-9319-4fecafa2803e None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:59.217369 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655e91c-7874-4b48-9319-4fecafa2803e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:59.228050 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655e91c-7874-4b48-9319-4fecafa2803e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:59.229510 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655e91c-7874-4b48-9319-4fecafa2803e None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:59.245022 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-2655e91c-7874-4b48-9319-4fecafa2803e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:59.245022 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:59.245022 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:59.245022 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:59.245022 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:59.245022 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:59.245022 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:59.245022 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:59.245022 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:59.245022 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:59.245022 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:59.245022 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:59.245022 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:31:59.245022 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:31:59.245022 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:31:59.245022 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:31:59.246009 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:59.246009 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:59.246009 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:59.246009 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:59.246009 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:59.246009 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:59.246009 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:59.246009 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:59.246009 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:59.246009 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:59.246009 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:59.246009 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:59.246009 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:59.246009 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:59.246009 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:59.246009 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:59.246009 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:31:59.247545 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:31:59.247545 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:31:59.247545 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:59.247545 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 514/1043] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:31:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 07:31:59.252266 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b03a6c-c8ab-4cf5-8c1b-322896496faf None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:59.274840 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:59.340810 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655e91c-7874-4b48-9319-4fecafa2803e None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:59.365147 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b03a6c-c8ab-4cf5-8c1b-322896496faf None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:59.406000 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e463c-ad62-498c-ba67-5c99fe7bc06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:59.406619 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e463c-ad62-498c-ba67-5c99fe7bc06c None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:59.406900 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e463c-ad62-498c-ba67-5c99fe7bc06c None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:59.407196 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e463c-ad62-498c-ba67-5c99fe7bc06c None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:59.407848 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e463c-ad62-498c-ba67-5c99fe7bc06c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:59.408149 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e463c-ad62-498c-ba67-5c99fe7bc06c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:59.409357 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:59.409531 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e463c-ad62-498c-ba67-5c99fe7bc06c None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:59.428375 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 530/1044] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:31:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:59.429681 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e463c-ad62-498c-ba67-5c99fe7bc06c None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:59.464960 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655e91c-7874-4b48-9319-4fecafa2803e None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:59.504448 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d122e-9784-421e-8734-316387ed1264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:59.505094 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d122e-9784-421e-8734-316387ed1264 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:59.505373 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d122e-9784-421e-8734-316387ed1264 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:59.505647 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d122e-9784-421e-8734-316387ed1264 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:59.517511 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d122e-9784-421e-8734-316387ed1264 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:31:59.522739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-469d122e-9784-421e-8734-316387ed1264 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:31:59.522739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:59.522739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:59.522739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:59.522739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:59.522739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:59.522739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:59.522739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:59.522739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:59.522739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:59.522739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:59.522739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:59.522739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:31:59.522739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:31:59.522739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:31:59.522739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:31:59.523953 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:31:59.523953 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:31:59.523953 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:31:59.523953 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:31:59.523953 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:59.523953 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:59.523953 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:59.523953 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:59.523953 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:59.523953 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:59.523953 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:59.523953 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:59.523953 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:59.523953 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:59.523953 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:59.523953 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:59.524993 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:59.524993 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:59.524993 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:59.524993 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:59.524993 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:31:59.524993 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:31:59.524993 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:31:59.524993 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:31:59.524993 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:31:59.524993 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:31:59.524993 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:31:59.524993 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:31:59.524993 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 515/1045] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 26 07:31:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:59.525747 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8fe85-2909-4f04-8d92-56a613d4f358 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:59.525747 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8fe85-2909-4f04-8d92-56a613d4f358 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:59.525747 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8fe85-2909-4f04-8d92-56a613d4f358 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:59.526963 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 516/1046] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:31:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:31:59.529786 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:59.531800 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8fe85-2909-4f04-8d92-56a613d4f358 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:59.550440 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e463c-ad62-498c-ba67-5c99fe7bc06c None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:59.586504 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b766e0c-1aae-4f9e-ac63-c3a27c11ad48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:59.587161 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b766e0c-1aae-4f9e-ac63-c3a27c11ad48 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:59.587443 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b766e0c-1aae-4f9e-ac63-c3a27c11ad48 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:59.587716 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b766e0c-1aae-4f9e-ac63-c3a27c11ad48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:59.594545 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b766e0c-1aae-4f9e-ac63-c3a27c11ad48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:59.596016 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b766e0c-1aae-4f9e-ac63-c3a27c11ad48 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:59.608772 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-7b766e0c-1aae-4f9e-ac63-c3a27c11ad48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:31:59.608772 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:31:59.608772 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:31:59.608772 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:31:59.608772 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:31:59.608772 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:31:59.608772 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:31:59.608772 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:31:59.608772 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:31:59.608772 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:31:59.608772 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:31:59.608772 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:31:59.608772 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 07:31:59.608772 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 07:31:59.608772 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 07:31:59.614972 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 07:31:59.614972 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:31:59.614972 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:31:59.614972 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:31:59.614972 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:31:59.614972 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:31:59.614972 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:31:59.614972 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:31:59.614972 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:31:59.614972 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:31:59.614972 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:31:59.614972 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:31:59.614972 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:31:59.614972 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:31:59.614972 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:31:59.614972 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:31:59.614972 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:31:59.616153 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 07:31:59.616153 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 07:31:59.616153 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 07:31:59.616153 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 07:31:59.616153 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 07:31:59.616153 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 07:31:59.616153 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:31:59.616153 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:31:59.616153 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 531/1047] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:31:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:31:59.616153 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84598c68-8c2c-4b71-980e-6bf6e6dd805c None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:59.616153 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84598c68-8c2c-4b71-980e-6bf6e6dd805c None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:59.616928 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84598c68-8c2c-4b71-980e-6bf6e6dd805c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:59.635841 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-84598c68-8c2c-4b71-980e-6bf6e6dd805c None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:31:59.637046 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-84598c68-8c2c-4b71-980e-6bf6e6dd805c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:31:59.644917 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8fe85-2909-4f04-8d92-56a613d4f358 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:59.668194 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:59.687824 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c5995-a206-4dde-820c-e827804b6561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:59.687824 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c5995-a206-4dde-820c-e827804b6561 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:59.687824 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c5995-a206-4dde-820c-e827804b6561 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:59.687824 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c5995-a206-4dde-820c-e827804b6561 None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:59.688443 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c5995-a206-4dde-820c-e827804b6561 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:59.688443 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c5995-a206-4dde-820c-e827804b6561 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:59.688443 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c5995-a206-4dde-820c-e827804b6561 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:59.703123 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 517/1048] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:31:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:59.703123 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c5995-a206-4dde-820c-e827804b6561 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:59.711443 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 532/1049] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:31:59 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:31:59.712123 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84598c68-8c2c-4b71-980e-6bf6e6dd805c None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:59.789644 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:31:59.817662 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c5995-a206-4dde-820c-e827804b6561 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:59.825520 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84598c68-8c2c-4b71-980e-6bf6e6dd805c None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:31:59.867546 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de6bb6-5a1c-4a75-b22f-dc61bfc9b652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:59.867808 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf35687-133e-487e-9257-0b49bf313fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:31:59.868237 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de6bb6-5a1c-4a75-b22f-dc61bfc9b652 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:59.868416 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf35687-133e-487e-9257-0b49bf313fe6 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:31:59.868520 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de6bb6-5a1c-4a75-b22f-dc61bfc9b652 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:59.868695 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf35687-133e-487e-9257-0b49bf313fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:31:59.868818 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de6bb6-5a1c-4a75-b22f-dc61bfc9b652 None admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:59.868971 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf35687-133e-487e-9257-0b49bf313fe6 None admin] PATH_INFO: `/v3/users/91f974d6343c4f56b4b1e15df7359479` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:31:59.869474 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de6bb6-5a1c-4a75-b22f-dc61bfc9b652 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:31:59.869785 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de6bb6-5a1c-4a75-b22f-dc61bfc9b652 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:59.871265 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de6bb6-5a1c-4a75-b22f-dc61bfc9b652 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:59.885208 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 518/1050] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 26 07:31:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:59.886912 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf35687-133e-487e-9257-0b49bf313fe6 None admin] RBAC: Authorizing `identity:get_user(user_id=91f974d6343c4f56b4b1e15df7359479)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:31:59.888622 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf35687-133e-487e-9257-0b49bf313fe6 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:31:59.890473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 533/1051] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:31:59 2022] GET /identity/v3/users/91f974d6343c4f56b4b1e15df7359479 => generated 285 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:31:59.892258 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de6bb6-5a1c-4a75-b22f-dc61bfc9b652 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:59.898554 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf35687-133e-487e-9257-0b49bf313fe6 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:31:59.947018 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:00.012329 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de6bb6-5a1c-4a75-b22f-dc61bfc9b652 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:00.015058 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf35687-133e-487e-9257-0b49bf313fe6 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:00.046065 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:00.052874 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91a166-b93c-49a0-a85d-cfc331140d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:00.053481 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91a166-b93c-49a0-a85d-cfc331140d81 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:00.053756 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91a166-b93c-49a0-a85d-cfc331140d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:00.054023 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91a166-b93c-49a0-a85d-cfc331140d81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:00.054204 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966a6ac-fbb5-46d4-bf89-d299feeeb07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:00.054745 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c91a166-b93c-49a0-a85d-cfc331140d81 None admin] RBAC: Adding query filter params (role.id=dc39243380ac40299d78581303d95252, scope.project.id=becbf57e91454d499dec313ff9eadfae, user.id=bc92c0a0a2cc4722868e6877bac93ada) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:32:00.054875 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966a6ac-fbb5-46d4-bf89-d299feeeb07c None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:00.055075 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c91a166-b93c-49a0-a85d-cfc331140d81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:00.055173 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966a6ac-fbb5-46d4-bf89-d299feeeb07c None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:00.061726 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966a6ac-fbb5-46d4-bf89-d299feeeb07c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:00.061888 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c91a166-b93c-49a0-a85d-cfc331140d81 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:00.063637 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 519/1052] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:31:59 2022] GET /identity/v3/role_assignments?user.id=bc92c0a0a2cc4722868e6877bac93ada&scope.project.id=becbf57e91454d499dec313ff9eadfae&role.id=dc39243380ac40299d78581303d95252 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:00.064731 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91a166-b93c-49a0-a85d-cfc331140d81 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:00.139570 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966a6ac-fbb5-46d4-bf89-d299feeeb07c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:00.141218 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966a6ac-fbb5-46d4-bf89-d299feeeb07c None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:00.205333 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91a166-b93c-49a0-a85d-cfc331140d81 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:00.215049 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:00.245768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098077f-6520-43d5-b642-2db1ca5f3a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:00.246495 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098077f-6520-43d5-b642-2db1ca5f3a03 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:00.246771 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098077f-6520-43d5-b642-2db1ca5f3a03 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:00.247074 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098077f-6520-43d5-b642-2db1ca5f3a03 None admin] PATH_INFO: `/v3/services/image` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:00.248374 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6098077f-6520-43d5-b642-2db1ca5f3a03 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:00.249889 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6098077f-6520-43d5-b642-2db1ca5f3a03 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:00.260324 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-6098077f-6520-43d5-b642-2db1ca5f3a03 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 07:32:00.260324 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:32:00.260324 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 07:32:00.260324 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 07:32:00.260324 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 07:32:00.260324 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 07:32:00.260324 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 07:32:00.260324 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:32:00.260324 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 07:32:00.260324 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:32:00.260324 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 07:32:00.260324 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:32:00.260324 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:32:00.260324 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:32:00.260324 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:32:00.260324 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:32:00.260324 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:32:00.261667 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:32:00.261667 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:32:00.261667 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:32:00.261667 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:32:00.261667 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:32:00.261667 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:32:00.261667 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 07:32:00.261667 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 07:32:00.261667 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 07:32:00.261667 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 07:32:00.261667 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:32:00.261667 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:32:00.261667 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:32:00.261667 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:32:00.261667 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:32:00.261667 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:32:00.262849 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:32:00.262849 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:32:00.262849 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:32:00.262849 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:32:00.262849 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:32:00.262849 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:32:00.262849 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:32:00.262849 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:32:00.262849 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:32:00.262849 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:32:00.262849 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 07:32:00.262849 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:32:00.262849 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 07:32:00.262849 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:32:00.262849 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 520/1053] 10.222.0.42 () {56 vars in 1105 bytes} [Fri Aug 26 07:32:00 2022] GET /identity/v3/services/image => generated 86 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:32:00.267727 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098077f-6520-43d5-b642-2db1ca5f3a03 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:00.280435 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 534/1054] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:31:59 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 07:32:00.282308 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966a6ac-fbb5-46d4-bf89-d299feeeb07c None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:00.320776 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:00.392813 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098077f-6520-43d5-b642-2db1ca5f3a03 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:00.418840 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966a6ac-fbb5-46d4-bf89-d299feeeb07c None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:00.442800 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59644f31-91a6-4c4e-b21d-c5637212525b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:00.443452 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59644f31-91a6-4c4e-b21d-c5637212525b None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:00.443990 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59644f31-91a6-4c4e-b21d-c5637212525b None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:00.444288 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59644f31-91a6-4c4e-b21d-c5637212525b None admin] PATH_INFO: `/v3/services` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:00.444912 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59644f31-91a6-4c4e-b21d-c5637212525b None admin] RBAC: Adding query filter params (name=image) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:32:00.445216 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59644f31-91a6-4c4e-b21d-c5637212525b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:00.446602 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59644f31-91a6-4c4e-b21d-c5637212525b None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:00.453074 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 521/1055] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:32:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:32:00.458633 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59644f31-91a6-4c4e-b21d-c5637212525b None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:00.461373 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a907a4-f98d-45dc-b563-49d149ec35a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:00.462027 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a907a4-f98d-45dc-b563-49d149ec35a4 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:00.462291 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a907a4-f98d-45dc-b563-49d149ec35a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:00.462559 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a907a4-f98d-45dc-b563-49d149ec35a4 None admin] PATH_INFO: `/v3/projects/43760eb07e3e4c059a59ed6dc6b83bf3` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:00.463779 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a907a4-f98d-45dc-b563-49d149ec35a4 None admin] RBAC: Authorizing `identity:get_project(project_id=43760eb07e3e4c059a59ed6dc6b83bf3)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:00.465210 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a907a4-f98d-45dc-b563-49d149ec35a4 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:00.467829 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 535/1056] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:32:00 2022] GET /identity/v3/projects/43760eb07e3e4c059a59ed6dc6b83bf3 => generated 311 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:32:00.473895 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a907a4-f98d-45dc-b563-49d149ec35a4 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:00.500310 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:00.574529 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59644f31-91a6-4c4e-b21d-c5637212525b None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:00.588898 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:00.597008 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a907a4-f98d-45dc-b563-49d149ec35a4 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:00.614336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11c226-b63d-438f-9c99-bdeb96d9e4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:00.614944 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11c226-b63d-438f-9c99-bdeb96d9e4a2 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:00.615284 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11c226-b63d-438f-9c99-bdeb96d9e4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:00.615546 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11c226-b63d-438f-9c99-bdeb96d9e4a2 None admin] PATH_INFO: `/v3/services` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:00.616179 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e11c226-b63d-438f-9c99-bdeb96d9e4a2 None admin] RBAC: Adding query filter params (type=image) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:32:00.616478 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e11c226-b63d-438f-9c99-bdeb96d9e4a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:00.617877 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e11c226-b63d-438f-9c99-bdeb96d9e4a2 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:00.623713 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 522/1057] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:32:00 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:00.629278 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11c226-b63d-438f-9c99-bdeb96d9e4a2 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:00.634711 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8bee51-170b-4348-a148-ba8b4837fa64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:00.635416 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bee51-170b-4348-a148-ba8b4837fa64 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:00.635689 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bee51-170b-4348-a148-ba8b4837fa64 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:00.635958 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bee51-170b-4348-a148-ba8b4837fa64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:00.636684 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8bee51-170b-4348-a148-ba8b4837fa64 None admin] RBAC: Adding query filter params (role.id=07ed857b2feb472f9fa9e7fe0b08582b, scope.project.id=43760eb07e3e4c059a59ed6dc6b83bf3, user.id=91f974d6343c4f56b4b1e15df7359479) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:32:00.637055 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8bee51-170b-4348-a148-ba8b4837fa64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:00.642438 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8bee51-170b-4348-a148-ba8b4837fa64 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:00.659019 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 536/1058] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:32:00 2022] GET /identity/v3/role_assignments?user.id=91f974d6343c4f56b4b1e15df7359479&scope.project.id=43760eb07e3e4c059a59ed6dc6b83bf3&role.id=07ed857b2feb472f9fa9e7fe0b08582b => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:32:00.772067 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:00.775873 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11c226-b63d-438f-9c99-bdeb96d9e4a2 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:00.822753 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7993ff6-53d3-4ebe-b31c-ba79df7eb501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:00.823800 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7993ff6-53d3-4ebe-b31c-ba79df7eb501 None admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:00.824277 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7993ff6-53d3-4ebe-b31c-ba79df7eb501 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:00.824766 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7993ff6-53d3-4ebe-b31c-ba79df7eb501 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:00.825638 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7993ff6-53d3-4ebe-b31c-ba79df7eb501 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:00.827419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7993ff6-53d3-4ebe-b31c-ba79df7eb501 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:00.933393 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 523/1059] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:32:00 2022] POST /identity/v3/endpoints => generated 327 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 07:32:02.038663 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3aecc7-78bf-4424-9627-c42760a3016b None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:02.039229 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3aecc7-78bf-4424-9627-c42760a3016b None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:02.039229 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3aecc7-78bf-4424-9627-c42760a3016b None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:02.040664 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 537/1060] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:32:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:32:02.046613 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b46f59-2e1b-40cf-8bc7-5cde8570fff9 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:02.047182 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b46f59-2e1b-40cf-8bc7-5cde8570fff9 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:02.047182 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b46f59-2e1b-40cf-8bc7-5cde8570fff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:02.068028 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-59b46f59-2e1b-40cf-8bc7-5cde8570fff9 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:32:02.069517 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-59b46f59-2e1b-40cf-8bc7-5cde8570fff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:32:02.158055 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 524/1061] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:32:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:32:02.436847 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3aecc7-78bf-4424-9627-c42760a3016b None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:02.554070 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3aecc7-78bf-4424-9627-c42760a3016b None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:02.590924 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e9bc0-73c9-4964-89d3-32ff5c6c841a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:02.591868 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e9bc0-73c9-4964-89d3-32ff5c6c841a None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:02.592348 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e9bc0-73c9-4964-89d3-32ff5c6c841a None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:02.592621 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e9bc0-73c9-4964-89d3-32ff5c6c841a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:02.603207 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d622a-2ed9-4e0a-bc40-c2a710a50ab6 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:02.603633 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d622a-2ed9-4e0a-bc40-c2a710a50ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:02.604012 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d622a-2ed9-4e0a-bc40-c2a710a50ab6 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:02.604400 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e9bc0-73c9-4964-89d3-32ff5c6c841a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:32:02.605632 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 525/1062] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:32:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 07:32:02.609970 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-975e9bc0-73c9-4964-89d3-32ff5c6c841a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 07:32:02.609970 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:32:02.609970 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:32:02.609970 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:32:02.609970 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:32:02.609970 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:32:02.609970 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:32:02.609970 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:32:02.609970 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:32:02.609970 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:32:02.609970 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:32:02.609970 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:32:02.609970 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:32:02.609970 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:32:02.609970 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:32:02.609970 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:32:02.610959 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:32:02.610959 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:32:02.610959 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:32:02.610959 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:32:02.610959 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:32:02.610959 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:32:02.610959 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:32:02.610959 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:32:02.610959 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:32:02.610959 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:32:02.610959 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:32:02.610959 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:32:02.610959 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:32:02.610959 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:32:02.610959 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:32:02.610959 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:32:02.611854 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:32:02.611854 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:32:02.611854 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:32:02.611854 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:32:02.611854 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:32:02.611854 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:32:02.611854 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:32:02.611854 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:32:02.611854 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:32:02.611854 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:32:02.611854 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 07:32:02.611854 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:32:02.613301 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2fd7c-5437-454b-8a65-6d493608d981 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:02.613648 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2fd7c-5437-454b-8a65-6d493608d981 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:02.613996 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2fd7c-5437-454b-8a65-6d493608d981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:02.615838 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 538/1063] 10.222.0.42 () {56 vars in 1120 bytes} [Fri Aug 26 07:32:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:32:02.617042 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e9bc0-73c9-4964-89d3-32ff5c6c841a None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:02.634737 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-1ee2fd7c-5437-454b-8a65-6d493608d981 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:32:02.635986 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-1ee2fd7c-5437-454b-8a65-6d493608d981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:32:02.643817 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:02.731454 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 526/1064] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:32:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:32:02.736626 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e9bc0-73c9-4964-89d3-32ff5c6c841a None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:02.777328 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff5b01-88f0-43c3-9f0d-8d285bc8b408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:02.778174 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff5b01-88f0-43c3-9f0d-8d285bc8b408 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:02.778580 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff5b01-88f0-43c3-9f0d-8d285bc8b408 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:02.778892 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff5b01-88f0-43c3-9f0d-8d285bc8b408 None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:02.779598 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ff5b01-88f0-43c3-9f0d-8d285bc8b408 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:32:02.779895 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ff5b01-88f0-43c3-9f0d-8d285bc8b408 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:02.781275 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ff5b01-88f0-43c3-9f0d-8d285bc8b408 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:02.795568 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 539/1065] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Aug 26 07:32:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:32:02.797112 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2fd7c-5437-454b-8a65-6d493608d981 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:02.814784 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:02.908413 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2fd7c-5437-454b-8a65-6d493608d981 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:02.927461 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264ce10-96f2-4171-87fb-86fb0df2770f None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:02.927779 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264ce10-96f2-4171-87fb-86fb0df2770f None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:02.928099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264ce10-96f2-4171-87fb-86fb0df2770f None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:02.929341 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 540/1066] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:32:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 07:32:02.934600 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c40ea-5819-4ee7-9b87-82bdf45d2645 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:02.934887 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c40ea-5819-4ee7-9b87-82bdf45d2645 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:02.935825 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c40ea-5819-4ee7-9b87-82bdf45d2645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:02.950360 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d79b5-5686-4e3a-8221-a70cc1f3d8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:02.952027 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d79b5-5686-4e3a-8221-a70cc1f3d8a0 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:02.952317 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d79b5-5686-4e3a-8221-a70cc1f3d8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:02.952594 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d79b5-5686-4e3a-8221-a70cc1f3d8a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:02.959477 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-fb3c40ea-5819-4ee7-9b87-82bdf45d2645 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:32:02.960763 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-fb3c40ea-5819-4ee7-9b87-82bdf45d2645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:32:02.963761 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d79b5-5686-4e3a-8221-a70cc1f3d8a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:02.965226 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d79b5-5686-4e3a-8221-a70cc1f3d8a0 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:02.981172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-9f5d79b5-5686-4e3a-8221-a70cc1f3d8a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:32:02.981172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:32:02.981172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:32:02.981172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:32:02.981172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:32:02.981172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:32:02.981172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:32:02.981172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:32:02.981172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:32:02.981172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:32:02.981172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:32:02.981172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:32:02.981172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:32:02.981172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:32:02.981172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:32:02.981172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:32:02.982294 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:32:02.982294 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:32:02.982294 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:32:02.982294 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:32:02.982294 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:32:02.982294 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:32:02.982294 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:32:02.982294 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:32:02.982294 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:32:02.982294 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:32:02.982294 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:32:02.982294 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:32:02.982294 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:32:02.982294 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:32:02.982294 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:32:02.982294 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:32:02.982294 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:32:02.983274 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:32:02.983274 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:32:02.983274 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:32:02.983461 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 527/1067] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:32:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:32:02.989206 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d79b5-5686-4e3a-8221-a70cc1f3d8a0 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:03.036359 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 541/1068] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:32:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:32:03.037216 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c40ea-5819-4ee7-9b87-82bdf45d2645 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:03.051484 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:03.074619 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:03.122415 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d79b5-5686-4e3a-8221-a70cc1f3d8a0 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:03.148619 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c40ea-5819-4ee7-9b87-82bdf45d2645 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:03.162639 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824b718-b8cd-4713-b4ff-6a08a6d52fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:03.163427 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824b718-b8cd-4713-b4ff-6a08a6d52fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:03.163715 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824b718-b8cd-4713-b4ff-6a08a6d52fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:03.163983 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824b718-b8cd-4713-b4ff-6a08a6d52fc4 None admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:03.165016 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824b718-b8cd-4713-b4ff-6a08a6d52fc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:32:03.165515 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824b718-b8cd-4713-b4ff-6a08a6d52fc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:03.166835 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824b718-b8cd-4713-b4ff-6a08a6d52fc4 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:03.182248 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 528/1069] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:32:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:32:03.189043 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824b718-b8cd-4713-b4ff-6a08a6d52fc4 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:03.192026 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a20b9-5b88-4b1f-b1d2-3b2bac2f8d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:03.192671 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a20b9-5b88-4b1f-b1d2-3b2bac2f8d8f None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:03.192952 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a20b9-5b88-4b1f-b1d2-3b2bac2f8d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:03.193217 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a20b9-5b88-4b1f-b1d2-3b2bac2f8d8f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:03.208498 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a20b9-5b88-4b1f-b1d2-3b2bac2f8d8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:32:03.213705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-298a20b9-5b88-4b1f-b1d2-3b2bac2f8d8f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:32:03.213705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:32:03.213705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:32:03.213705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:32:03.213705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:32:03.213705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:32:03.213705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:32:03.213705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:32:03.213705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:32:03.213705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:32:03.213705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:32:03.213705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:32:03.213705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:32:03.213705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:32:03.213705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:32:03.213705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:32:03.214705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:32:03.214705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:32:03.214705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:32:03.214705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:32:03.214705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:32:03.214705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:32:03.214705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:32:03.214705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:32:03.214705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:32:03.214705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:32:03.214705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:32:03.214705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:32:03.214705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:32:03.214705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:32:03.214705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:32:03.214705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:32:03.220669 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:32:03.220669 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:32:03.220669 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:32:03.220669 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:32:03.220669 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:32:03.220669 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:32:03.220669 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:32:03.220669 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:32:03.220669 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:32:03.220669 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:32:03.220669 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:32:03.220669 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:32:03.220669 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 542/1070] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 26 07:32:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:32:03.222069 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a20b9-5b88-4b1f-b1d2-3b2bac2f8d8f None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:03.301586 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:03.308437 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824b718-b8cd-4713-b4ff-6a08a6d52fc4 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:03.334667 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a20b9-5b88-4b1f-b1d2-3b2bac2f8d8f None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:03.337839 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:03.349161 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8da81d-7669-48e2-ad9e-f11b8feeef13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:03.349802 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8da81d-7669-48e2-ad9e-f11b8feeef13 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:03.350074 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8da81d-7669-48e2-ad9e-f11b8feeef13 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:03.350342 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8da81d-7669-48e2-ad9e-f11b8feeef13 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:03.359033 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8da81d-7669-48e2-ad9e-f11b8feeef13 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:03.360500 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8da81d-7669-48e2-ad9e-f11b8feeef13 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:03.373390 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec871b-edaa-49fa-995e-f5c95f63c891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:03.373711 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-4e8da81d-7669-48e2-ad9e-f11b8feeef13 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 07:32:03.373711 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:32:03.373711 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:32:03.373711 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:32:03.373711 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:32:03.373711 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:32:03.373711 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:32:03.373711 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:32:03.373711 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:32:03.373711 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:32:03.373711 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:32:03.373711 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:32:03.373711 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 07:32:03.373711 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 07:32:03.373711 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 07:32:03.373711 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 07:32:03.374790 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:32:03.374790 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:32:03.374790 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 07:32:03.374790 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:32:03.374790 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 07:32:03.374790 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:32:03.374790 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:32:03.374790 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:32:03.374790 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:32:03.374790 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:32:03.374790 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:32:03.374790 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:32:03.374790 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:32:03.374790 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:32:03.374790 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:32:03.374790 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:32:03.374790 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:32:03.374790 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:32:03.375776 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:32:03.375776 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:32:03.375776 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 07:32:03.375776 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 07:32:03.375776 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 07:32:03.375776 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 07:32:03.375776 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 07:32:03.375776 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 07:32:03.375776 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 07:32:03.375776 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:32:03.376310 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec871b-edaa-49fa-995e-f5c95f63c891 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:03.376310 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec871b-edaa-49fa-995e-f5c95f63c891 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:03.376310 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec871b-edaa-49fa-995e-f5c95f63c891 None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:03.376506 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 529/1071] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Aug 26 07:32:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:32:03.376506 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8da81d-7669-48e2-ad9e-f11b8feeef13 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:03.382314 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec871b-edaa-49fa-995e-f5c95f63c891 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:32:03.382314 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec871b-edaa-49fa-995e-f5c95f63c891 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:03.382314 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec871b-edaa-49fa-995e-f5c95f63c891 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:03.391449 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 543/1072] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:32:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:03.392298 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec871b-edaa-49fa-995e-f5c95f63c891 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:03.489216 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8da81d-7669-48e2-ad9e-f11b8feeef13 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:03.508863 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec871b-edaa-49fa-995e-f5c95f63c891 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:03.527347 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151b49a-2498-4302-a2d2-c2dace66cc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:03.527963 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151b49a-2498-4302-a2d2-c2dace66cc4b None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:03.528238 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151b49a-2498-4302-a2d2-c2dace66cc4b None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:03.528513 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151b49a-2498-4302-a2d2-c2dace66cc4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:03.546055 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1b7a8-cee7-4eb9-9dc4-d52a960d9218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:03.546660 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1b7a8-cee7-4eb9-9dc4-d52a960d9218 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:03.546999 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1b7a8-cee7-4eb9-9dc4-d52a960d9218 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:03.547255 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1b7a8-cee7-4eb9-9dc4-d52a960d9218 None admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:03.548083 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1b7a8-cee7-4eb9-9dc4-d52a960d9218 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:32:03.548387 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1b7a8-cee7-4eb9-9dc4-d52a960d9218 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:03.549842 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1b7a8-cee7-4eb9-9dc4-d52a960d9218 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:03.551795 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:03.579681 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 544/1073] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Aug 26 07:32:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:03.580760 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1b7a8-cee7-4eb9-9dc4-d52a960d9218 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:03.590219 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:03.610014 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1151b49a-2498-4302-a2d2-c2dace66cc4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:03.612047 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1151b49a-2498-4302-a2d2-c2dace66cc4b None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:03.710199 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1b7a8-cee7-4eb9-9dc4-d52a960d9218 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:03.745866 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 530/1074] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:32:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 07:32:03.746395 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151b49a-2498-4302-a2d2-c2dace66cc4b None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:03.758854 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c816050-fb7d-4d15-9ab9-170185321e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:03.759613 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c816050-fb7d-4d15-9ab9-170185321e21 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:03.759812 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c816050-fb7d-4d15-9ab9-170185321e21 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:03.760079 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c816050-fb7d-4d15-9ab9-170185321e21 None admin] PATH_INFO: `/v3/users/91f974d6343c4f56b4b1e15df7359479` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:03.764327 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c816050-fb7d-4d15-9ab9-170185321e21 None admin] RBAC: Authorizing `identity:get_user(user_id=91f974d6343c4f56b4b1e15df7359479)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:03.765884 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c816050-fb7d-4d15-9ab9-170185321e21 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:03.767839 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 545/1075] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:32:03 2022] GET /identity/v3/users/91f974d6343c4f56b4b1e15df7359479 => generated 285 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:03.768433 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c816050-fb7d-4d15-9ab9-170185321e21 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:03.851572 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:03.866954 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:03.886185 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151b49a-2498-4302-a2d2-c2dace66cc4b None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:03.908470 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c816050-fb7d-4d15-9ab9-170185321e21 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:03.932887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3476ae-c7d4-4a47-8bf7-0f2023e53d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:03.933881 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3476ae-c7d4-4a47-8bf7-0f2023e53d09 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:03.934162 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3476ae-c7d4-4a47-8bf7-0f2023e53d09 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:03.934544 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3476ae-c7d4-4a47-8bf7-0f2023e53d09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:03.947893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3476ae-c7d4-4a47-8bf7-0f2023e53d09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:03.949599 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3476ae-c7d4-4a47-8bf7-0f2023e53d09 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:03.956561 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694838fd-fa86-48f9-ad65-a185d25ad283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:03.957214 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694838fd-fa86-48f9-ad65-a185d25ad283 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:03.957494 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694838fd-fa86-48f9-ad65-a185d25ad283 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:03.957766 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694838fd-fa86-48f9-ad65-a185d25ad283 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:03.969442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-1f3476ae-c7d4-4a47-8bf7-0f2023e53d09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:32:03.969442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:32:03.969442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:32:03.969442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:32:03.969442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:32:03.969442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:32:03.969442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:32:03.969442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:32:03.969442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:32:03.969442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:32:03.969442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:32:03.969442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:32:03.969442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:32:03.969442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:32:03.969442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:32:03.969442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:32:03.970537 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:32:03.970537 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:32:03.970537 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:32:03.970537 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:32:03.970537 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:32:03.970537 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:32:03.970537 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:32:03.970537 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:32:03.970537 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:32:03.970537 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:32:03.970537 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:32:03.970537 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:32:03.970537 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:32:03.970537 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:32:03.970537 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:32:03.970537 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:32:03.970537 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:32:03.971475 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:32:03.971475 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:32:03.971475 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:32:03.971680 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694838fd-fa86-48f9-ad65-a185d25ad283 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:03.973088 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694838fd-fa86-48f9-ad65-a185d25ad283 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:03.975372 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 531/1076] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:32:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:32:03.976306 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3476ae-c7d4-4a47-8bf7-0f2023e53d09 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:03.990822 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-694838fd-fa86-48f9-ad65-a185d25ad283 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:32:03.990822 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:32:03.990822 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:32:03.990822 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:32:03.990822 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:32:03.990822 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:32:03.990822 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:32:03.990822 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:32:03.990822 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:32:03.990822 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:32:03.990822 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:32:03.990822 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:32:03.990822 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:32:03.990822 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:32:03.990822 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:32:03.990822 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:32:03.992045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:32:03.992045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:32:03.992045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:32:03.992045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:32:03.992045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:32:03.992045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:32:03.992045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:32:03.992045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:32:03.992045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:32:03.992045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:32:03.992045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:32:03.992045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:32:03.992045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:32:03.992045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:32:03.992045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:32:03.992045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:32:03.992045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:32:03.992950 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:32:03.992950 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:32:03.992950 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:32:03.992950 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 546/1077] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:32:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:32:03.993186 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694838fd-fa86-48f9-ad65-a185d25ad283 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:04.108423 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3476ae-c7d4-4a47-8bf7-0f2023e53d09 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:04.123232 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694838fd-fa86-48f9-ad65-a185d25ad283 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:04.146217 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ebc22-e301-4d58-af72-b32d13c8d346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:04.146888 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:04.147322 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ebc22-e301-4d58-af72-b32d13c8d346 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:04.147827 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ebc22-e301-4d58-af72-b32d13c8d346 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:04.148313 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ebc22-e301-4d58-af72-b32d13c8d346 None admin] PATH_INFO: `/v3/projects/43760eb07e3e4c059a59ed6dc6b83bf3` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:04.150328 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ebc22-e301-4d58-af72-b32d13c8d346 None admin] RBAC: Authorizing `identity:get_project(project_id=43760eb07e3e4c059a59ed6dc6b83bf3)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:04.152735 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ebc22-e301-4d58-af72-b32d13c8d346 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:04.155412 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 532/1078] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:32:03 2022] GET /identity/v3/projects/43760eb07e3e4c059a59ed6dc6b83bf3 => generated 311 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:04.156318 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ebc22-e301-4d58-af72-b32d13c8d346 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:04.170566 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:04.177198 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adcc052-8943-46cc-b5d5-1a865d56fbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:04.177837 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcc052-8943-46cc-b5d5-1a865d56fbc2 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:04.178487 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcc052-8943-46cc-b5d5-1a865d56fbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:04.178487 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcc052-8943-46cc-b5d5-1a865d56fbc2 None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:04.179123 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adcc052-8943-46cc-b5d5-1a865d56fbc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:32:04.179678 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adcc052-8943-46cc-b5d5-1a865d56fbc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:04.183949 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adcc052-8943-46cc-b5d5-1a865d56fbc2 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:04.197567 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 547/1079] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:32:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:04.198410 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adcc052-8943-46cc-b5d5-1a865d56fbc2 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:04.299937 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ebc22-e301-4d58-af72-b32d13c8d346 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:04.338538 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adcc052-8943-46cc-b5d5-1a865d56fbc2 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:04.342546 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4bff6b-32e7-4f4d-9549-e73f8a4c1fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:04.343226 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4bff6b-32e7-4f4d-9549-e73f8a4c1fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:04.343511 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4bff6b-32e7-4f4d-9549-e73f8a4c1fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:04.343782 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4bff6b-32e7-4f4d-9549-e73f8a4c1fc3 None admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:04.344459 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4bff6b-32e7-4f4d-9549-e73f8a4c1fc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:32:04.344764 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4bff6b-32e7-4f4d-9549-e73f8a4c1fc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:04.346169 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4bff6b-32e7-4f4d-9549-e73f8a4c1fc3 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:04.363524 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 533/1080] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:32:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:04.364308 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4bff6b-32e7-4f4d-9549-e73f8a4c1fc3 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:04.387205 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f8d60-8844-4b45-84d7-85960665fde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:04.388107 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f8d60-8844-4b45-84d7-85960665fde4 None admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:04.388424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f8d60-8844-4b45-84d7-85960665fde4 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:04.388898 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f8d60-8844-4b45-84d7-85960665fde4 None admin] PATH_INFO: `/v3/projects/43760eb07e3e4c059a59ed6dc6b83bf3/users/91f974d6343c4f56b4b1e15df7359479/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:04.392677 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8f8d60-8844-4b45-84d7-85960665fde4 None admin] RBAC: Authorizing `identity:create_grant(project_id=43760eb07e3e4c059a59ed6dc6b83bf3, user_id=91f974d6343c4f56b4b1e15df7359479, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:04.394428 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8f8d60-8844-4b45-84d7-85960665fde4 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:04.463071 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 548/1081] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 26 07:32:04 2022] PUT /identity/v3/projects/43760eb07e3e4c059a59ed6dc6b83bf3/users/91f974d6343c4f56b4b1e15df7359479/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:32:04.478847 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:04.537119 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4bff6b-32e7-4f4d-9549-e73f8a4c1fc3 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:04.597507 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459bdac-c0ff-4c1d-bfd4-4dcb9c32bffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:04.600549 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459bdac-c0ff-4c1d-bfd4-4dcb9c32bffe None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:04.600867 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459bdac-c0ff-4c1d-bfd4-4dcb9c32bffe None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:04.601099 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459bdac-c0ff-4c1d-bfd4-4dcb9c32bffe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:04.609901 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6459bdac-c0ff-4c1d-bfd4-4dcb9c32bffe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:04.611484 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6459bdac-c0ff-4c1d-bfd4-4dcb9c32bffe None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:04.625073 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-6459bdac-c0ff-4c1d-bfd4-4dcb9c32bffe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:32:04.625073 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:32:04.625073 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:32:04.625073 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:32:04.625073 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:32:04.625073 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:32:04.625073 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:32:04.625073 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:32:04.625073 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:32:04.625073 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:32:04.625073 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:32:04.625073 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:32:04.625073 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 07:32:04.625073 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 07:32:04.625073 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 07:32:04.626259 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 07:32:04.626259 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:32:04.626259 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:32:04.626259 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:32:04.626259 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:32:04.626259 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:32:04.626259 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:32:04.626259 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:32:04.626259 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:32:04.626259 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:32:04.626259 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:32:04.626259 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:32:04.626259 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:32:04.626259 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:32:04.626259 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:32:04.626259 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:32:04.626259 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:32:04.627268 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 07:32:04.627268 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 07:32:04.627268 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 07:32:04.627268 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 07:32:04.627268 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 07:32:04.627268 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 07:32:04.627268 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:32:04.627268 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:32:04.628660 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 534/1082] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:32:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:32:04.634328 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f8d60-8844-4b45-84d7-85960665fde4 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:04.678129 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:04.769425 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f8d60-8844-4b45-84d7-85960665fde4 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:04.805096 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55d4f9-8f2b-4572-a453-4de3631ec358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:04.805717 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55d4f9-8f2b-4572-a453-4de3631ec358 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:04.805993 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55d4f9-8f2b-4572-a453-4de3631ec358 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:04.806262 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55d4f9-8f2b-4572-a453-4de3631ec358 None admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:04.806961 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b55d4f9-8f2b-4572-a453-4de3631ec358 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:32:04.807292 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b55d4f9-8f2b-4572-a453-4de3631ec358 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:04.808720 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b55d4f9-8f2b-4572-a453-4de3631ec358 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:04.821981 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 549/1083] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 26 07:32:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:04.828607 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459bdac-c0ff-4c1d-bfd4-4dcb9c32bffe None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:04.938107 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459bdac-c0ff-4c1d-bfd4-4dcb9c32bffe None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:04.964608 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:04.977635 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e41e0-1910-40b3-b74d-468ce3064bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:04.978336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e41e0-1910-40b3-b74d-468ce3064bcc None admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:04.978616 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e41e0-1910-40b3-b74d-468ce3064bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:04.978888 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e41e0-1910-40b3-b74d-468ce3064bcc None admin] PATH_INFO: `/v3/projects/becbf57e91454d499dec313ff9eadfae/users/bc92c0a0a2cc4722868e6877bac93ada/roles/dc39243380ac40299d78581303d95252` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:04.981134 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e41e0-1910-40b3-b74d-468ce3064bcc None admin] RBAC: Authorizing `identity:create_grant(project_id=becbf57e91454d499dec313ff9eadfae, user_id=bc92c0a0a2cc4722868e6877bac93ada, role_id=dc39243380ac40299d78581303d95252)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:04.994159 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e41e0-1910-40b3-b74d-468ce3064bcc None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:05.118946 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 535/1084] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 26 07:32:04 2022] PUT /identity/v3/projects/becbf57e91454d499dec313ff9eadfae/users/bc92c0a0a2cc4722868e6877bac93ada/roles/dc39243380ac40299d78581303d95252 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:32:06.477200 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e95f75-3b32-4b19-b87e-75a3b3f56bc5 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:06.477737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e95f75-3b32-4b19-b87e-75a3b3f56bc5 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:06.477737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e95f75-3b32-4b19-b87e-75a3b3f56bc5 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:06.479057 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 550/1085] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:32:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:32:06.485179 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6268a3-77d0-43b7-9cbb-ef9f0eae4c1f None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:06.485705 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6268a3-77d0-43b7-9cbb-ef9f0eae4c1f None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:06.485796 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6268a3-77d0-43b7-9cbb-ef9f0eae4c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:06.504423 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-3e6268a3-77d0-43b7-9cbb-ef9f0eae4c1f None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:32:06.505616 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-3e6268a3-77d0-43b7-9cbb-ef9f0eae4c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:32:06.578769 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 536/1086] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:32:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:32:06.857752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e95f75-3b32-4b19-b87e-75a3b3f56bc5 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:06.962274 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:06.971728 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e95f75-3b32-4b19-b87e-75a3b3f56bc5 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:07.008141 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ce142-eb5c-49e5-b5b8-9fbf27d4419c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:07.008784 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ce142-eb5c-49e5-b5b8-9fbf27d4419c None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:07.009060 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ce142-eb5c-49e5-b5b8-9fbf27d4419c None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:07.009334 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ce142-eb5c-49e5-b5b8-9fbf27d4419c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:07.020648 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ce142-eb5c-49e5-b5b8-9fbf27d4419c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:32:07.025312 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-e31ce142-eb5c-49e5-b5b8-9fbf27d4419c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:32:07.025312 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:32:07.025312 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:32:07.025312 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:32:07.025312 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:32:07.025312 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:32:07.025312 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:32:07.025312 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:32:07.025312 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:32:07.025312 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:32:07.025312 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:32:07.025312 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:32:07.025312 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:32:07.025312 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:32:07.025312 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:32:07.025312 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:32:07.026434 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:32:07.026434 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:32:07.026434 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:32:07.026434 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:32:07.026434 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:32:07.026434 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:32:07.026434 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:32:07.026434 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:32:07.026434 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:32:07.026434 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:32:07.026434 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:32:07.026434 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:32:07.026434 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:32:07.026434 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:32:07.026434 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:32:07.026434 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:32:07.027608 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:32:07.027608 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:32:07.027608 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:32:07.027608 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:32:07.027608 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:32:07.027608 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:32:07.027608 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:32:07.027608 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:32:07.027608 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:32:07.027608 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:32:07.027608 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:32:07.027608 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:32:07.027608 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 551/1087] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 26 07:32:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:32:07.033915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6268a3-77d0-43b7-9cbb-ef9f0eae4c1f None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:07.039998 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b7ee6-d321-432e-a253-c8f6865d8e67 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:07.040312 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b7ee6-d321-432e-a253-c8f6865d8e67 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:07.045392 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b7ee6-d321-432e-a253-c8f6865d8e67 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:07.045392 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 552/1088] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:32:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 07:32:07.048593 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276a179-42ef-4531-900e-72c97cff0652 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:07.048882 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276a179-42ef-4531-900e-72c97cff0652 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:07.049158 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276a179-42ef-4531-900e-72c97cff0652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:07.069161 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-4276a179-42ef-4531-900e-72c97cff0652 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:32:07.070396 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-4276a179-42ef-4531-900e-72c97cff0652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:32:07.142959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6268a3-77d0-43b7-9cbb-ef9f0eae4c1f None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:07.155223 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 553/1089] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:32:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 07:32:07.158495 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:07.179641 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60149479-7dff-4f15-ba8e-11deb3466b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:07.180347 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60149479-7dff-4f15-ba8e-11deb3466b8c None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:07.180623 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60149479-7dff-4f15-ba8e-11deb3466b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:07.180893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60149479-7dff-4f15-ba8e-11deb3466b8c None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:07.181562 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60149479-7dff-4f15-ba8e-11deb3466b8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:32:07.181862 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60149479-7dff-4f15-ba8e-11deb3466b8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:07.183376 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60149479-7dff-4f15-ba8e-11deb3466b8c None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:07.192498 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 537/1090] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:32:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:07.198560 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276a179-42ef-4531-900e-72c97cff0652 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:07.292885 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:07.311198 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276a179-42ef-4531-900e-72c97cff0652 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:07.430175 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60149479-7dff-4f15-ba8e-11deb3466b8c None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:07.467790 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794f9f0-8cb3-4ee6-a61c-16f469030c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:07.468432 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794f9f0-8cb3-4ee6-a61c-16f469030c11 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:07.468708 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794f9f0-8cb3-4ee6-a61c-16f469030c11 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:07.469075 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794f9f0-8cb3-4ee6-a61c-16f469030c11 None admin] PATH_INFO: `/v3/users/91f974d6343c4f56b4b1e15df7359479` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:07.470214 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e794f9f0-8cb3-4ee6-a61c-16f469030c11 None admin] RBAC: Authorizing `identity:get_user(user_id=91f974d6343c4f56b4b1e15df7359479)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:07.471725 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e794f9f0-8cb3-4ee6-a61c-16f469030c11 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:07.473277 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 554/1091] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:32:07 2022] GET /identity/v3/users/91f974d6343c4f56b4b1e15df7359479 => generated 285 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:07.479387 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794f9f0-8cb3-4ee6-a61c-16f469030c11 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:07.542235 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60149479-7dff-4f15-ba8e-11deb3466b8c None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:07.578248 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbd106-0e78-4070-94d0-67e9481305ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:07.578914 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbd106-0e78-4070-94d0-67e9481305ae None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:07.579222 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbd106-0e78-4070-94d0-67e9481305ae None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:07.579491 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbd106-0e78-4070-94d0-67e9481305ae None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:07.586940 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794f9f0-8cb3-4ee6-a61c-16f469030c11 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:07.590903 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebbd106-0e78-4070-94d0-67e9481305ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:32:07.596575 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-8ebbd106-0e78-4070-94d0-67e9481305ae None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 07:32:07.596575 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:32:07.596575 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:32:07.596575 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:32:07.596575 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:32:07.596575 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:32:07.596575 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:32:07.596575 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:32:07.596575 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:32:07.596575 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:32:07.596575 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:32:07.596575 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:32:07.596575 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:32:07.596575 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:32:07.596575 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:32:07.596575 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:32:07.597595 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:32:07.597595 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:32:07.597595 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:32:07.597595 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:32:07.597595 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:32:07.597595 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:32:07.597595 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:32:07.597595 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:32:07.597595 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:32:07.597595 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:32:07.597595 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:32:07.597595 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:32:07.597595 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:32:07.597595 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:32:07.597595 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:32:07.597595 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:32:07.598599 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:32:07.598599 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:32:07.598599 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:32:07.598599 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:32:07.598599 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:32:07.598599 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:32:07.598599 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:32:07.598599 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:32:07.598599 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:32:07.598599 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:32:07.598599 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 07:32:07.598599 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:32:07.598599 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 538/1092] 10.222.0.42 () {56 vars in 1120 bytes} [Fri Aug 26 07:32:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 07:32:07.603702 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbd106-0e78-4070-94d0-67e9481305ae None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:07.625035 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb16bf5-44e5-4160-9929-89f596128f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:07.625647 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb16bf5-44e5-4160-9929-89f596128f04 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:07.625979 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb16bf5-44e5-4160-9929-89f596128f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:07.626251 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb16bf5-44e5-4160-9929-89f596128f04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:07.641323 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:07.646078 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:07.695800 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb16bf5-44e5-4160-9929-89f596128f04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:07.697250 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb16bf5-44e5-4160-9929-89f596128f04 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:07.742015 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbd106-0e78-4070-94d0-67e9481305ae None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:07.789391 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885a872-63a1-41c9-a203-8747c7bdf64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:07.790002 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885a872-63a1-41c9-a203-8747c7bdf64f None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:07.790279 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885a872-63a1-41c9-a203-8747c7bdf64f None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:07.790576 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885a872-63a1-41c9-a203-8747c7bdf64f None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:07.791363 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a885a872-63a1-41c9-a203-8747c7bdf64f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:32:07.791606 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a885a872-63a1-41c9-a203-8747c7bdf64f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:07.792990 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a885a872-63a1-41c9-a203-8747c7bdf64f None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:07.801696 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 539/1093] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Aug 26 07:32:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:32:07.801883 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 555/1094] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:32:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 26 07:32:07.807310 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885a872-63a1-41c9-a203-8747c7bdf64f None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:07.807758 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb16bf5-44e5-4160-9929-89f596128f04 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:07.860148 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:07.909706 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:07.912901 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb16bf5-44e5-4160-9929-89f596128f04 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:07.913487 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885a872-63a1-41c9-a203-8747c7bdf64f None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:07.949306 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973d930-4330-4e53-9f1d-d4dde3914628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:07.949944 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973d930-4330-4e53-9f1d-d4dde3914628 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:07.950218 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973d930-4330-4e53-9f1d-d4dde3914628 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:07.951145 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973d930-4330-4e53-9f1d-d4dde3914628 None admin] PATH_INFO: `/v3/projects/43760eb07e3e4c059a59ed6dc6b83bf3` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:07.952439 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4ab61-ad00-4a90-8036-29706caac9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:07.952588 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973d930-4330-4e53-9f1d-d4dde3914628 None admin] RBAC: Authorizing `identity:get_project(project_id=43760eb07e3e4c059a59ed6dc6b83bf3)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:07.953083 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4ab61-ad00-4a90-8036-29706caac9ab None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:07.953365 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4ab61-ad00-4a90-8036-29706caac9ab None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:07.953640 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4ab61-ad00-4a90-8036-29706caac9ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:07.953863 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973d930-4330-4e53-9f1d-d4dde3914628 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:07.955683 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 556/1095] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:32:07 2022] GET /identity/v3/projects/43760eb07e3e4c059a59ed6dc6b83bf3 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:32:07.961632 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973d930-4330-4e53-9f1d-d4dde3914628 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:07.970815 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e4ab61-ad00-4a90-8036-29706caac9ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:07.972781 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e4ab61-ad00-4a90-8036-29706caac9ab None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:07.991514 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-61e4ab61-ad00-4a90-8036-29706caac9ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:32:07.991514 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:32:07.991514 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:32:07.991514 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:32:07.991514 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:32:07.991514 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:32:07.991514 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:32:07.991514 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:32:07.991514 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:32:07.991514 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:32:07.991514 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:32:07.991514 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:32:07.991514 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:32:07.991514 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:32:07.991514 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:32:07.991514 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:32:07.992578 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:32:07.992578 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:32:07.992578 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:32:07.992578 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:32:07.992578 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:32:07.992578 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:32:07.992578 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:32:07.992578 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:32:07.992578 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:32:07.992578 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:32:07.992578 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:32:07.992578 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:32:07.992578 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:32:07.992578 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:32:07.992578 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:32:07.992578 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:32:07.992578 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:32:07.994021 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:32:07.994021 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:32:07.994021 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:32:07.994021 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 540/1096] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:32:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:32:07.999191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4ab61-ad00-4a90-8036-29706caac9ab None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:08.083476 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973d930-4330-4e53-9f1d-d4dde3914628 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:08.105635 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:08.127440 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d5f80-0697-4944-b19e-59715e88c726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:08.128059 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d5f80-0697-4944-b19e-59715e88c726 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:08.128346 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d5f80-0697-4944-b19e-59715e88c726 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:08.128616 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d5f80-0697-4944-b19e-59715e88c726 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:08.129350 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30d5f80-0697-4944-b19e-59715e88c726 None admin] RBAC: Adding query filter params (role.id=07ed857b2feb472f9fa9e7fe0b08582b, scope.project.id=43760eb07e3e4c059a59ed6dc6b83bf3, user.id=91f974d6343c4f56b4b1e15df7359479) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:32:08.129658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30d5f80-0697-4944-b19e-59715e88c726 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:08.131132 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30d5f80-0697-4944-b19e-59715e88c726 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:08.137197 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4ab61-ad00-4a90-8036-29706caac9ab None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:08.137817 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 557/1097] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:32:07 2022] GET /identity/v3/role_assignments?user.id=91f974d6343c4f56b4b1e15df7359479&scope.project.id=43760eb07e3e4c059a59ed6dc6b83bf3&role.id=07ed857b2feb472f9fa9e7fe0b08582b => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:32:08.176666 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73d2f2-d7bd-46cd-a254-d664d8c50d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:08.177293 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73d2f2-d7bd-46cd-a254-d664d8c50d93 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:08.177573 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73d2f2-d7bd-46cd-a254-d664d8c50d93 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:08.177902 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73d2f2-d7bd-46cd-a254-d664d8c50d93 None admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:08.178508 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e73d2f2-d7bd-46cd-a254-d664d8c50d93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:32:08.178814 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e73d2f2-d7bd-46cd-a254-d664d8c50d93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:08.180252 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e73d2f2-d7bd-46cd-a254-d664d8c50d93 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:08.198402 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 541/1098] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:32:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:08.205511 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d5f80-0697-4944-b19e-59715e88c726 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:08.318141 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d5f80-0697-4944-b19e-59715e88c726 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:08.354700 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2af68-6cf6-4461-9e62-fc29182cde61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:08.355360 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2af68-6cf6-4461-9e62-fc29182cde61 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:08.355638 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2af68-6cf6-4461-9e62-fc29182cde61 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:08.355905 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2af68-6cf6-4461-9e62-fc29182cde61 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:08.364208 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e2af68-6cf6-4461-9e62-fc29182cde61 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:08.365713 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e2af68-6cf6-4461-9e62-fc29182cde61 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:08.381288 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-a3e2af68-6cf6-4461-9e62-fc29182cde61 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 07:32:08.381288 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:32:08.381288 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:32:08.381288 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:32:08.381288 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:32:08.381288 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:32:08.381288 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:32:08.381288 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:32:08.381288 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:32:08.381288 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:32:08.381288 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:32:08.381288 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:32:08.381288 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 07:32:08.381288 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 07:32:08.381288 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 07:32:08.381288 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 07:32:08.382340 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:32:08.382340 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:32:08.382340 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 07:32:08.382340 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:32:08.382340 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 07:32:08.382340 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:32:08.382340 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:32:08.382340 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:32:08.382340 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:32:08.382340 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:32:08.382340 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:32:08.382340 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:32:08.382340 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:32:08.382340 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:32:08.382340 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:32:08.382340 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:32:08.382340 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:32:08.382340 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:32:08.383365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:32:08.383365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:32:08.383365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 07:32:08.383365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 07:32:08.383365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 07:32:08.383365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 07:32:08.383365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 07:32:08.383365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 07:32:08.383365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 07:32:08.383365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:32:08.383365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 558/1099] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Aug 26 07:32:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:32:08.388907 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73d2f2-d7bd-46cd-a254-d664d8c50d93 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:08.402223 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:08.506544 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73d2f2-d7bd-46cd-a254-d664d8c50d93 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:08.547575 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af702ed2-6eec-455e-b5b0-feaa77b6e7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:08.548215 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af702ed2-6eec-455e-b5b0-feaa77b6e7df None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:08.548457 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af702ed2-6eec-455e-b5b0-feaa77b6e7df None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:08.548730 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af702ed2-6eec-455e-b5b0-feaa77b6e7df None admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:08.549467 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af702ed2-6eec-455e-b5b0-feaa77b6e7df None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:32:08.549777 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af702ed2-6eec-455e-b5b0-feaa77b6e7df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:08.551225 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af702ed2-6eec-455e-b5b0-feaa77b6e7df None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:08.570040 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 542/1100] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Aug 26 07:32:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:08.576034 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2af68-6cf6-4461-9e62-fc29182cde61 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:08.621192 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:08.684509 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2af68-6cf6-4461-9e62-fc29182cde61 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:08.724508 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f883a27-89da-46c9-bce3-1d9cdd31176c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:08.725124 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f883a27-89da-46c9-bce3-1d9cdd31176c None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:08.725403 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f883a27-89da-46c9-bce3-1d9cdd31176c None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:08.725676 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f883a27-89da-46c9-bce3-1d9cdd31176c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:08.796038 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f883a27-89da-46c9-bce3-1d9cdd31176c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:08.797499 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f883a27-89da-46c9-bce3-1d9cdd31176c None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:08.838799 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:08.895794 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 559/1101] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:32:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 26 07:32:08.900589 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af702ed2-6eec-455e-b5b0-feaa77b6e7df None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:08.970089 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:09.009257 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af702ed2-6eec-455e-b5b0-feaa77b6e7df None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:09.045636 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afa379-7074-4513-b89f-06813bd0fce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:09.046277 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afa379-7074-4513-b89f-06813bd0fce5 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:09.046556 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afa379-7074-4513-b89f-06813bd0fce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:09.046824 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afa379-7074-4513-b89f-06813bd0fce5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:09.057400 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46afa379-7074-4513-b89f-06813bd0fce5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:09.058863 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46afa379-7074-4513-b89f-06813bd0fce5 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:09.074171 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-46afa379-7074-4513-b89f-06813bd0fce5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:32:09.074171 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:32:09.074171 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:32:09.074171 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:32:09.074171 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:32:09.074171 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:32:09.074171 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:32:09.074171 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:32:09.074171 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:32:09.074171 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:32:09.074171 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:32:09.074171 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:32:09.074171 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:32:09.074171 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:32:09.074171 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:32:09.074171 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:32:09.075326 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:32:09.075326 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:32:09.075326 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:32:09.075326 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:32:09.075326 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:32:09.075326 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:32:09.075326 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:32:09.075326 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:32:09.075326 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:32:09.075326 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:32:09.075326 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:32:09.075326 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:32:09.075326 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:32:09.075326 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:32:09.075326 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:32:09.075326 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:32:09.075326 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:32:09.076502 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:32:09.076502 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:32:09.076502 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:32:09.076502 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 543/1102] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:32:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:32:09.081154 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f883a27-89da-46c9-bce3-1d9cdd31176c None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:09.184944 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f883a27-89da-46c9-bce3-1d9cdd31176c None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:09.223611 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b587b-bf96-4824-b0ce-0e765c8ff36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:09.224140 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b587b-bf96-4824-b0ce-0e765c8ff36f None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:09.224420 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b587b-bf96-4824-b0ce-0e765c8ff36f None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:09.224692 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b587b-bf96-4824-b0ce-0e765c8ff36f None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:09.225341 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b587b-bf96-4824-b0ce-0e765c8ff36f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:32:09.225653 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b587b-bf96-4824-b0ce-0e765c8ff36f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:09.227047 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b587b-bf96-4824-b0ce-0e765c8ff36f None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:09.240582 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 560/1103] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:32:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:09.246254 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afa379-7074-4513-b89f-06813bd0fce5 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:09.356204 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afa379-7074-4513-b89f-06813bd0fce5 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:09.377722 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:09.392323 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3696a0d-bf99-42ea-9fad-76bfc39d2eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:09.392958 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3696a0d-bf99-42ea-9fad-76bfc39d2eb0 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:09.393234 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3696a0d-bf99-42ea-9fad-76bfc39d2eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:09.393506 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3696a0d-bf99-42ea-9fad-76bfc39d2eb0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:09.400363 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3696a0d-bf99-42ea-9fad-76bfc39d2eb0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:09.401824 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3696a0d-bf99-42ea-9fad-76bfc39d2eb0 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:09.413355 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-a3696a0d-bf99-42ea-9fad-76bfc39d2eb0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:32:09.413355 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:32:09.413355 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:32:09.413355 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:32:09.413355 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:32:09.413355 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:32:09.413355 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:32:09.413355 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:32:09.413355 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:32:09.413355 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:32:09.413355 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:32:09.413355 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:32:09.413355 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 07:32:09.413355 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 07:32:09.413355 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 07:32:09.414330 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 07:32:09.414330 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:32:09.414330 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:32:09.414330 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:32:09.414330 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:32:09.414330 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:32:09.414330 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:32:09.414330 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:32:09.414330 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:32:09.414330 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:32:09.414330 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:32:09.414330 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:32:09.414330 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:32:09.414330 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:32:09.414330 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:32:09.414330 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:32:09.414330 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:32:09.415727 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 07:32:09.415727 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 07:32:09.415727 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 07:32:09.415727 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 07:32:09.415727 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 07:32:09.415727 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 07:32:09.415727 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:32:09.415727 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:32:09.415727 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 544/1104] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:32:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:32:09.421027 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b587b-bf96-4824-b0ce-0e765c8ff36f None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:09.424521 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:09.534125 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b587b-bf96-4824-b0ce-0e765c8ff36f None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:09.571512 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af495e7f-0f40-479c-bb7a-c86b418289a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:09.572364 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af495e7f-0f40-479c-bb7a-c86b418289a4 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:09.572539 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af495e7f-0f40-479c-bb7a-c86b418289a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:09.572685 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af495e7f-0f40-479c-bb7a-c86b418289a4 None admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:09.573357 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af495e7f-0f40-479c-bb7a-c86b418289a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:32:09.573661 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af495e7f-0f40-479c-bb7a-c86b418289a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:09.575120 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af495e7f-0f40-479c-bb7a-c86b418289a4 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:09.588125 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 561/1105] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 26 07:32:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:09.595270 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3696a0d-bf99-42ea-9fad-76bfc39d2eb0 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:09.708455 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3696a0d-bf99-42ea-9fad-76bfc39d2eb0 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:09.749388 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccae7b6-eba3-45fb-afcf-95d654e633b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:09.750010 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccae7b6-eba3-45fb-afcf-95d654e633b8 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:09.750288 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccae7b6-eba3-45fb-afcf-95d654e633b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:09.750561 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccae7b6-eba3-45fb-afcf-95d654e633b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:09.751506 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccae7b6-eba3-45fb-afcf-95d654e633b8 None admin] RBAC: Adding query filter params (role.id=dc39243380ac40299d78581303d95252, scope.project.id=becbf57e91454d499dec313ff9eadfae, user.id=bc92c0a0a2cc4722868e6877bac93ada) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:32:09.751775 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccae7b6-eba3-45fb-afcf-95d654e633b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:09.753297 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccae7b6-eba3-45fb-afcf-95d654e633b8 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:09.771334 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 545/1106] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:32:09 2022] GET /identity/v3/role_assignments?user.id=bc92c0a0a2cc4722868e6877bac93ada&scope.project.id=becbf57e91454d499dec313ff9eadfae&role.id=dc39243380ac40299d78581303d95252 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:32:10.142465 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c34cf-6c60-4193-b5d2-68d179bbb98e None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:10.142792 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c34cf-6c60-4193-b5d2-68d179bbb98e None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:10.143034 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c34cf-6c60-4193-b5d2-68d179bbb98e None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:10.144437 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 562/1107] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:32:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:32:10.151750 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405fa6c-7583-4384-bb77-f47d3e1cef8f None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:10.151750 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405fa6c-7583-4384-bb77-f47d3e1cef8f None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:10.151750 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405fa6c-7583-4384-bb77-f47d3e1cef8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:10.171973 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-e405fa6c-7583-4384-bb77-f47d3e1cef8f None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:32:10.173201 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-e405fa6c-7583-4384-bb77-f47d3e1cef8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:32:10.224897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:10.256600 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 546/1108] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:32:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 07:32:10.529556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c34cf-6c60-4193-b5d2-68d179bbb98e None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:10.604412 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:10.647720 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c34cf-6c60-4193-b5d2-68d179bbb98e None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:10.688966 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce1e51-3b62-4ff8-aa15-e0ef6d3a1d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:10.689614 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce1e51-3b62-4ff8-aa15-e0ef6d3a1d88 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:10.689895 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce1e51-3b62-4ff8-aa15-e0ef6d3a1d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:10.690165 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce1e51-3b62-4ff8-aa15-e0ef6d3a1d88 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:10.691335 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce1e51-3b62-4ff8-aa15-e0ef6d3a1d88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:10.692761 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce1e51-3b62-4ff8-aa15-e0ef6d3a1d88 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:10.694909 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 563/1109] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:32:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:32:10.701025 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405fa6c-7583-4384-bb77-f47d3e1cef8f None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:10.803752 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405fa6c-7583-4384-bb77-f47d3e1cef8f None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:10.838261 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17156605-c711-402f-937c-0f6ba06bee83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:10.838867 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17156605-c711-402f-937c-0f6ba06bee83 None admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:10.839184 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17156605-c711-402f-937c-0f6ba06bee83 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:10.839450 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17156605-c711-402f-937c-0f6ba06bee83 None admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:10.840100 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17156605-c711-402f-937c-0f6ba06bee83 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:10.842259 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17156605-c711-402f-937c-0f6ba06bee83 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:10.964458 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 547/1110] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 26 07:32:10 2022] POST /identity/v3/users => generated 286 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:32:12.941875 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12c6c2-ecae-48c7-8b2b-d42f87e87663 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:12.942425 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12c6c2-ecae-48c7-8b2b-d42f87e87663 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:12.942425 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12c6c2-ecae-48c7-8b2b-d42f87e87663 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:12.943750 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 564/1111] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:32:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:32:12.949501 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1f849-87ad-4e0f-aa8c-2c4cefd494b5 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:12.949935 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1f849-87ad-4e0f-aa8c-2c4cefd494b5 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:12.950049 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1f849-87ad-4e0f-aa8c-2c4cefd494b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:12.968857 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-29b1f849-87ad-4e0f-aa8c-2c4cefd494b5 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:32:12.970068 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-29b1f849-87ad-4e0f-aa8c-2c4cefd494b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:32:12.994711 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:13.040213 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 548/1112] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:32:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:32:13.314312 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12c6c2-ecae-48c7-8b2b-d42f87e87663 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:13.417463 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12c6c2-ecae-48c7-8b2b-d42f87e87663 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:13.446725 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:13.452799 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afbee98-dff9-43de-90dd-118b4368af6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:13.453431 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbee98-dff9-43de-90dd-118b4368af6b None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:13.453711 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbee98-dff9-43de-90dd-118b4368af6b None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:13.453991 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbee98-dff9-43de-90dd-118b4368af6b None admin] PATH_INFO: `/v3/roles/865b733dc94e43589d2385826a23e137` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:13.455401 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afbee98-dff9-43de-90dd-118b4368af6b None admin] RBAC: Authorizing `identity:get_role(role_id=865b733dc94e43589d2385826a23e137)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:13.456770 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afbee98-dff9-43de-90dd-118b4368af6b None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:13.458076 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 565/1113] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:32:13 2022] GET /identity/v3/roles/865b733dc94e43589d2385826a23e137 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:13.463945 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1f849-87ad-4e0f-aa8c-2c4cefd494b5 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:13.568681 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1f849-87ad-4e0f-aa8c-2c4cefd494b5 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:13.603536 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc96afe-368b-47f6-92e2-c9b7a60e420f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:13.604175 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc96afe-368b-47f6-92e2-c9b7a60e420f None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:13.604451 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc96afe-368b-47f6-92e2-c9b7a60e420f None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:13.604722 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc96afe-368b-47f6-92e2-c9b7a60e420f None admin] PATH_INFO: `/v3/users/1e7d930c9be141e6a018b1b59d17f4b5` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:13.619629 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc96afe-368b-47f6-92e2-c9b7a60e420f None admin] RBAC: Authorizing `identity:get_user(user_id=1e7d930c9be141e6a018b1b59d17f4b5)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:13.621317 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc96afe-368b-47f6-92e2-c9b7a60e420f None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:13.623485 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 549/1114] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:32:13 2022] GET /identity/v3/users/1e7d930c9be141e6a018b1b59d17f4b5 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:13.630702 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afbee98-dff9-43de-90dd-118b4368af6b None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:13.737811 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afbee98-dff9-43de-90dd-118b4368af6b None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:13.772541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfe627-0a62-4933-81fc-69592dac0417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:13.773157 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfe627-0a62-4933-81fc-69592dac0417 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:13.773431 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfe627-0a62-4933-81fc-69592dac0417 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:13.773700 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfe627-0a62-4933-81fc-69592dac0417 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:13.846304 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:13.849469 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cfe627-0a62-4933-81fc-69592dac0417 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:13.850905 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cfe627-0a62-4933-81fc-69592dac0417 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:13.947982 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 566/1115] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:32:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 07:32:13.954493 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc96afe-368b-47f6-92e2-c9b7a60e420f None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:13.974189 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:14.057111 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc96afe-368b-47f6-92e2-c9b7a60e420f None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:14.092342 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07997a34-0aa5-4ff1-bb80-e9f985313474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:14.092980 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07997a34-0aa5-4ff1-bb80-e9f985313474 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:14.093258 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07997a34-0aa5-4ff1-bb80-e9f985313474 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:14.093535 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07997a34-0aa5-4ff1-bb80-e9f985313474 None admin] PATH_INFO: `/v3/projects/43760eb07e3e4c059a59ed6dc6b83bf3` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:14.094678 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07997a34-0aa5-4ff1-bb80-e9f985313474 None admin] RBAC: Authorizing `identity:get_project(project_id=43760eb07e3e4c059a59ed6dc6b83bf3)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:14.096146 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07997a34-0aa5-4ff1-bb80-e9f985313474 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:14.097843 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 550/1116] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:32:13 2022] GET /identity/v3/projects/43760eb07e3e4c059a59ed6dc6b83bf3 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:14.103993 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfe627-0a62-4933-81fc-69592dac0417 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:14.205704 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:14.211395 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfe627-0a62-4933-81fc-69592dac0417 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:14.246601 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a14b4-fd4f-443b-8aef-9f6a991ad435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:14.247736 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a14b4-fd4f-443b-8aef-9f6a991ad435 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:14.248544 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a14b4-fd4f-443b-8aef-9f6a991ad435 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:14.248824 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a14b4-fd4f-443b-8aef-9f6a991ad435 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:14.249558 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a14b4-fd4f-443b-8aef-9f6a991ad435 None admin] RBAC: Adding query filter params (role.id=865b733dc94e43589d2385826a23e137, scope.project.id=43760eb07e3e4c059a59ed6dc6b83bf3, user.id=1e7d930c9be141e6a018b1b59d17f4b5) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:32:14.249873 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a14b4-fd4f-443b-8aef-9f6a991ad435 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:14.251333 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a14b4-fd4f-443b-8aef-9f6a991ad435 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:14.257036 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 567/1117] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:32:14 2022] GET /identity/v3/role_assignments?user.id=1e7d930c9be141e6a018b1b59d17f4b5&scope.project.id=43760eb07e3e4c059a59ed6dc6b83bf3&role.id=865b733dc94e43589d2385826a23e137 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:16.171653 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb5fa4d-6138-4490-ae3a-0ce625a62d3b None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:16.172192 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb5fa4d-6138-4490-ae3a-0ce625a62d3b None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:16.172192 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb5fa4d-6138-4490-ae3a-0ce625a62d3b None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:16.173529 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 551/1118] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:32:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:32:16.179134 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52332b57-90e7-4846-9ac6-a7d8ebeb0e57 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:16.179607 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52332b57-90e7-4846-9ac6-a7d8ebeb0e57 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:16.179698 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52332b57-90e7-4846-9ac6-a7d8ebeb0e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:16.198028 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-52332b57-90e7-4846-9ac6-a7d8ebeb0e57 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:32:16.199275 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-52332b57-90e7-4846-9ac6-a7d8ebeb0e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:32:16.267979 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 568/1119] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:32:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:32:16.545465 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb5fa4d-6138-4490-ae3a-0ce625a62d3b None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:16.637336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:16.653822 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb5fa4d-6138-4490-ae3a-0ce625a62d3b None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:16.691143 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81def50b-8af7-46d2-8c69-a7aae16a4724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:16.691781 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81def50b-8af7-46d2-8c69-a7aae16a4724 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:16.692062 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81def50b-8af7-46d2-8c69-a7aae16a4724 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:16.692336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81def50b-8af7-46d2-8c69-a7aae16a4724 None admin] PATH_INFO: `/v3/roles/865b733dc94e43589d2385826a23e137` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:16.693775 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81def50b-8af7-46d2-8c69-a7aae16a4724 None admin] RBAC: Authorizing `identity:get_role(role_id=865b733dc94e43589d2385826a23e137)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:16.695518 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81def50b-8af7-46d2-8c69-a7aae16a4724 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:16.696951 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 552/1120] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:32:16 2022] GET /identity/v3/roles/865b733dc94e43589d2385826a23e137 => generated 223 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:16.703833 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52332b57-90e7-4846-9ac6-a7d8ebeb0e57 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:16.799621 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:16.808053 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52332b57-90e7-4846-9ac6-a7d8ebeb0e57 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:16.847770 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c48b1d-bb10-4b5a-8cde-911b025ab781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:16.848412 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c48b1d-bb10-4b5a-8cde-911b025ab781 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:16.848691 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c48b1d-bb10-4b5a-8cde-911b025ab781 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:16.848963 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c48b1d-bb10-4b5a-8cde-911b025ab781 None admin] PATH_INFO: `/v3/users/1e7d930c9be141e6a018b1b59d17f4b5` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:16.850114 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c48b1d-bb10-4b5a-8cde-911b025ab781 None admin] RBAC: Authorizing `identity:get_user(user_id=1e7d930c9be141e6a018b1b59d17f4b5)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:16.851602 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c48b1d-bb10-4b5a-8cde-911b025ab781 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:16.853171 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 569/1121] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:32:16 2022] GET /identity/v3/users/1e7d930c9be141e6a018b1b59d17f4b5 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:16.859408 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81def50b-8af7-46d2-8c69-a7aae16a4724 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:16.969314 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81def50b-8af7-46d2-8c69-a7aae16a4724 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:17.005494 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1179d-d7c8-4bd6-a61a-679fdd528872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:17.006125 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1179d-d7c8-4bd6-a61a-679fdd528872 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:17.006407 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1179d-d7c8-4bd6-a61a-679fdd528872 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:17.006684 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1179d-d7c8-4bd6-a61a-679fdd528872 None admin] PATH_INFO: `/v3/projects/43760eb07e3e4c059a59ed6dc6b83bf3` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:17.007838 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e1179d-d7c8-4bd6-a61a-679fdd528872 None admin] RBAC: Authorizing `identity:get_project(project_id=43760eb07e3e4c059a59ed6dc6b83bf3)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:17.009282 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e1179d-d7c8-4bd6-a61a-679fdd528872 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:17.010938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 553/1122] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:32:16 2022] GET /identity/v3/projects/43760eb07e3e4c059a59ed6dc6b83bf3 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:17.017191 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c48b1d-bb10-4b5a-8cde-911b025ab781 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:17.119844 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c48b1d-bb10-4b5a-8cde-911b025ab781 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:17.155182 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc031c26-2ae8-4a42-8bfc-1e3e6a485b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:17.155849 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc031c26-2ae8-4a42-8bfc-1e3e6a485b06 None admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:17.156130 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc031c26-2ae8-4a42-8bfc-1e3e6a485b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:17.156405 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc031c26-2ae8-4a42-8bfc-1e3e6a485b06 None admin] PATH_INFO: `/v3/projects/43760eb07e3e4c059a59ed6dc6b83bf3/users/1e7d930c9be141e6a018b1b59d17f4b5/roles/865b733dc94e43589d2385826a23e137` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:17.158579 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc031c26-2ae8-4a42-8bfc-1e3e6a485b06 None admin] RBAC: Authorizing `identity:create_grant(project_id=43760eb07e3e4c059a59ed6dc6b83bf3, user_id=1e7d930c9be141e6a018b1b59d17f4b5, role_id=865b733dc94e43589d2385826a23e137)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:17.160042 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc031c26-2ae8-4a42-8bfc-1e3e6a485b06 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:17.244227 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 570/1123] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 26 07:32:17 2022] PUT /identity/v3/projects/43760eb07e3e4c059a59ed6dc6b83bf3/users/1e7d930c9be141e6a018b1b59d17f4b5/roles/865b733dc94e43589d2385826a23e137 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:32:19.202671 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493cd5f-8f6b-483a-8d40-6523d3357414 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:19.203406 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493cd5f-8f6b-483a-8d40-6523d3357414 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:19.203406 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493cd5f-8f6b-483a-8d40-6523d3357414 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:19.204758 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 554/1124] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:32:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:32:19.210551 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ecc7c0-e218-4ef7-b308-84799630adff None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:19.211091 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ecc7c0-e218-4ef7-b308-84799630adff None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:19.211091 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ecc7c0-e218-4ef7-b308-84799630adff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:19.229493 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-a6ecc7c0-e218-4ef7-b308-84799630adff None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:32:19.230678 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-a6ecc7c0-e218-4ef7-b308-84799630adff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:32:19.245424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:19.300371 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 571/1125] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:32:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:32:19.572204 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493cd5f-8f6b-483a-8d40-6523d3357414 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:19.597496 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:19.677439 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493cd5f-8f6b-483a-8d40-6523d3357414 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:19.711485 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ad05f-4b70-4b56-bbc1-5e204e322ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:19.712106 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ad05f-4b70-4b56-bbc1-5e204e322ae7 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:19.712381 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ad05f-4b70-4b56-bbc1-5e204e322ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:19.712650 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ad05f-4b70-4b56-bbc1-5e204e322ae7 None admin] PATH_INFO: `/v3/roles/865b733dc94e43589d2385826a23e137` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:19.714127 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529ad05f-4b70-4b56-bbc1-5e204e322ae7 None admin] RBAC: Authorizing `identity:get_role(role_id=865b733dc94e43589d2385826a23e137)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:19.715525 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529ad05f-4b70-4b56-bbc1-5e204e322ae7 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:19.718037 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 555/1126] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:32:19 2022] GET /identity/v3/roles/865b733dc94e43589d2385826a23e137 => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:19.723909 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ecc7c0-e218-4ef7-b308-84799630adff None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:19.826807 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ecc7c0-e218-4ef7-b308-84799630adff None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:19.861653 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c1b39-9d9e-4eff-82ba-9b7f7c946d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:19.862286 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c1b39-9d9e-4eff-82ba-9b7f7c946d9f None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:19.862563 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c1b39-9d9e-4eff-82ba-9b7f7c946d9f None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:19.862831 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c1b39-9d9e-4eff-82ba-9b7f7c946d9f None admin] PATH_INFO: `/v3/users/1e7d930c9be141e6a018b1b59d17f4b5` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:19.864020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c1b39-9d9e-4eff-82ba-9b7f7c946d9f None admin] RBAC: Authorizing `identity:get_user(user_id=1e7d930c9be141e6a018b1b59d17f4b5)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:19.865453 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c1b39-9d9e-4eff-82ba-9b7f7c946d9f None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:19.867045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 572/1127] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:32:19 2022] GET /identity/v3/users/1e7d930c9be141e6a018b1b59d17f4b5 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:19.873145 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ad05f-4b70-4b56-bbc1-5e204e322ae7 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:19.967227 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:19.976939 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ad05f-4b70-4b56-bbc1-5e204e322ae7 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:20.011165 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed101423-81bf-4ac4-a269-bbfe81ee75fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:20.011816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed101423-81bf-4ac4-a269-bbfe81ee75fb None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:20.012096 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed101423-81bf-4ac4-a269-bbfe81ee75fb None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:20.012370 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed101423-81bf-4ac4-a269-bbfe81ee75fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:20.081933 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed101423-81bf-4ac4-a269-bbfe81ee75fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:20.083316 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed101423-81bf-4ac4-a269-bbfe81ee75fb None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:20.170460 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:20.180467 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 556/1128] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:32:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 07:32:20.187130 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c1b39-9d9e-4eff-82ba-9b7f7c946d9f None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:20.207171 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:20.289549 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c1b39-9d9e-4eff-82ba-9b7f7c946d9f None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:20.324804 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bddf1bd-2d28-45c0-b71e-308ec8b626a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:20.326071 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddf1bd-2d28-45c0-b71e-308ec8b626a4 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:20.326404 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddf1bd-2d28-45c0-b71e-308ec8b626a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:20.326685 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddf1bd-2d28-45c0-b71e-308ec8b626a4 None admin] PATH_INFO: `/v3/projects/43760eb07e3e4c059a59ed6dc6b83bf3` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:20.328546 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bddf1bd-2d28-45c0-b71e-308ec8b626a4 None admin] RBAC: Authorizing `identity:get_project(project_id=43760eb07e3e4c059a59ed6dc6b83bf3)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:20.330645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bddf1bd-2d28-45c0-b71e-308ec8b626a4 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:20.332398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 573/1129] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:32:20 2022] GET /identity/v3/projects/43760eb07e3e4c059a59ed6dc6b83bf3 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:32:20.338857 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed101423-81bf-4ac4-a269-bbfe81ee75fb None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:20.444286 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed101423-81bf-4ac4-a269-bbfe81ee75fb None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:20.479077 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a213be5d-b9cf-4c72-b867-e8e65fe92bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:20.479681 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213be5d-b9cf-4c72-b867-e8e65fe92bcf None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:20.479964 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213be5d-b9cf-4c72-b867-e8e65fe92bcf None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:20.480236 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213be5d-b9cf-4c72-b867-e8e65fe92bcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:20.480957 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a213be5d-b9cf-4c72-b867-e8e65fe92bcf None admin] RBAC: Adding query filter params (role.id=865b733dc94e43589d2385826a23e137, scope.project.id=43760eb07e3e4c059a59ed6dc6b83bf3, user.id=1e7d930c9be141e6a018b1b59d17f4b5) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:32:20.481839 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a213be5d-b9cf-4c72-b867-e8e65fe92bcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:20.483410 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a213be5d-b9cf-4c72-b867-e8e65fe92bcf None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:20.489219 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 557/1130] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:32:20 2022] GET /identity/v3/role_assignments?user.id=1e7d930c9be141e6a018b1b59d17f4b5&scope.project.id=43760eb07e3e4c059a59ed6dc6b83bf3&role.id=865b733dc94e43589d2385826a23e137 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:32:22.440355 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437e545-c18a-4b6c-9624-d8cbfe0f9965 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:22.440927 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437e545-c18a-4b6c-9624-d8cbfe0f9965 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:22.440927 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437e545-c18a-4b6c-9624-d8cbfe0f9965 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:22.442210 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 574/1131] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:32:22.447852 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae650c6-e4b3-4f43-a3bc-3785fb3eca9f None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:22.448319 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae650c6-e4b3-4f43-a3bc-3785fb3eca9f None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:22.448419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae650c6-e4b3-4f43-a3bc-3785fb3eca9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:22.468093 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-fae650c6-e4b3-4f43-a3bc-3785fb3eca9f None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:32:22.469297 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-fae650c6-e4b3-4f43-a3bc-3785fb3eca9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:32:22.520021 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:22.538321 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 558/1132] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:32:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:32:22.821669 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437e545-c18a-4b6c-9624-d8cbfe0f9965 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:22.907602 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:22.923195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437e545-c18a-4b6c-9624-d8cbfe0f9965 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:22.957171 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d1997-e80c-4667-98fe-a8a5a38e0a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:22.957792 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d1997-e80c-4667-98fe-a8a5a38e0a64 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:22.958071 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d1997-e80c-4667-98fe-a8a5a38e0a64 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:22.958342 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d1997-e80c-4667-98fe-a8a5a38e0a64 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:22.959478 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d1997-e80c-4667-98fe-a8a5a38e0a64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:22.960906 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d1997-e80c-4667-98fe-a8a5a38e0a64 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:22.962450 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 575/1133] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:32:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:22.968984 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae650c6-e4b3-4f43-a3bc-3785fb3eca9f None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:23.073179 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae650c6-e4b3-4f43-a3bc-3785fb3eca9f None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:23.106432 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28e89a-e7d1-43ba-bacd-6f2d0d787259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:23.107105 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28e89a-e7d1-43ba-bacd-6f2d0d787259 None admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:23.107391 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28e89a-e7d1-43ba-bacd-6f2d0d787259 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:23.107662 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28e89a-e7d1-43ba-bacd-6f2d0d787259 None admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:23.108312 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28e89a-e7d1-43ba-bacd-6f2d0d787259 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:23.109748 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28e89a-e7d1-43ba-bacd-6f2d0d787259 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:23.217028 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 559/1134] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Aug 26 07:32:22 2022] POST /identity/v3/projects => generated 311 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:32:25.194911 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2498b-65f7-4868-878f-a8bc2ba7ac3b None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:25.195502 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2498b-65f7-4868-878f-a8bc2ba7ac3b None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:25.195502 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2498b-65f7-4868-878f-a8bc2ba7ac3b None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:25.196807 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 576/1135] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:32:25.203121 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7963d-7987-44af-b35e-a178650aa751 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:25.203599 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7963d-7987-44af-b35e-a178650aa751 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:25.203715 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7963d-7987-44af-b35e-a178650aa751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:25.223787 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-e2a7963d-7987-44af-b35e-a178650aa751 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:32:25.224977 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-e2a7963d-7987-44af-b35e-a178650aa751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:32:25.256314 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:25.299015 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 560/1136] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:32:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 07:32:25.594927 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2498b-65f7-4868-878f-a8bc2ba7ac3b None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:25.711879 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2498b-65f7-4868-878f-a8bc2ba7ac3b None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:25.753466 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b591e05f-64db-43f5-8116-5ee3e843148c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:25.754097 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591e05f-64db-43f5-8116-5ee3e843148c None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:25.754375 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591e05f-64db-43f5-8116-5ee3e843148c None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:25.754644 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591e05f-64db-43f5-8116-5ee3e843148c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:25.755793 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b591e05f-64db-43f5-8116-5ee3e843148c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:25.757223 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b591e05f-64db-43f5-8116-5ee3e843148c None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:25.758792 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 577/1137] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:32:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:25.765244 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7963d-7987-44af-b35e-a178650aa751 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:25.873794 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7963d-7987-44af-b35e-a178650aa751 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:25.910423 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ade20-d6b1-47bd-b12d-ab42ea7ca1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:25.911062 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ade20-d6b1-47bd-b12d-ab42ea7ca1e7 None admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:25.911344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ade20-d6b1-47bd-b12d-ab42ea7ca1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:25.911693 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ade20-d6b1-47bd-b12d-ab42ea7ca1e7 None admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:25.912266 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807ade20-d6b1-47bd-b12d-ab42ea7ca1e7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:25.913722 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807ade20-d6b1-47bd-b12d-ab42ea7ca1e7 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:26.026653 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 561/1138] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 26 07:32:25 2022] POST /identity/v3/users => generated 286 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:32:28.017283 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64290875-25e6-41fc-8475-d16e043ab1b3 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:28.017798 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64290875-25e6-41fc-8475-d16e043ab1b3 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:28.017798 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64290875-25e6-41fc-8475-d16e043ab1b3 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:28.019084 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 578/1139] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:32:28.024686 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4978b7-b9b8-46ba-b112-bd594eb549e8 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:28.025162 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4978b7-b9b8-46ba-b112-bd594eb549e8 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:28.025262 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4978b7-b9b8-46ba-b112-bd594eb549e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:28.044665 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-ad4978b7-b9b8-46ba-b112-bd594eb549e8 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:32:28.046011 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-ad4978b7-b9b8-46ba-b112-bd594eb549e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:32:28.063871 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:28.125708 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 562/1140] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:32:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:32:28.397280 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64290875-25e6-41fc-8475-d16e043ab1b3 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:28.422848 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:28.509453 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64290875-25e6-41fc-8475-d16e043ab1b3 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:28.545590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da465aa-7cf6-48ec-8a40-fc691015fbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:28.546212 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da465aa-7cf6-48ec-8a40-fc691015fbb8 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:28.546483 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da465aa-7cf6-48ec-8a40-fc691015fbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:28.546747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da465aa-7cf6-48ec-8a40-fc691015fbb8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:28.556823 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da465aa-7cf6-48ec-8a40-fc691015fbb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:32:28.562171 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-5da465aa-7cf6-48ec-8a40-fc691015fbb8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:32:28.562171 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:32:28.562171 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:32:28.562171 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:32:28.562171 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:32:28.562171 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:32:28.562171 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:32:28.562171 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:32:28.562171 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:32:28.562171 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:32:28.562171 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:32:28.562171 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:32:28.562171 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:32:28.562171 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:32:28.562171 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:32:28.562171 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:32:28.564111 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:32:28.564111 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:32:28.564111 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:32:28.564111 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:32:28.564111 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:32:28.564111 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:32:28.564111 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:32:28.564111 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:32:28.564111 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:32:28.564111 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:32:28.564111 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:32:28.564111 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:32:28.564111 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:32:28.564111 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:32:28.564111 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:32:28.564111 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:32:28.565744 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:32:28.565744 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:32:28.565744 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:32:28.565744 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:32:28.565744 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:32:28.565744 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:32:28.565744 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:32:28.565744 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:32:28.565744 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:32:28.565744 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:32:28.565744 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:32:28.565744 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:32:28.565744 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 579/1141] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 26 07:32:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:32:28.569910 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4978b7-b9b8-46ba-b112-bd594eb549e8 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:28.682034 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4978b7-b9b8-46ba-b112-bd594eb549e8 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:28.718563 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6b705-0a90-43f6-8dfa-b83b58b4ee72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:28.719224 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6b705-0a90-43f6-8dfa-b83b58b4ee72 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:28.719553 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6b705-0a90-43f6-8dfa-b83b58b4ee72 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:28.719778 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6b705-0a90-43f6-8dfa-b83b58b4ee72 None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:28.720464 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6b705-0a90-43f6-8dfa-b83b58b4ee72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:32:28.720769 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6b705-0a90-43f6-8dfa-b83b58b4ee72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:28.722160 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6b705-0a90-43f6-8dfa-b83b58b4ee72 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:28.737624 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 563/1142] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:32:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:28.744248 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da465aa-7cf6-48ec-8a40-fc691015fbb8 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:28.829421 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:28.852565 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da465aa-7cf6-48ec-8a40-fc691015fbb8 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:28.888130 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80761002-6896-4e04-8ca1-d590a4c73011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:28.888762 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80761002-6896-4e04-8ca1-d590a4c73011 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:28.889036 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80761002-6896-4e04-8ca1-d590a4c73011 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:28.889305 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80761002-6896-4e04-8ca1-d590a4c73011 None admin] PATH_INFO: `/v3/users/378b5dfd58624199978e4207ce4adaec` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:28.903055 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80761002-6896-4e04-8ca1-d590a4c73011 None admin] RBAC: Authorizing `identity:get_user(user_id=378b5dfd58624199978e4207ce4adaec)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:28.904513 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80761002-6896-4e04-8ca1-d590a4c73011 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:28.906166 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 580/1143] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:32:28 2022] GET /identity/v3/users/378b5dfd58624199978e4207ce4adaec => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:28.912250 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6b705-0a90-43f6-8dfa-b83b58b4ee72 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:28.931394 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:29.018248 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6b705-0a90-43f6-8dfa-b83b58b4ee72 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:29.053226 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb927026-ac13-4fe3-9909-b1b0d9d87d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:29.053934 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb927026-ac13-4fe3-9909-b1b0d9d87d97 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:29.054103 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb927026-ac13-4fe3-9909-b1b0d9d87d97 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:29.054368 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb927026-ac13-4fe3-9909-b1b0d9d87d97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:29.123889 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb927026-ac13-4fe3-9909-b1b0d9d87d97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:29.125331 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb927026-ac13-4fe3-9909-b1b0d9d87d97 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:29.139849 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:29.225960 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 564/1144] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:32:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 07:32:29.233021 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80761002-6896-4e04-8ca1-d590a4c73011 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:29.333814 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80761002-6896-4e04-8ca1-d590a4c73011 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:29.370126 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f478c1-c4a2-4038-ae6e-78b547965014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:29.370774 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f478c1-c4a2-4038-ae6e-78b547965014 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:29.371061 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f478c1-c4a2-4038-ae6e-78b547965014 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:29.371332 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f478c1-c4a2-4038-ae6e-78b547965014 None admin] PATH_INFO: `/v3/projects/9784581da1d948cdba0314458c84b42e` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:29.372638 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f478c1-c4a2-4038-ae6e-78b547965014 None admin] RBAC: Authorizing `identity:get_project(project_id=9784581da1d948cdba0314458c84b42e)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:29.374073 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f478c1-c4a2-4038-ae6e-78b547965014 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:29.375747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 581/1145] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:32:29 2022] GET /identity/v3/projects/9784581da1d948cdba0314458c84b42e => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:29.382024 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb927026-ac13-4fe3-9909-b1b0d9d87d97 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:29.495982 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb927026-ac13-4fe3-9909-b1b0d9d87d97 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:29.515521 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:29.541344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b111cf-0cfe-4b88-83c9-701b6cc20c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:29.541957 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b111cf-0cfe-4b88-83c9-701b6cc20c18 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:29.542239 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b111cf-0cfe-4b88-83c9-701b6cc20c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:29.542516 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b111cf-0cfe-4b88-83c9-701b6cc20c18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:29.543279 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b111cf-0cfe-4b88-83c9-701b6cc20c18 None admin] RBAC: Adding query filter params (role.id=07ed857b2feb472f9fa9e7fe0b08582b, scope.project.id=9784581da1d948cdba0314458c84b42e, user.id=378b5dfd58624199978e4207ce4adaec) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:32:29.544151 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b111cf-0cfe-4b88-83c9-701b6cc20c18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:29.545824 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b111cf-0cfe-4b88-83c9-701b6cc20c18 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:29.551886 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 565/1146] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:32:29 2022] GET /identity/v3/role_assignments?user.id=378b5dfd58624199978e4207ce4adaec&scope.project.id=9784581da1d948cdba0314458c84b42e&role.id=07ed857b2feb472f9fa9e7fe0b08582b => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:31.499807 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03d53d-bd3b-4025-a5d5-c2cb0d4f3252 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:31.500343 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03d53d-bd3b-4025-a5d5-c2cb0d4f3252 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:31.500343 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03d53d-bd3b-4025-a5d5-c2cb0d4f3252 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:31.501667 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 582/1147] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:32:31.507198 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a6fc1-dfe6-40cb-9e92-fb9b1fc9bf13 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:31.507623 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a6fc1-dfe6-40cb-9e92-fb9b1fc9bf13 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:31.507752 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a6fc1-dfe6-40cb-9e92-fb9b1fc9bf13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:31.525908 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-597a6fc1-dfe6-40cb-9e92-fb9b1fc9bf13 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:32:31.527137 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-597a6fc1-dfe6-40cb-9e92-fb9b1fc9bf13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:32:31.596737 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 566/1148] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:32:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:32:31.866619 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03d53d-bd3b-4025-a5d5-c2cb0d4f3252 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:31.878426 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:31.971610 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03d53d-bd3b-4025-a5d5-c2cb0d4f3252 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:32.005378 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0b00d-848f-4679-bedc-481ca2661901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:32.006005 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0b00d-848f-4679-bedc-481ca2661901 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:32.006285 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0b00d-848f-4679-bedc-481ca2661901 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:32.006551 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0b00d-848f-4679-bedc-481ca2661901 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:32.025096 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e0b00d-848f-4679-bedc-481ca2661901 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:32:32.030462 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-97e0b00d-848f-4679-bedc-481ca2661901 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:32:32.030462 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:32:32.030462 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:32:32.030462 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:32:32.030462 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:32:32.030462 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:32:32.030462 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:32:32.030462 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:32:32.030462 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:32:32.030462 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:32:32.030462 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:32:32.030462 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:32:32.030462 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:32:32.030462 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:32:32.030462 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:32:32.030462 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:32:32.031607 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:32:32.031607 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:32:32.031607 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:32:32.031607 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:32:32.031607 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:32:32.031607 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:32:32.031607 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:32:32.031607 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:32:32.031607 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:32:32.031607 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:32:32.031607 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:32:32.031607 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:32:32.031607 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:32:32.031607 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:32:32.031607 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:32:32.031607 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:32:32.032461 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:32:32.032461 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:32:32.032461 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:32:32.032461 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:32:32.032461 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:32:32.032461 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:32:32.032461 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:32:32.032461 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:32:32.032461 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:32:32.032461 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:32:32.032461 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:32:32.032461 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:32:32.032461 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 583/1149] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 26 07:32:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:32:32.037998 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a6fc1-dfe6-40cb-9e92-fb9b1fc9bf13 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:32.139411 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a6fc1-dfe6-40cb-9e92-fb9b1fc9bf13 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:32.148494 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:32.174194 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0adb4e-d40e-46ef-b971-da3b87cc5ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:32.174810 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0adb4e-d40e-46ef-b971-da3b87cc5ffe None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:32.175123 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0adb4e-d40e-46ef-b971-da3b87cc5ffe None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:32.175401 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0adb4e-d40e-46ef-b971-da3b87cc5ffe None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:32.176077 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0adb4e-d40e-46ef-b971-da3b87cc5ffe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:32:32.176386 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0adb4e-d40e-46ef-b971-da3b87cc5ffe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:32.177776 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0adb4e-d40e-46ef-b971-da3b87cc5ffe None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:32.186430 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 567/1150] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:32:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:32.192388 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0b00d-848f-4679-bedc-481ca2661901 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:32.258423 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:32.291811 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0b00d-848f-4679-bedc-481ca2661901 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:32.325889 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf44003-3c39-4104-9d2d-ae3f97b841ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:32.326519 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf44003-3c39-4104-9d2d-ae3f97b841ab None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:32.326799 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf44003-3c39-4104-9d2d-ae3f97b841ab None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:32.327106 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf44003-3c39-4104-9d2d-ae3f97b841ab None admin] PATH_INFO: `/v3/users/378b5dfd58624199978e4207ce4adaec` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:32.328315 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf44003-3c39-4104-9d2d-ae3f97b841ab None admin] RBAC: Authorizing `identity:get_user(user_id=378b5dfd58624199978e4207ce4adaec)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:32.329718 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf44003-3c39-4104-9d2d-ae3f97b841ab None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:32.331333 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 584/1151] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:32:32 2022] GET /identity/v3/users/378b5dfd58624199978e4207ce4adaec => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:32.337138 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0adb4e-d40e-46ef-b971-da3b87cc5ffe None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:32.439417 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0adb4e-d40e-46ef-b971-da3b87cc5ffe None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:32.472888 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f9862-8fb9-4f43-b5e3-9d7b68c813e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:32.473503 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f9862-8fb9-4f43-b5e3-9d7b68c813e9 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:32.473784 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f9862-8fb9-4f43-b5e3-9d7b68c813e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:32.474051 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f9862-8fb9-4f43-b5e3-9d7b68c813e9 None admin] PATH_INFO: `/v3/projects/9784581da1d948cdba0314458c84b42e` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:32.475175 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888f9862-8fb9-4f43-b5e3-9d7b68c813e9 None admin] RBAC: Authorizing `identity:get_project(project_id=9784581da1d948cdba0314458c84b42e)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:32.476637 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888f9862-8fb9-4f43-b5e3-9d7b68c813e9 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:32.478240 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 568/1152] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:32:32 2022] GET /identity/v3/projects/9784581da1d948cdba0314458c84b42e => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:32.484434 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf44003-3c39-4104-9d2d-ae3f97b841ab None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:32.582767 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf44003-3c39-4104-9d2d-ae3f97b841ab None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:32.616436 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a890c45-879e-44c8-a454-5bdb535844bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:32.617088 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a890c45-879e-44c8-a454-5bdb535844bc None admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:32.617366 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a890c45-879e-44c8-a454-5bdb535844bc None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:32.617638 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a890c45-879e-44c8-a454-5bdb535844bc None admin] PATH_INFO: `/v3/projects/9784581da1d948cdba0314458c84b42e/users/378b5dfd58624199978e4207ce4adaec/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:32.619530 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a890c45-879e-44c8-a454-5bdb535844bc None admin] RBAC: Authorizing `identity:create_grant(project_id=9784581da1d948cdba0314458c84b42e, user_id=378b5dfd58624199978e4207ce4adaec, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:32.620994 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a890c45-879e-44c8-a454-5bdb535844bc None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:32.624776 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:32.747721 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 585/1153] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 26 07:32:32 2022] PUT /identity/v3/projects/9784581da1d948cdba0314458c84b42e/users/378b5dfd58624199978e4207ce4adaec/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:32:34.650882 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe960a9-514b-4a03-b1ce-c355fb9444ee None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:34.651460 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe960a9-514b-4a03-b1ce-c355fb9444ee None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:34.651460 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe960a9-514b-4a03-b1ce-c355fb9444ee None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:34.653570 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 569/1154] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:32:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:32:34.659188 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b1803-5d22-405a-a01f-f54b416b1e48 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:34.659687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b1803-5d22-405a-a01f-f54b416b1e48 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:34.659776 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b1803-5d22-405a-a01f-f54b416b1e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:34.678742 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-0c3b1803-5d22-405a-a01f-f54b416b1e48 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:32:34.679978 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-0c3b1803-5d22-405a-a01f-f54b416b1e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:32:34.754521 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 586/1155] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:32:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:32:35.029224 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe960a9-514b-4a03-b1ce-c355fb9444ee None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:35.078488 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:35.145469 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe960a9-514b-4a03-b1ce-c355fb9444ee None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:35.181630 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd846e13-1662-4667-bdda-b909f2ee63c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:35.182273 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd846e13-1662-4667-bdda-b909f2ee63c3 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:35.182558 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd846e13-1662-4667-bdda-b909f2ee63c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:35.182833 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd846e13-1662-4667-bdda-b909f2ee63c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:35.194751 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd846e13-1662-4667-bdda-b909f2ee63c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:32:35.199850 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-fd846e13-1662-4667-bdda-b909f2ee63c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:32:35.199850 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:32:35.199850 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:32:35.199850 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:32:35.199850 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:32:35.199850 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:32:35.199850 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:32:35.199850 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:32:35.199850 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:32:35.199850 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:32:35.199850 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:32:35.199850 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:32:35.199850 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:32:35.199850 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:32:35.199850 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:32:35.199850 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:32:35.200958 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:32:35.200958 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:32:35.200958 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:32:35.200958 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:32:35.200958 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:32:35.200958 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:32:35.200958 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:32:35.200958 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:32:35.200958 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:32:35.200958 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:32:35.200958 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:32:35.200958 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:32:35.200958 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:32:35.200958 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:32:35.200958 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:32:35.200958 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:32:35.201816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:32:35.201816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:32:35.201816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:32:35.201816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:32:35.201816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:32:35.201816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:32:35.201816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:32:35.201816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:32:35.201816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:32:35.201816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:32:35.201816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:32:35.201816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:32:35.201816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 570/1156] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 26 07:32:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:32:35.207797 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b1803-5d22-405a-a01f-f54b416b1e48 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:35.308509 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b1803-5d22-405a-a01f-f54b416b1e48 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:35.333969 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:35.342928 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64271c-7352-49da-8305-65d80dee0e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:35.343578 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64271c-7352-49da-8305-65d80dee0e84 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:35.343857 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64271c-7352-49da-8305-65d80dee0e84 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:35.344127 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64271c-7352-49da-8305-65d80dee0e84 None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:35.344801 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e64271c-7352-49da-8305-65d80dee0e84 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:32:35.345099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e64271c-7352-49da-8305-65d80dee0e84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:35.346466 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e64271c-7352-49da-8305-65d80dee0e84 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:35.354792 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 587/1157] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:32:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:35.361444 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd846e13-1662-4667-bdda-b909f2ee63c3 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:35.461339 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:35.471172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd846e13-1662-4667-bdda-b909f2ee63c3 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:35.506665 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcacaee1-005e-4135-ae84-0daa2564d49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:35.507650 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacaee1-005e-4135-ae84-0daa2564d49b None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:35.508408 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacaee1-005e-4135-ae84-0daa2564d49b None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:35.508685 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacaee1-005e-4135-ae84-0daa2564d49b None admin] PATH_INFO: `/v3/users/378b5dfd58624199978e4207ce4adaec` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:35.509830 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcacaee1-005e-4135-ae84-0daa2564d49b None admin] RBAC: Authorizing `identity:get_user(user_id=378b5dfd58624199978e4207ce4adaec)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:35.511305 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcacaee1-005e-4135-ae84-0daa2564d49b None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:35.513442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 571/1158] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:32:35 2022] GET /identity/v3/users/378b5dfd58624199978e4207ce4adaec => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:35.519597 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64271c-7352-49da-8305-65d80dee0e84 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:35.622848 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64271c-7352-49da-8305-65d80dee0e84 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:35.657744 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba903a6-ad43-47dc-b2af-c1b7ee78adc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:35.658355 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba903a6-ad43-47dc-b2af-c1b7ee78adc7 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:35.658636 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba903a6-ad43-47dc-b2af-c1b7ee78adc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:35.658906 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba903a6-ad43-47dc-b2af-c1b7ee78adc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:35.721200 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:35.733347 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba903a6-ad43-47dc-b2af-c1b7ee78adc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:35.734783 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba903a6-ad43-47dc-b2af-c1b7ee78adc7 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:35.834603 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 588/1159] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:32:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 07:32:35.840928 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcacaee1-005e-4135-ae84-0daa2564d49b None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:35.945919 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcacaee1-005e-4135-ae84-0daa2564d49b None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:35.980595 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57220727-d046-451c-9041-5e05bd890f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:35.981952 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57220727-d046-451c-9041-5e05bd890f1d None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:35.982231 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57220727-d046-451c-9041-5e05bd890f1d None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:35.982503 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57220727-d046-451c-9041-5e05bd890f1d None admin] PATH_INFO: `/v3/projects/9784581da1d948cdba0314458c84b42e` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:35.983658 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57220727-d046-451c-9041-5e05bd890f1d None admin] RBAC: Authorizing `identity:get_project(project_id=9784581da1d948cdba0314458c84b42e)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:35.985105 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57220727-d046-451c-9041-5e05bd890f1d None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:35.986750 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 572/1160] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:32:35 2022] GET /identity/v3/projects/9784581da1d948cdba0314458c84b42e => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:35.993241 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba903a6-ad43-47dc-b2af-c1b7ee78adc7 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:36.083915 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:36.096226 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba903a6-ad43-47dc-b2af-c1b7ee78adc7 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:36.134272 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb12c3-94fe-43be-99c4-ebc8c647245f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:36.134869 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb12c3-94fe-43be-99c4-ebc8c647245f None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:36.135246 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb12c3-94fe-43be-99c4-ebc8c647245f None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:36.135521 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb12c3-94fe-43be-99c4-ebc8c647245f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:36.136245 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb12c3-94fe-43be-99c4-ebc8c647245f None admin] RBAC: Adding query filter params (role.id=07ed857b2feb472f9fa9e7fe0b08582b, scope.project.id=9784581da1d948cdba0314458c84b42e, user.id=378b5dfd58624199978e4207ce4adaec) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:32:36.136549 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb12c3-94fe-43be-99c4-ebc8c647245f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:36.138057 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb12c3-94fe-43be-99c4-ebc8c647245f None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:36.144331 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 589/1161] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:32:35 2022] GET /identity/v3/role_assignments?user.id=378b5dfd58624199978e4207ce4adaec&scope.project.id=9784581da1d948cdba0314458c84b42e&role.id=07ed857b2feb472f9fa9e7fe0b08582b => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:38.136019 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb89ee7-bbae-4eff-aa52-fd169008fbac None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:38.136555 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb89ee7-bbae-4eff-aa52-fd169008fbac None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:38.136555 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb89ee7-bbae-4eff-aa52-fd169008fbac None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:38.138008 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 573/1162] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:32:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:32:38.143678 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3caad-b8e5-4459-b354-f1da0ab2ca8b None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:38.144160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3caad-b8e5-4459-b354-f1da0ab2ca8b None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:38.144269 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3caad-b8e5-4459-b354-f1da0ab2ca8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:38.162898 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-75b3caad-b8e5-4459-b354-f1da0ab2ca8b None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:32:38.164121 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-75b3caad-b8e5-4459-b354-f1da0ab2ca8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:32:38.234698 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 590/1163] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:32:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:32:38.517867 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb89ee7-bbae-4eff-aa52-fd169008fbac None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:38.555670 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:38.627460 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb89ee7-bbae-4eff-aa52-fd169008fbac None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:38.661692 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c647429-b22c-4bec-b813-5a337f1d1c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:38.662296 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c647429-b22c-4bec-b813-5a337f1d1c4d None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:38.662577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c647429-b22c-4bec-b813-5a337f1d1c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:38.662884 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c647429-b22c-4bec-b813-5a337f1d1c4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:38.730389 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c647429-b22c-4bec-b813-5a337f1d1c4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:38.733013 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c647429-b22c-4bec-b813-5a337f1d1c4d None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:38.768403 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:38.846282 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 574/1164] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:32:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 07:32:38.852185 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b3caad-b8e5-4459-b354-f1da0ab2ca8b None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:38.933319 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:38.951304 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b3caad-b8e5-4459-b354-f1da0ab2ca8b None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:38.987720 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53506b07-7bd1-4c57-9e6e-977893adef23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:38.988350 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53506b07-7bd1-4c57-9e6e-977893adef23 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:38.988619 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53506b07-7bd1-4c57-9e6e-977893adef23 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:38.988883 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53506b07-7bd1-4c57-9e6e-977893adef23 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:38.995791 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53506b07-7bd1-4c57-9e6e-977893adef23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:38.997384 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53506b07-7bd1-4c57-9e6e-977893adef23 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:39.009071 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-53506b07-7bd1-4c57-9e6e-977893adef23 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 26 07:32:39.009071 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:32:39.009071 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 26 07:32:39.009071 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 26 07:32:39.009071 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 07:32:39.009071 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 07:32:39.009071 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 07:32:39.009071 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 07:32:39.009071 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 26 07:32:39.009071 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:32:39.009071 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 07:32:39.009071 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:32:39.009071 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:32:39.009071 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:32:39.009071 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:32:39.009071 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:32:39.009071 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:32:39.010377 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:32:39.010377 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:32:39.010377 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:32:39.010377 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:32:39.010377 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:32:39.010377 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:32:39.010377 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:32:39.010377 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:32:39.010377 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:32:39.010377 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:32:39.010377 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:32:39.010377 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:32:39.010377 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:32:39.010377 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:32:39.010377 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:32:39.010377 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:32:39.011367 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:32:39.011367 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:32:39.011367 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:32:39.011367 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:32:39.011367 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:32:39.011367 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:32:39.011367 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:32:39.011367 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:32:39.011367 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:32:39.011367 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:32:39.011367 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 26 07:32:39.011367 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:32:39.011367 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 26 07:32:39.011367 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:32:39.011367 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 591/1165] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Aug 26 07:32:38 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 07:32:39.016724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c647429-b22c-4bec-b813-5a337f1d1c4d None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:39.116243 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c647429-b22c-4bec-b813-5a337f1d1c4d None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:39.151737 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d81d51-007d-4fc9-9c2f-71e7b7c72776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:39.153198 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d81d51-007d-4fc9-9c2f-71e7b7c72776 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:39.153491 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d81d51-007d-4fc9-9c2f-71e7b7c72776 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:39.153766 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d81d51-007d-4fc9-9c2f-71e7b7c72776 None admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:39.154528 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d81d51-007d-4fc9-9c2f-71e7b7c72776 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:32:39.154832 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d81d51-007d-4fc9-9c2f-71e7b7c72776 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:39.156258 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d81d51-007d-4fc9-9c2f-71e7b7c72776 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:39.157967 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:39.164504 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 575/1166] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Aug 26 07:32:39 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:41.110158 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4b6cc-9672-4c6d-909c-9cbec6f926ea None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:41.110672 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4b6cc-9672-4c6d-909c-9cbec6f926ea None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:41.110672 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4b6cc-9672-4c6d-909c-9cbec6f926ea None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:41.112005 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 592/1167] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:32:41.117605 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20df483-a285-4fee-b3c5-e492c392a2d7 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:41.118062 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20df483-a285-4fee-b3c5-e492c392a2d7 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:41.118158 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20df483-a285-4fee-b3c5-e492c392a2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:41.137396 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-e20df483-a285-4fee-b3c5-e492c392a2d7 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:32:41.138693 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-e20df483-a285-4fee-b3c5-e492c392a2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:32:41.207673 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 576/1168] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:32:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:32:41.499808 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf4b6cc-9672-4c6d-909c-9cbec6f926ea None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:41.619494 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf4b6cc-9672-4c6d-909c-9cbec6f926ea None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:41.659627 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286dcef-0a9f-45e9-a4cd-f2424bf37d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:41.660233 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286dcef-0a9f-45e9-a4cd-f2424bf37d1d None admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:41.660507 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286dcef-0a9f-45e9-a4cd-f2424bf37d1d None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:41.660774 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286dcef-0a9f-45e9-a4cd-f2424bf37d1d None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:41.661436 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0286dcef-0a9f-45e9-a4cd-f2424bf37d1d None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:41.662788 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0286dcef-0a9f-45e9-a4cd-f2424bf37d1d None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:41.741931 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 593/1169] 10.222.0.42 () {60 vars in 1138 bytes} [Fri Aug 26 07:32:41 2022] POST /identity/v3/domains => generated 267 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:32:43.737023 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd9c78-ab5e-4173-a757-7ec92809e49e None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:43.737580 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd9c78-ab5e-4173-a757-7ec92809e49e None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:43.737580 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd9c78-ab5e-4173-a757-7ec92809e49e None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:43.738890 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 577/1170] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:32:43.744094 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40a8ae-cff8-4fb0-902c-27c527432b5f None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:43.744517 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40a8ae-cff8-4fb0-902c-27c527432b5f None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:43.744633 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40a8ae-cff8-4fb0-902c-27c527432b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:43.751561 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:43.764027 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-6d40a8ae-cff8-4fb0-902c-27c527432b5f None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:32:43.765285 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-6d40a8ae-cff8-4fb0-902c-27c527432b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:32:43.835834 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 594/1171] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:32:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:32:44.111695 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd9c78-ab5e-4173-a757-7ec92809e49e None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:44.215589 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd9c78-ab5e-4173-a757-7ec92809e49e None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:44.243302 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:44.251127 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82370fe-6f4a-4c51-bdf1-29bc4803f913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:44.260449 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82370fe-6f4a-4c51-bdf1-29bc4803f913 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:44.260449 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82370fe-6f4a-4c51-bdf1-29bc4803f913 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:44.260449 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82370fe-6f4a-4c51-bdf1-29bc4803f913 None admin] PATH_INFO: `/v3/domains/fd771cb53dc745dd922142532d3201e2` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:44.263159 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82370fe-6f4a-4c51-bdf1-29bc4803f913 None admin] RBAC: Authorizing `identity:get_domain(domain_id=fd771cb53dc745dd922142532d3201e2)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:44.264649 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82370fe-6f4a-4c51-bdf1-29bc4803f913 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:44.266336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 578/1172] 10.222.0.42 () {56 vars in 1183 bytes} [Fri Aug 26 07:32:44 2022] GET /identity/v3/domains/fd771cb53dc745dd922142532d3201e2 => generated 267 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:44.272332 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40a8ae-cff8-4fb0-902c-27c527432b5f None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:44.380053 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40a8ae-cff8-4fb0-902c-27c527432b5f None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:44.410457 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:44.415533 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baa67f4-a744-4c06-8492-255de23b70c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:44.416215 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa67f4-a744-4c06-8492-255de23b70c2 None admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:44.416431 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa67f4-a744-4c06-8492-255de23b70c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:44.416700 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa67f4-a744-4c06-8492-255de23b70c2 None admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:44.417354 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baa67f4-a744-4c06-8492-255de23b70c2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:44.419428 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baa67f4-a744-4c06-8492-255de23b70c2 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:44.502470 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 595/1173] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Aug 26 07:32:44 2022] POST /identity/v3/projects => generated 361 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 07:32:46.489765 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecca94-273f-4394-af3a-31f934fa0f10 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:46.490340 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecca94-273f-4394-af3a-31f934fa0f10 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:46.490340 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecca94-273f-4394-af3a-31f934fa0f10 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:46.491685 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 579/1174] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:32:46.497763 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af729c-4e01-4e60-b62d-a26c8d262c4f None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:46.498239 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af729c-4e01-4e60-b62d-a26c8d262c4f None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:46.498332 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af729c-4e01-4e60-b62d-a26c8d262c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:46.516948 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-43af729c-4e01-4e60-b62d-a26c8d262c4f None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:32:46.518171 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-43af729c-4e01-4e60-b62d-a26c8d262c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:32:46.589330 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 596/1175] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:32:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:32:46.877093 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcecca94-273f-4394-af3a-31f934fa0f10 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:46.991516 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcecca94-273f-4394-af3a-31f934fa0f10 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:47.025834 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1727804d-31db-4ecc-90ea-4e807c220450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:47.026396 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727804d-31db-4ecc-90ea-4e807c220450 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:47.026677 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727804d-31db-4ecc-90ea-4e807c220450 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:47.026949 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727804d-31db-4ecc-90ea-4e807c220450 None admin] PATH_INFO: `/v3/domains/fd771cb53dc745dd922142532d3201e2` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:47.028207 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1727804d-31db-4ecc-90ea-4e807c220450 None admin] RBAC: Authorizing `identity:get_domain(domain_id=fd771cb53dc745dd922142532d3201e2)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:47.029649 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1727804d-31db-4ecc-90ea-4e807c220450 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:47.031269 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 580/1176] 10.222.0.42 () {56 vars in 1183 bytes} [Fri Aug 26 07:32:46 2022] GET /identity/v3/domains/fd771cb53dc745dd922142532d3201e2 => generated 267 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:47.037228 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af729c-4e01-4e60-b62d-a26c8d262c4f None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:47.137284 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af729c-4e01-4e60-b62d-a26c8d262c4f None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:47.154423 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:47.175122 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87197efa-52dc-4dee-9734-05bf64efe09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:47.175732 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87197efa-52dc-4dee-9734-05bf64efe09b None admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:47.176011 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87197efa-52dc-4dee-9734-05bf64efe09b None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:47.176282 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87197efa-52dc-4dee-9734-05bf64efe09b None admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:47.176925 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87197efa-52dc-4dee-9734-05bf64efe09b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:47.178597 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87197efa-52dc-4dee-9734-05bf64efe09b None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:47.279133 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 597/1177] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 26 07:32:47 2022] POST /identity/v3/users => generated 311 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:32:49.328217 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74baccf6-b0d8-48d6-8812-e6e6b2b57f31 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:49.328811 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74baccf6-b0d8-48d6-8812-e6e6b2b57f31 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:49.328811 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74baccf6-b0d8-48d6-8812-e6e6b2b57f31 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:49.330115 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 581/1178] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:32:49.335394 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857e6c2-53a7-40d9-9d0d-b62a594e3a50 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:49.335851 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857e6c2-53a7-40d9-9d0d-b62a594e3a50 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:49.335953 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857e6c2-53a7-40d9-9d0d-b62a594e3a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:49.354930 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-6857e6c2-53a7-40d9-9d0d-b62a594e3a50 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:32:49.356971 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-6857e6c2-53a7-40d9-9d0d-b62a594e3a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:32:49.423743 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 598/1179] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:32:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:32:49.695903 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74baccf6-b0d8-48d6-8812-e6e6b2b57f31 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:49.755411 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:49.800443 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74baccf6-b0d8-48d6-8812-e6e6b2b57f31 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:49.836505 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acbd085-1b79-4ec5-8fb5-ec3c05326629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:49.837130 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbd085-1b79-4ec5-8fb5-ec3c05326629 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:49.837409 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbd085-1b79-4ec5-8fb5-ec3c05326629 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:49.837679 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbd085-1b79-4ec5-8fb5-ec3c05326629 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:49.848618 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acbd085-1b79-4ec5-8fb5-ec3c05326629 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:32:49.853327 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-5acbd085-1b79-4ec5-8fb5-ec3c05326629 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:32:49.853327 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:32:49.853327 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:32:49.853327 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:32:49.853327 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:32:49.853327 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:32:49.853327 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:32:49.853327 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:32:49.853327 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:32:49.853327 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:32:49.853327 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:32:49.853327 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:32:49.853327 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:32:49.853327 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:32:49.853327 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:32:49.853327 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:32:49.854524 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:32:49.854524 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:32:49.854524 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:32:49.854524 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:32:49.854524 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:32:49.854524 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:32:49.854524 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:32:49.854524 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:32:49.854524 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:32:49.854524 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:32:49.854524 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:32:49.854524 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:32:49.854524 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:32:49.854524 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:32:49.854524 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:32:49.854524 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:32:49.855621 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:32:49.855621 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:32:49.855621 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:32:49.855621 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:32:49.855621 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:32:49.855621 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:32:49.855621 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:32:49.855621 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:32:49.855621 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:32:49.855621 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:32:49.855621 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:32:49.855621 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:32:49.859161 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 582/1180] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 26 07:32:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:32:49.860611 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857e6c2-53a7-40d9-9d0d-b62a594e3a50 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:49.958114 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:49.960940 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857e6c2-53a7-40d9-9d0d-b62a594e3a50 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:49.995372 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e3927-10e7-41f0-a106-e858f8d6c642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:49.996026 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e3927-10e7-41f0-a106-e858f8d6c642 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:49.996299 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e3927-10e7-41f0-a106-e858f8d6c642 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:49.996566 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e3927-10e7-41f0-a106-e858f8d6c642 None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:49.997264 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3e3927-10e7-41f0-a106-e858f8d6c642 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:32:49.997561 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3e3927-10e7-41f0-a106-e858f8d6c642 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:49.998928 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3e3927-10e7-41f0-a106-e858f8d6c642 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:50.007309 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 599/1181] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:32:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:50.013861 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acbd085-1b79-4ec5-8fb5-ec3c05326629 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:50.119994 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acbd085-1b79-4ec5-8fb5-ec3c05326629 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:50.138772 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:50.159679 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12032843-09a4-49b6-bc8c-f7d6da3460e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:50.160340 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12032843-09a4-49b6-bc8c-f7d6da3460e0 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:50.160624 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12032843-09a4-49b6-bc8c-f7d6da3460e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:50.160897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12032843-09a4-49b6-bc8c-f7d6da3460e0 None admin] PATH_INFO: `/v3/users/729bf030acf64c3f924516a5bbc5c135` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:50.174946 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12032843-09a4-49b6-bc8c-f7d6da3460e0 None admin] RBAC: Authorizing `identity:get_user(user_id=729bf030acf64c3f924516a5bbc5c135)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:50.178030 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12032843-09a4-49b6-bc8c-f7d6da3460e0 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:50.179239 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 583/1182] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:32:50 2022] GET /identity/v3/users/729bf030acf64c3f924516a5bbc5c135 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:50.185385 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e3927-10e7-41f0-a106-e858f8d6c642 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:50.293841 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e3927-10e7-41f0-a106-e858f8d6c642 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:50.327830 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9cded8-2e1b-4768-96a7-d78752df727a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:50.328431 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cded8-2e1b-4768-96a7-d78752df727a None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:50.329027 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cded8-2e1b-4768-96a7-d78752df727a None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:50.329027 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cded8-2e1b-4768-96a7-d78752df727a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:50.358202 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:50.396895 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9cded8-2e1b-4768-96a7-d78752df727a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:50.398321 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9cded8-2e1b-4768-96a7-d78752df727a None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:50.494072 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 600/1183] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:32:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 07:32:50.500689 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12032843-09a4-49b6-bc8c-f7d6da3460e0 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:50.597708 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12032843-09a4-49b6-bc8c-f7d6da3460e0 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:50.634292 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d68c3f-0a96-42d0-9009-bcabd3fab331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:50.634924 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d68c3f-0a96-42d0-9009-bcabd3fab331 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:50.635228 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d68c3f-0a96-42d0-9009-bcabd3fab331 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:50.635498 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d68c3f-0a96-42d0-9009-bcabd3fab331 None admin] PATH_INFO: `/v3/projects/34c6fc3f421543a6b625f13ba6a2c837` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:50.636951 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d68c3f-0a96-42d0-9009-bcabd3fab331 None admin] RBAC: Authorizing `identity:get_project(project_id=34c6fc3f421543a6b625f13ba6a2c837)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:50.638277 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d68c3f-0a96-42d0-9009-bcabd3fab331 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:50.639931 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 584/1184] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:32:50 2022] GET /identity/v3/projects/34c6fc3f421543a6b625f13ba6a2c837 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:50.646127 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9cded8-2e1b-4768-96a7-d78752df727a None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:50.706597 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:50.746355 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9cded8-2e1b-4768-96a7-d78752df727a None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:50.780017 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b86cd-371e-41d6-bb2d-8f8661db02a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:50.780628 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b86cd-371e-41d6-bb2d-8f8661db02a3 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:50.780902 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b86cd-371e-41d6-bb2d-8f8661db02a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:50.781170 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b86cd-371e-41d6-bb2d-8f8661db02a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:50.781890 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b86cd-371e-41d6-bb2d-8f8661db02a3 None admin] RBAC: Adding query filter params (role.id=07ed857b2feb472f9fa9e7fe0b08582b, scope.project.id=34c6fc3f421543a6b625f13ba6a2c837, user.id=729bf030acf64c3f924516a5bbc5c135) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:32:50.782197 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b86cd-371e-41d6-bb2d-8f8661db02a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:50.783661 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b86cd-371e-41d6-bb2d-8f8661db02a3 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:50.788977 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 601/1185] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:32:50 2022] GET /identity/v3/role_assignments?user.id=729bf030acf64c3f924516a5bbc5c135&scope.project.id=34c6fc3f421543a6b625f13ba6a2c837&role.id=07ed857b2feb472f9fa9e7fe0b08582b => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:52.695683 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5b4ce-172b-44a9-bf1c-dd5139bc9b6a None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:52.696231 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5b4ce-172b-44a9-bf1c-dd5139bc9b6a None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:52.696231 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5b4ce-172b-44a9-bf1c-dd5139bc9b6a None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:52.697535 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 585/1186] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:32:52.703913 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec2781-cbbc-428b-91ae-7535f65dc5bf None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:52.704386 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec2781-cbbc-428b-91ae-7535f65dc5bf None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:52.704477 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec2781-cbbc-428b-91ae-7535f65dc5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:52.723887 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-b6ec2781-cbbc-428b-91ae-7535f65dc5bf None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:32:52.725109 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-b6ec2781-cbbc-428b-91ae-7535f65dc5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:32:52.794463 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 602/1187] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:32:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 07:32:53.079725 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5b4ce-172b-44a9-bf1c-dd5139bc9b6a None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:53.125177 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:53.181878 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5b4ce-172b-44a9-bf1c-dd5139bc9b6a None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:53.216604 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fec3ff-3205-4566-b1a2-7c76f6d1fbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:53.217218 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fec3ff-3205-4566-b1a2-7c76f6d1fbf2 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:53.217493 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fec3ff-3205-4566-b1a2-7c76f6d1fbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:53.217762 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fec3ff-3205-4566-b1a2-7c76f6d1fbf2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:53.227844 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fec3ff-3205-4566-b1a2-7c76f6d1fbf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:32:53.233441 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-d3fec3ff-3205-4566-b1a2-7c76f6d1fbf2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:32:53.233441 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:32:53.233441 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:32:53.233441 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:32:53.233441 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:32:53.233441 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:32:53.233441 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:32:53.233441 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:32:53.233441 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:32:53.233441 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:32:53.233441 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:32:53.233441 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:32:53.233441 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:32:53.233441 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:32:53.233441 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:32:53.233441 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:32:53.234579 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:32:53.234579 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:32:53.234579 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:32:53.234579 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:32:53.234579 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:32:53.234579 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:32:53.234579 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:32:53.234579 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:32:53.234579 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:32:53.234579 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:32:53.234579 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:32:53.234579 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:32:53.234579 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:32:53.234579 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:32:53.234579 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:32:53.234579 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:32:53.235505 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:32:53.235505 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:32:53.235505 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:32:53.235505 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:32:53.235505 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:32:53.235505 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:32:53.235505 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:32:53.235505 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:32:53.235505 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:32:53.235505 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:32:53.235505 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:32:53.235505 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:32:53.235505 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 586/1188] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 26 07:32:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:32:53.240570 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec2781-cbbc-428b-91ae-7535f65dc5bf None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:53.298818 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:53.345324 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec2781-cbbc-428b-91ae-7535f65dc5bf None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:53.378198 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb6384-3d32-4442-967c-4cb94e9d86c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:53.378783 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb6384-3d32-4442-967c-4cb94e9d86c0 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:53.379083 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb6384-3d32-4442-967c-4cb94e9d86c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:53.379354 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb6384-3d32-4442-967c-4cb94e9d86c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:53.380042 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb6384-3d32-4442-967c-4cb94e9d86c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:32:53.380337 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb6384-3d32-4442-967c-4cb94e9d86c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:53.381690 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb6384-3d32-4442-967c-4cb94e9d86c0 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:53.390227 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 603/1189] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:32:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:53.396202 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fec3ff-3205-4566-b1a2-7c76f6d1fbf2 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:53.495358 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fec3ff-3205-4566-b1a2-7c76f6d1fbf2 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:53.497069 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:53.529267 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda07ca-7878-465c-afb3-96e200548ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:53.529880 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda07ca-7878-465c-afb3-96e200548ab1 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:53.530157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda07ca-7878-465c-afb3-96e200548ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:53.530428 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda07ca-7878-465c-afb3-96e200548ab1 None admin] PATH_INFO: `/v3/users/729bf030acf64c3f924516a5bbc5c135` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:53.531547 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bda07ca-7878-465c-afb3-96e200548ab1 None admin] RBAC: Authorizing `identity:get_user(user_id=729bf030acf64c3f924516a5bbc5c135)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:53.533057 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bda07ca-7878-465c-afb3-96e200548ab1 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:53.534619 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 587/1190] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:32:53 2022] GET /identity/v3/users/729bf030acf64c3f924516a5bbc5c135 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:53.540699 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb6384-3d32-4442-967c-4cb94e9d86c0 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:53.640698 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb6384-3d32-4442-967c-4cb94e9d86c0 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:53.657020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:53.674118 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224d894-67db-4049-a248-8670332ac2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:53.674728 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224d894-67db-4049-a248-8670332ac2be None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:53.675022 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224d894-67db-4049-a248-8670332ac2be None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:53.675292 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224d894-67db-4049-a248-8670332ac2be None admin] PATH_INFO: `/v3/projects/34c6fc3f421543a6b625f13ba6a2c837` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:53.685466 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e224d894-67db-4049-a248-8670332ac2be None admin] RBAC: Authorizing `identity:get_project(project_id=34c6fc3f421543a6b625f13ba6a2c837)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:53.687310 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e224d894-67db-4049-a248-8670332ac2be None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:53.689044 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 604/1191] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:32:53 2022] GET /identity/v3/projects/34c6fc3f421543a6b625f13ba6a2c837 => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:53.695441 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda07ca-7878-465c-afb3-96e200548ab1 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:53.798690 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda07ca-7878-465c-afb3-96e200548ab1 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:53.833011 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dea6d3-3e38-42f2-aa4d-5578f0a24a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:53.833661 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dea6d3-3e38-42f2-aa4d-5578f0a24a35 None admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:53.833976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dea6d3-3e38-42f2-aa4d-5578f0a24a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:53.834206 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dea6d3-3e38-42f2-aa4d-5578f0a24a35 None admin] PATH_INFO: `/v3/projects/34c6fc3f421543a6b625f13ba6a2c837/users/729bf030acf64c3f924516a5bbc5c135/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:53.836078 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dea6d3-3e38-42f2-aa4d-5578f0a24a35 None admin] RBAC: Authorizing `identity:create_grant(project_id=34c6fc3f421543a6b625f13ba6a2c837, user_id=729bf030acf64c3f924516a5bbc5c135, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:53.837493 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dea6d3-3e38-42f2-aa4d-5578f0a24a35 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:53.922497 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 588/1192] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 26 07:32:53 2022] PUT /identity/v3/projects/34c6fc3f421543a6b625f13ba6a2c837/users/729bf030acf64c3f924516a5bbc5c135/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:32:55.854140 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4100a76-5893-4bc1-b8b2-6780c1313694 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:55.854695 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4100a76-5893-4bc1-b8b2-6780c1313694 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:55.854695 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4100a76-5893-4bc1-b8b2-6780c1313694 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:55.856179 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 605/1193] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:32:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:32:55.861347 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2fde2-4374-4204-a997-7607c96f63d6 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:55.861755 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2fde2-4374-4204-a997-7607c96f63d6 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:55.861889 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2fde2-4374-4204-a997-7607c96f63d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:55.879913 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-e5b2fde2-4374-4204-a997-7607c96f63d6 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:32:55.881114 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-e5b2fde2-4374-4204-a997-7607c96f63d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:32:55.905296 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:55.947227 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 589/1194] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:32:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:32:56.219266 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4100a76-5893-4bc1-b8b2-6780c1313694 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:56.321004 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4100a76-5893-4bc1-b8b2-6780c1313694 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:56.355372 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57847a0b-76dd-48df-a40f-64f34c027894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:56.355989 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57847a0b-76dd-48df-a40f-64f34c027894 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:56.356261 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57847a0b-76dd-48df-a40f-64f34c027894 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:56.356523 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57847a0b-76dd-48df-a40f-64f34c027894 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:56.366297 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57847a0b-76dd-48df-a40f-64f34c027894 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:32:56.371567 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-57847a0b-76dd-48df-a40f-64f34c027894 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:32:56.371567 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:32:56.371567 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:32:56.371567 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:32:56.371567 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:32:56.371567 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:32:56.371567 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:32:56.371567 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:32:56.371567 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:32:56.371567 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:32:56.371567 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:32:56.371567 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:32:56.371567 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:32:56.371567 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:32:56.371567 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:32:56.371567 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:32:56.372737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:32:56.372737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:32:56.372737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:32:56.372737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:32:56.372737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:32:56.372737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:32:56.372737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:32:56.372737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:32:56.372737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:32:56.372737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:32:56.372737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:32:56.372737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:32:56.372737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:32:56.372737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:32:56.372737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:32:56.372737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:32:56.373923 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:32:56.373923 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:32:56.373923 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:32:56.373923 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:32:56.373923 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:32:56.373923 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:32:56.373923 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:32:56.373923 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:32:56.373923 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:32:56.373923 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:32:56.373923 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:32:56.373923 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:32:56.373923 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 606/1195] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 26 07:32:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:32:56.379884 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2fde2-4374-4204-a997-7607c96f63d6 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:56.482497 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2fde2-4374-4204-a997-7607c96f63d6 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:56.517279 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e3df6-84f5-4798-aa75-6fd956f5b2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:56.517893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e3df6-84f5-4798-aa75-6fd956f5b2d8 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:56.518173 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e3df6-84f5-4798-aa75-6fd956f5b2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:56.518443 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e3df6-84f5-4798-aa75-6fd956f5b2d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:56.519134 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e3df6-84f5-4798-aa75-6fd956f5b2d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:32:56.519438 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e3df6-84f5-4798-aa75-6fd956f5b2d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:56.520815 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e3df6-84f5-4798-aa75-6fd956f5b2d8 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:56.528895 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 590/1196] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:32:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:56.535009 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57847a0b-76dd-48df-a40f-64f34c027894 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:56.588333 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:56.644835 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57847a0b-76dd-48df-a40f-64f34c027894 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:56.681065 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30364d3a-131d-4544-958c-f11596fbf117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:56.681691 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30364d3a-131d-4544-958c-f11596fbf117 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:56.681968 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30364d3a-131d-4544-958c-f11596fbf117 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:56.682243 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30364d3a-131d-4544-958c-f11596fbf117 None admin] PATH_INFO: `/v3/users/729bf030acf64c3f924516a5bbc5c135` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:56.684080 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30364d3a-131d-4544-958c-f11596fbf117 None admin] RBAC: Authorizing `identity:get_user(user_id=729bf030acf64c3f924516a5bbc5c135)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:56.685759 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30364d3a-131d-4544-958c-f11596fbf117 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:56.687392 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 607/1197] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Aug 26 07:32:56 2022] GET /identity/v3/users/729bf030acf64c3f924516a5bbc5c135 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:56.693506 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e3df6-84f5-4798-aa75-6fd956f5b2d8 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:56.720803 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:56.814643 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e3df6-84f5-4798-aa75-6fd956f5b2d8 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:56.850114 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab35737-f8de-4032-b233-34440c924e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:56.850719 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab35737-f8de-4032-b233-34440c924e14 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:56.851021 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab35737-f8de-4032-b233-34440c924e14 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:56.851291 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab35737-f8de-4032-b233-34440c924e14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:56.921648 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab35737-f8de-4032-b233-34440c924e14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:56.923128 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab35737-f8de-4032-b233-34440c924e14 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:56.946144 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:57.023344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 591/1198] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:32:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 07:32:57.033225 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30364d3a-131d-4544-958c-f11596fbf117 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:57.149108 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30364d3a-131d-4544-958c-f11596fbf117 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:57.163825 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:57.184787 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549e7d7-a31e-4584-b39a-e9cb49866c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:57.185422 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549e7d7-a31e-4584-b39a-e9cb49866c1d None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:57.185694 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549e7d7-a31e-4584-b39a-e9cb49866c1d None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:57.185965 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549e7d7-a31e-4584-b39a-e9cb49866c1d None admin] PATH_INFO: `/v3/projects/34c6fc3f421543a6b625f13ba6a2c837` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:57.187129 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549e7d7-a31e-4584-b39a-e9cb49866c1d None admin] RBAC: Authorizing `identity:get_project(project_id=34c6fc3f421543a6b625f13ba6a2c837)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:57.188551 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549e7d7-a31e-4584-b39a-e9cb49866c1d None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:57.190163 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 608/1199] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Aug 26 07:32:57 2022] GET /identity/v3/projects/34c6fc3f421543a6b625f13ba6a2c837 => generated 361 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:32:57.196846 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab35737-f8de-4032-b233-34440c924e14 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:32:57.309320 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab35737-f8de-4032-b233-34440c924e14 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:32:57.333309 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:32:57.345346 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bcecb9-a6a7-4d03-b7ef-c8b2315fbf5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:32:57.347528 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcecb9-a6a7-4d03-b7ef-c8b2315fbf5a None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:32:57.347528 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcecb9-a6a7-4d03-b7ef-c8b2315fbf5a None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:32:57.347528 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcecb9-a6a7-4d03-b7ef-c8b2315fbf5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:32:57.347528 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bcecb9-a6a7-4d03-b7ef-c8b2315fbf5a None admin] RBAC: Adding query filter params (role.id=07ed857b2feb472f9fa9e7fe0b08582b, scope.project.id=34c6fc3f421543a6b625f13ba6a2c837, user.id=729bf030acf64c3f924516a5bbc5c135) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:32:57.347528 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bcecb9-a6a7-4d03-b7ef-c8b2315fbf5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:32:57.348966 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bcecb9-a6a7-4d03-b7ef-c8b2315fbf5a None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:32:57.354792 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 592/1200] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:32:57 2022] GET /identity/v3/role_assignments?user.id=729bf030acf64c3f924516a5bbc5c135&scope.project.id=34c6fc3f421543a6b625f13ba6a2c837&role.id=07ed857b2feb472f9fa9e7fe0b08582b => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:33:07.202940 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=9 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:33:07.367139 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=7 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:18.643121 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690acbb9-3122-4071-b2c1-7effd9921d1e None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:18.643720 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690acbb9-3122-4071-b2c1-7effd9921d1e None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:18.643720 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690acbb9-3122-4071-b2c1-7effd9921d1e None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:18.645000 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 609/1201] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:34:18.650821 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c3c74-d3f2-47db-af0f-81a9c5c9b5b2 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:18.651279 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c3c74-d3f2-47db-af0f-81a9c5c9b5b2 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:18.651375 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c3c74-d3f2-47db-af0f-81a9c5c9b5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:18.670886 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-d57c3c74-d3f2-47db-af0f-81a9c5c9b5b2 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:34:18.672135 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-d57c3c74-d3f2-47db-af0f-81a9c5c9b5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:34:18.744621 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 593/1202] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:34:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:34:19.020380 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690acbb9-3122-4071-b2c1-7effd9921d1e None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:19.139234 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690acbb9-3122-4071-b2c1-7effd9921d1e None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:19.174361 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40127506-d208-46ea-ba81-a039700fd137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:19.175013 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40127506-d208-46ea-ba81-a039700fd137 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:19.175302 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40127506-d208-46ea-ba81-a039700fd137 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:19.175570 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40127506-d208-46ea-ba81-a039700fd137 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:19.186733 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40127506-d208-46ea-ba81-a039700fd137 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:19.191119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40127506-d208-46ea-ba81-a039700fd137 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:19.203981 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-40127506-d208-46ea-ba81-a039700fd137 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:34:19.203981 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:34:19.203981 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:34:19.203981 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:34:19.203981 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:34:19.203981 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:34:19.203981 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:34:19.203981 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:34:19.203981 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:34:19.203981 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:34:19.203981 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:34:19.203981 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:34:19.203981 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:34:19.203981 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:34:19.203981 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:34:19.203981 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:34:19.205827 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:34:19.205827 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:34:19.205827 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:34:19.205827 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:34:19.205827 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:34:19.205827 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:34:19.205827 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:34:19.205827 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:34:19.205827 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:34:19.205827 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:34:19.205827 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:34:19.205827 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:34:19.205827 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:34:19.205827 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:34:19.205827 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:34:19.205827 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:34:19.205827 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:34:19.207226 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:34:19.207226 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:34:19.207226 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:34:19.207226 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 610/1203] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:34:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 07:34:19.211389 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c3c74-d3f2-47db-af0f-81a9c5c9b5b2 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:19.314788 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c3c74-d3f2-47db-af0f-81a9c5c9b5b2 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:19.343482 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:19.349170 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36aa203-23fd-4a62-9bf4-86373e444f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:19.349777 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36aa203-23fd-4a62-9bf4-86373e444f5c None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:19.350057 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36aa203-23fd-4a62-9bf4-86373e444f5c None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:19.350328 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36aa203-23fd-4a62-9bf4-86373e444f5c None admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:19.350967 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36aa203-23fd-4a62-9bf4-86373e444f5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:34:19.351301 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36aa203-23fd-4a62-9bf4-86373e444f5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:19.352864 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36aa203-23fd-4a62-9bf4-86373e444f5c None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:19.366560 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 594/1204] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:34:19.373348 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40127506-d208-46ea-ba81-a039700fd137 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:19.428136 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:19.482654 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40127506-d208-46ea-ba81-a039700fd137 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:19.516724 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc962d1-324b-48be-a4fe-e5ad92de4e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:19.517343 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc962d1-324b-48be-a4fe-e5ad92de4e3a None admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:19.517626 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc962d1-324b-48be-a4fe-e5ad92de4e3a None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:19.518401 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc962d1-324b-48be-a4fe-e5ad92de4e3a None admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:19.519077 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc962d1-324b-48be-a4fe-e5ad92de4e3a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:19.520540 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc962d1-324b-48be-a4fe-e5ad92de4e3a None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:19.624146 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 611/1205] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Aug 26 07:34:19 2022] POST /identity/v3/users => generated 251 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:34:21.634296 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb15e75-ddd2-4ec4-8782-eb4569c9078c None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:21.634898 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb15e75-ddd2-4ec4-8782-eb4569c9078c None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:21.634898 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb15e75-ddd2-4ec4-8782-eb4569c9078c None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:21.636867 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 595/1206] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:34:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:34:21.642425 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8c492-6ad8-4b09-9e05-a584561a939e None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:21.647826 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8c492-6ad8-4b09-9e05-a584561a939e None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:21.647826 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8c492-6ad8-4b09-9e05-a584561a939e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:21.661394 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-b9b8c492-6ad8-4b09-9e05-a584561a939e None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:34:21.662606 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-b9b8c492-6ad8-4b09-9e05-a584561a939e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:34:21.737273 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 612/1207] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:34:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:34:22.009541 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb15e75-ddd2-4ec4-8782-eb4569c9078c None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:22.117368 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb15e75-ddd2-4ec4-8782-eb4569c9078c None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:22.155341 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6292fcb-343e-48c3-8eaf-62f3ed5c57e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:22.155976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6292fcb-343e-48c3-8eaf-62f3ed5c57e0 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:22.156255 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6292fcb-343e-48c3-8eaf-62f3ed5c57e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:22.156529 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6292fcb-343e-48c3-8eaf-62f3ed5c57e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:22.167671 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6292fcb-343e-48c3-8eaf-62f3ed5c57e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:34:22.175438 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-e6292fcb-343e-48c3-8eaf-62f3ed5c57e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 07:34:22.175438 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:34:22.175438 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:34:22.175438 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:34:22.175438 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:34:22.175438 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:34:22.175438 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:34:22.175438 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:34:22.175438 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:34:22.175438 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:34:22.175438 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:34:22.175438 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:34:22.175438 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:34:22.175438 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:34:22.175438 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:34:22.175438 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:34:22.176657 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:34:22.176657 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:34:22.176657 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:34:22.176657 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:34:22.176657 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:34:22.176657 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:34:22.176657 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:34:22.176657 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:34:22.176657 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:34:22.176657 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:34:22.176657 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:34:22.176657 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:34:22.176657 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:34:22.176657 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:34:22.176657 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:34:22.176657 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:34:22.177897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:34:22.177897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:34:22.177897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:34:22.177897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:34:22.177897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:34:22.177897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:34:22.177897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:34:22.177897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:34:22.177897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:34:22.177897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:34:22.177897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 07:34:22.177897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:34:22.179147 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 596/1208] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 26 07:34:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:34:22.187196 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b8c492-6ad8-4b09-9e05-a584561a939e None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:22.233287 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:22.293483 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b8c492-6ad8-4b09-9e05-a584561a939e None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:22.330404 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ece71-2ed2-4fba-abba-3a6a35c34fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:22.331357 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ece71-2ed2-4fba-abba-3a6a35c34fd0 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:22.331357 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ece71-2ed2-4fba-abba-3a6a35c34fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:22.331633 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ece71-2ed2-4fba-abba-3a6a35c34fd0 None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:22.332302 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ece71-2ed2-4fba-abba-3a6a35c34fd0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:34:22.332601 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ece71-2ed2-4fba-abba-3a6a35c34fd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:22.333969 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ece71-2ed2-4fba-abba-3a6a35c34fd0 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:22.342476 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 613/1209] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 26 07:34:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:34:22.348250 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6292fcb-343e-48c3-8eaf-62f3ed5c57e0 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:22.404351 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:22.459902 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6292fcb-343e-48c3-8eaf-62f3ed5c57e0 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:22.500897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1536d64-30c1-413c-9c9f-75eba45e7c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:22.501580 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1536d64-30c1-413c-9c9f-75eba45e7c4f None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:22.501856 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1536d64-30c1-413c-9c9f-75eba45e7c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:22.502125 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1536d64-30c1-413c-9c9f-75eba45e7c4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:22.513190 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1536d64-30c1-413c-9c9f-75eba45e7c4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:22.514635 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1536d64-30c1-413c-9c9f-75eba45e7c4f None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:22.530414 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-b1536d64-30c1-413c-9c9f-75eba45e7c4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:34:22.530414 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:34:22.530414 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:34:22.530414 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:34:22.530414 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:34:22.530414 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:34:22.530414 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:34:22.530414 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:34:22.530414 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:34:22.530414 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:34:22.530414 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:34:22.530414 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:34:22.530414 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:34:22.530414 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:34:22.530414 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:34:22.530414 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:34:22.531783 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:34:22.531783 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:34:22.531783 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:34:22.531783 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:34:22.531783 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:34:22.531783 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:34:22.531783 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:34:22.531783 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:34:22.531783 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:34:22.531783 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:34:22.531783 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:34:22.531783 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:34:22.531783 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:34:22.531783 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:34:22.531783 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:34:22.531783 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:34:22.531783 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:34:22.532906 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:34:22.532906 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:34:22.532906 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:34:22.532906 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 597/1210] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:34:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:34:22.537759 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ece71-2ed2-4fba-abba-3a6a35c34fd0 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:22.641265 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:22.644397 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ece71-2ed2-4fba-abba-3a6a35c34fd0 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:22.680565 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747d06f-8b71-4bb8-9a0b-48c12b5532c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:22.681260 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747d06f-8b71-4bb8-9a0b-48c12b5532c6 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:22.681535 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747d06f-8b71-4bb8-9a0b-48c12b5532c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:22.681804 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747d06f-8b71-4bb8-9a0b-48c12b5532c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:22.682445 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c747d06f-8b71-4bb8-9a0b-48c12b5532c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:34:22.682746 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c747d06f-8b71-4bb8-9a0b-48c12b5532c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:22.684154 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c747d06f-8b71-4bb8-9a0b-48c12b5532c6 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:22.697188 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 614/1211] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:34:22.703568 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1536d64-30c1-413c-9c9f-75eba45e7c4f None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:22.820761 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1536d64-30c1-413c-9c9f-75eba45e7c4f None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:22.822543 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:22.858848 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf8bc8-2d1c-41ce-bed6-40a718e19bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:22.859506 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf8bc8-2d1c-41ce-bed6-40a718e19bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:22.859831 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf8bc8-2d1c-41ce-bed6-40a718e19bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:22.860103 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf8bc8-2d1c-41ce-bed6-40a718e19bb6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:22.867428 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf8bc8-2d1c-41ce-bed6-40a718e19bb6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:22.868955 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf8bc8-2d1c-41ce-bed6-40a718e19bb6 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:22.880703 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-babf8bc8-2d1c-41ce-bed6-40a718e19bb6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 07:34:22.880703 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:34:22.880703 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:34:22.880703 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:34:22.880703 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:34:22.880703 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:34:22.880703 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:34:22.880703 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:34:22.880703 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:34:22.880703 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:34:22.880703 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:34:22.880703 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:34:22.880703 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 07:34:22.880703 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 07:34:22.880703 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 07:34:22.880703 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 07:34:22.889613 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:34:22.889613 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:34:22.889613 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 07:34:22.889613 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:34:22.889613 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 07:34:22.889613 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:34:22.889613 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:34:22.889613 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:34:22.889613 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:34:22.889613 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:34:22.889613 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:34:22.889613 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:34:22.889613 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:34:22.889613 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:34:22.889613 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:34:22.889613 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:34:22.889613 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:34:22.889613 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:34:22.890724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:34:22.890724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:34:22.890724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 07:34:22.890724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 07:34:22.890724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 07:34:22.890724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 07:34:22.890724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 07:34:22.890724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 07:34:22.890724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 07:34:22.890724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:34:22.890724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 598/1212] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:34:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:34:22.891580 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747d06f-8b71-4bb8-9a0b-48c12b5532c6 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:22.999553 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747d06f-8b71-4bb8-9a0b-48c12b5532c6 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:23.034297 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7601d-b93e-481a-89c8-4292e078f07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:23.034911 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7601d-b93e-481a-89c8-4292e078f07a None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:23.035215 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7601d-b93e-481a-89c8-4292e078f07a None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:23.035485 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7601d-b93e-481a-89c8-4292e078f07a None admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:23.036214 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d7601d-b93e-481a-89c8-4292e078f07a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:34:23.036519 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d7601d-b93e-481a-89c8-4292e078f07a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:23.037966 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d7601d-b93e-481a-89c8-4292e078f07a None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:23.057106 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 615/1213] 10.222.0.42 () {56 vars in 1143 bytes} [Fri Aug 26 07:34:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:34:23.062905 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf8bc8-2d1c-41ce-bed6-40a718e19bb6 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:23.171400 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf8bc8-2d1c-41ce-bed6-40a718e19bb6 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:23.205297 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d223b4-c861-4db2-ac1c-f685b9b37678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:23.205912 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d223b4-c861-4db2-ac1c-f685b9b37678 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:23.206193 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d223b4-c861-4db2-ac1c-f685b9b37678 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:23.206469 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d223b4-c861-4db2-ac1c-f685b9b37678 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:23.237252 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:23.275791 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d223b4-c861-4db2-ac1c-f685b9b37678 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:23.277250 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d223b4-c861-4db2-ac1c-f685b9b37678 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:23.377596 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 599/1214] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:34:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 07:34:23.384561 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7601d-b93e-481a-89c8-4292e078f07a None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:23.407761 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:23.495221 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7601d-b93e-481a-89c8-4292e078f07a None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:23.534374 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e002a292-46fb-473f-a353-d9cfd258f4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:23.535036 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002a292-46fb-473f-a353-d9cfd258f4cb None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:23.535319 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002a292-46fb-473f-a353-d9cfd258f4cb None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:23.535730 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002a292-46fb-473f-a353-d9cfd258f4cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:23.546430 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e002a292-46fb-473f-a353-d9cfd258f4cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:23.547919 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e002a292-46fb-473f-a353-d9cfd258f4cb None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:23.564856 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-e002a292-46fb-473f-a353-d9cfd258f4cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:34:23.564856 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:34:23.564856 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:34:23.564856 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:34:23.564856 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:34:23.564856 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:34:23.564856 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:34:23.564856 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:34:23.564856 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:34:23.564856 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:34:23.564856 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:34:23.564856 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:34:23.564856 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:34:23.564856 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:34:23.564856 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:34:23.564856 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:34:23.566079 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:34:23.566079 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:34:23.566079 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:34:23.566079 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:34:23.566079 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:34:23.566079 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:34:23.566079 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:34:23.566079 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:34:23.566079 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:34:23.566079 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:34:23.566079 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:34:23.566079 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:34:23.566079 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:34:23.566079 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:34:23.566079 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:34:23.566079 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:34:23.566079 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:34:23.567394 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:34:23.567394 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:34:23.567394 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:34:23.567394 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 616/1215] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:34:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:34:23.572720 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d223b4-c861-4db2-ac1c-f685b9b37678 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:23.640846 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:23.680925 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d223b4-c861-4db2-ac1c-f685b9b37678 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:23.719181 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3212e44-28d3-4cb9-9f83-59ef595701bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:23.719855 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3212e44-28d3-4cb9-9f83-59ef595701bd None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:23.720072 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3212e44-28d3-4cb9-9f83-59ef595701bd None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:23.720379 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3212e44-28d3-4cb9-9f83-59ef595701bd None admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:23.721019 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3212e44-28d3-4cb9-9f83-59ef595701bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:34:23.721325 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3212e44-28d3-4cb9-9f83-59ef595701bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:23.722707 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3212e44-28d3-4cb9-9f83-59ef595701bd None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:23.735283 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 600/1216] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:34:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:34:23.741187 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e002a292-46fb-473f-a353-d9cfd258f4cb None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:23.816799 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:23.848722 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e002a292-46fb-473f-a353-d9cfd258f4cb None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:23.887269 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae164ba-904b-4f19-be80-caf68cbff5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:23.887907 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae164ba-904b-4f19-be80-caf68cbff5b1 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:23.888183 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae164ba-904b-4f19-be80-caf68cbff5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:23.888451 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae164ba-904b-4f19-be80-caf68cbff5b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:23.895141 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae164ba-904b-4f19-be80-caf68cbff5b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:23.896578 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae164ba-904b-4f19-be80-caf68cbff5b1 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:23.908564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-7ae164ba-904b-4f19-be80-caf68cbff5b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:34:23.908564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:34:23.908564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:34:23.908564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:34:23.908564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:34:23.908564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:34:23.908564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:34:23.908564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:34:23.908564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:34:23.908564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:34:23.908564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:34:23.908564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:34:23.908564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 07:34:23.908564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 07:34:23.908564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 07:34:23.910622 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 07:34:23.910622 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:34:23.910622 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:34:23.910622 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:34:23.910622 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:34:23.910622 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:34:23.910622 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:34:23.910622 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:34:23.910622 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:34:23.910622 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:34:23.910622 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:34:23.910622 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:34:23.910622 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:34:23.910622 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:34:23.910622 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:34:23.910622 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:34:23.910622 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:34:23.912163 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 07:34:23.912163 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 07:34:23.912163 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 07:34:23.912163 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 07:34:23.912163 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 07:34:23.912163 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 07:34:23.912163 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:34:23.912163 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:34:23.912163 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 617/1217] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:34:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:34:23.916677 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3212e44-28d3-4cb9-9f83-59ef595701bd None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:24.027606 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3212e44-28d3-4cb9-9f83-59ef595701bd None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:24.050167 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:24.062812 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75cc4e-9418-466d-b8dd-5d441d9b0f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:24.063496 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75cc4e-9418-466d-b8dd-5d441d9b0f62 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:24.063778 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75cc4e-9418-466d-b8dd-5d441d9b0f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:24.064052 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75cc4e-9418-466d-b8dd-5d441d9b0f62 None admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:24.064754 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75cc4e-9418-466d-b8dd-5d441d9b0f62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:34:24.065058 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75cc4e-9418-466d-b8dd-5d441d9b0f62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:24.066486 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75cc4e-9418-466d-b8dd-5d441d9b0f62 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:24.079777 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 601/1218] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 26 07:34:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:34:24.086861 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae164ba-904b-4f19-be80-caf68cbff5b1 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:24.193207 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae164ba-904b-4f19-be80-caf68cbff5b1 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:24.227278 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:24.234695 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa28df-7a95-43a9-ba18-e1589a53322d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:24.235341 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa28df-7a95-43a9-ba18-e1589a53322d None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:24.235624 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa28df-7a95-43a9-ba18-e1589a53322d None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:24.235896 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa28df-7a95-43a9-ba18-e1589a53322d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:24.236641 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa28df-7a95-43a9-ba18-e1589a53322d None admin] RBAC: Adding query filter params (role.id=aad163eaa5c8447ca5d5a7d5d861395a, scope.project.id=becbf57e91454d499dec313ff9eadfae, user.id=f6c2bc293f1b4daca83e8d6dff66a316) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:34:24.236948 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa28df-7a95-43a9-ba18-e1589a53322d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:24.238438 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa28df-7a95-43a9-ba18-e1589a53322d None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:24.244304 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 618/1219] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:34:24 2022] GET /identity/v3/role_assignments?user.id=f6c2bc293f1b4daca83e8d6dff66a316&scope.project.id=becbf57e91454d499dec313ff9eadfae&role.id=aad163eaa5c8447ca5d5a7d5d861395a => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:34:26.156998 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34a2d5-93a1-4327-a8cb-70842b006326 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:26.157533 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34a2d5-93a1-4327-a8cb-70842b006326 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:26.157533 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34a2d5-93a1-4327-a8cb-70842b006326 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:26.158872 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 602/1220] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:34:26.167479 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f4cce-916a-4b12-89ba-db45f9e5ee8b None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:26.167991 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f4cce-916a-4b12-89ba-db45f9e5ee8b None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:26.168073 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f4cce-916a-4b12-89ba-db45f9e5ee8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:26.187780 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-fc0f4cce-916a-4b12-89ba-db45f9e5ee8b None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:34:26.189001 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-fc0f4cce-916a-4b12-89ba-db45f9e5ee8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:34:26.264107 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 619/1221] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:34:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:34:26.551376 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34a2d5-93a1-4327-a8cb-70842b006326 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:26.667361 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34a2d5-93a1-4327-a8cb-70842b006326 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:26.703234 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814bcfe-c6fd-4f43-b7ca-27298795552d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:26.703866 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814bcfe-c6fd-4f43-b7ca-27298795552d None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:26.704145 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814bcfe-c6fd-4f43-b7ca-27298795552d None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:26.704410 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814bcfe-c6fd-4f43-b7ca-27298795552d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:26.716038 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814bcfe-c6fd-4f43-b7ca-27298795552d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:34:26.720756 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-1814bcfe-c6fd-4f43-b7ca-27298795552d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 07:34:26.720756 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:34:26.720756 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:34:26.720756 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:34:26.720756 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:34:26.720756 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:34:26.720756 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:34:26.720756 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:34:26.720756 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:34:26.720756 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:34:26.720756 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:34:26.720756 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:34:26.720756 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:34:26.720756 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:34:26.720756 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:34:26.720756 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:34:26.721897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:34:26.721897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:34:26.721897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:34:26.721897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:34:26.721897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:34:26.721897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:34:26.721897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:34:26.721897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:34:26.721897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:34:26.721897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:34:26.721897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:34:26.721897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:34:26.721897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:34:26.721897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:34:26.721897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:34:26.721897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:34:26.723196 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:34:26.723196 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:34:26.723196 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:34:26.723196 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:34:26.723196 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:34:26.723196 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:34:26.723196 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:34:26.723196 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:34:26.723196 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:34:26.723196 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:34:26.723196 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 07:34:26.723196 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:34:26.723196 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 603/1222] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 26 07:34:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:34:26.728847 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f4cce-916a-4b12-89ba-db45f9e5ee8b None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:26.842923 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f4cce-916a-4b12-89ba-db45f9e5ee8b None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:26.877442 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:26.888309 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeccb21-c8b1-41c0-9892-966069daeb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:26.888922 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeccb21-c8b1-41c0-9892-966069daeb79 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:26.889197 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeccb21-c8b1-41c0-9892-966069daeb79 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:26.889463 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeccb21-c8b1-41c0-9892-966069daeb79 None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:26.890130 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeccb21-c8b1-41c0-9892-966069daeb79 None admin] RBAC: Adding query filter params (name=service) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:34:26.890457 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeccb21-c8b1-41c0-9892-966069daeb79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:26.891849 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeccb21-c8b1-41c0-9892-966069daeb79 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:26.900603 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 620/1223] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 26 07:34:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:34:26.906422 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814bcfe-c6fd-4f43-b7ca-27298795552d None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:26.952703 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:27.009878 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814bcfe-c6fd-4f43-b7ca-27298795552d None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:27.045546 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26529f-fcd3-4255-a3ca-5bd47aa2c0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:27.046188 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26529f-fcd3-4255-a3ca-5bd47aa2c0db None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:27.046467 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26529f-fcd3-4255-a3ca-5bd47aa2c0db None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:27.046737 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26529f-fcd3-4255-a3ca-5bd47aa2c0db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:27.057094 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c26529f-fcd3-4255-a3ca-5bd47aa2c0db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:27.058558 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c26529f-fcd3-4255-a3ca-5bd47aa2c0db None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:27.073715 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-8c26529f-fcd3-4255-a3ca-5bd47aa2c0db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:34:27.073715 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:34:27.073715 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:34:27.073715 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:34:27.073715 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:34:27.073715 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:34:27.073715 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:34:27.073715 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:34:27.073715 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:34:27.073715 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:34:27.073715 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:34:27.073715 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:34:27.073715 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:34:27.073715 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:34:27.073715 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:34:27.073715 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:34:27.074768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:34:27.074768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:34:27.074768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:34:27.074768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:34:27.074768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:34:27.074768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:34:27.074768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:34:27.074768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:34:27.074768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:34:27.074768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:34:27.074768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:34:27.074768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:34:27.074768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:34:27.074768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:34:27.074768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:34:27.074768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:34:27.074768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:34:27.076169 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:34:27.076169 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:34:27.076169 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:34:27.076169 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 604/1224] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:34:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:34:27.080805 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeccb21-c8b1-41c0-9892-966069daeb79 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:27.221940 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeccb21-c8b1-41c0-9892-966069daeb79 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:27.258272 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba19974-d91b-495c-ad18-241f5b281624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:27.259172 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba19974-d91b-495c-ad18-241f5b281624 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:27.259453 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba19974-d91b-495c-ad18-241f5b281624 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:27.259723 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba19974-d91b-495c-ad18-241f5b281624 None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:27.260368 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba19974-d91b-495c-ad18-241f5b281624 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:34:27.260667 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba19974-d91b-495c-ad18-241f5b281624 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:27.262047 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba19974-d91b-495c-ad18-241f5b281624 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:27.275396 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 621/1225] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:34:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:34:27.281249 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26529f-fcd3-4255-a3ca-5bd47aa2c0db None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:27.377863 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:27.385223 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26529f-fcd3-4255-a3ca-5bd47aa2c0db None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:27.419774 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409798de-7199-4469-bdac-9835bd74738e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:27.420406 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409798de-7199-4469-bdac-9835bd74738e None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:27.420685 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409798de-7199-4469-bdac-9835bd74738e None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:27.420956 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409798de-7199-4469-bdac-9835bd74738e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:27.428036 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409798de-7199-4469-bdac-9835bd74738e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:27.430008 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409798de-7199-4469-bdac-9835bd74738e None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:27.442395 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-409798de-7199-4469-bdac-9835bd74738e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 07:34:27.442395 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:34:27.442395 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:34:27.442395 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:34:27.442395 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:34:27.442395 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:34:27.442395 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:34:27.442395 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:34:27.442395 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:34:27.442395 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:34:27.442395 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:34:27.442395 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:34:27.442395 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 07:34:27.442395 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 07:34:27.442395 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 07:34:27.442395 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 07:34:27.443598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:34:27.443598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:34:27.443598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 07:34:27.443598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:34:27.443598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 07:34:27.443598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:34:27.443598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:34:27.443598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:34:27.443598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:34:27.443598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:34:27.443598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:34:27.443598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:34:27.443598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:34:27.443598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:34:27.443598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:34:27.443598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:34:27.443598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:34:27.443598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:34:27.444602 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:34:27.444602 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:34:27.444602 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 07:34:27.444602 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 07:34:27.444602 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 07:34:27.444602 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 07:34:27.444602 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 07:34:27.444602 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 07:34:27.444602 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 07:34:27.444602 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:34:27.444602 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 605/1226] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:34:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 07:34:27.451045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba19974-d91b-495c-ad18-241f5b281624 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:27.507273 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:27.561513 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba19974-d91b-495c-ad18-241f5b281624 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:27.595419 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82aba14-a65d-4f41-bf68-f3416fbe1aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:27.596022 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82aba14-a65d-4f41-bf68-f3416fbe1aea None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:27.596296 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82aba14-a65d-4f41-bf68-f3416fbe1aea None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:27.596562 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82aba14-a65d-4f41-bf68-f3416fbe1aea None admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:27.597287 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82aba14-a65d-4f41-bf68-f3416fbe1aea None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:34:27.597587 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82aba14-a65d-4f41-bf68-f3416fbe1aea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:27.599054 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82aba14-a65d-4f41-bf68-f3416fbe1aea None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:27.618682 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 622/1227] 10.222.0.42 () {56 vars in 1143 bytes} [Fri Aug 26 07:34:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:34:27.624901 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409798de-7199-4469-bdac-9835bd74738e None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:27.730711 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409798de-7199-4469-bdac-9835bd74738e None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:27.766433 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec352486-bc98-4af1-ae3a-c38c976072f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:27.767099 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec352486-bc98-4af1-ae3a-c38c976072f2 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:27.767377 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec352486-bc98-4af1-ae3a-c38c976072f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:27.767642 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec352486-bc98-4af1-ae3a-c38c976072f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:27.779040 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec352486-bc98-4af1-ae3a-c38c976072f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:27.780489 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec352486-bc98-4af1-ae3a-c38c976072f2 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:27.796377 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-ec352486-bc98-4af1-ae3a-c38c976072f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:34:27.796377 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:34:27.796377 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:34:27.796377 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:34:27.796377 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:34:27.796377 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:34:27.796377 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:34:27.796377 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:34:27.796377 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:34:27.796377 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:34:27.796377 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:34:27.796377 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:34:27.796377 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:34:27.796377 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:34:27.796377 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:34:27.796377 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:34:27.797568 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:34:27.797568 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:34:27.797568 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:34:27.797568 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:34:27.797568 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:34:27.797568 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:34:27.797568 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:34:27.797568 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:34:27.797568 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:34:27.797568 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:34:27.797568 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:34:27.797568 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:34:27.797568 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:34:27.797568 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:34:27.797568 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:34:27.797568 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:34:27.797568 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:34:27.798474 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:34:27.798474 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:34:27.798474 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:34:27.798474 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 606/1228] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:34:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:34:27.803532 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82aba14-a65d-4f41-bf68-f3416fbe1aea None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:27.911341 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82aba14-a65d-4f41-bf68-f3416fbe1aea None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:27.914847 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:27.948275 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67058d3e-7163-48ec-9533-f07ae90cb8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:27.948902 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67058d3e-7163-48ec-9533-f07ae90cb8c7 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:27.949183 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67058d3e-7163-48ec-9533-f07ae90cb8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:27.949457 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67058d3e-7163-48ec-9533-f07ae90cb8c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:27.950115 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67058d3e-7163-48ec-9533-f07ae90cb8c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:34:27.950422 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67058d3e-7163-48ec-9533-f07ae90cb8c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:27.951897 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67058d3e-7163-48ec-9533-f07ae90cb8c7 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:27.964569 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 623/1229] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:34:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:34:27.970378 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec352486-bc98-4af1-ae3a-c38c976072f2 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:27.981165 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:28.078546 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec352486-bc98-4af1-ae3a-c38c976072f2 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:28.113066 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5ed77-689d-4a0a-aa12-c7798c2d17b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:28.113686 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5ed77-689d-4a0a-aa12-c7798c2d17b4 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:28.113963 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5ed77-689d-4a0a-aa12-c7798c2d17b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:28.114231 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5ed77-689d-4a0a-aa12-c7798c2d17b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:28.121875 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5ed77-689d-4a0a-aa12-c7798c2d17b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:28.123381 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5ed77-689d-4a0a-aa12-c7798c2d17b4 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:28.136503 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-e5a5ed77-689d-4a0a-aa12-c7798c2d17b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:34:28.136503 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:34:28.136503 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:34:28.136503 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:34:28.136503 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:34:28.136503 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:34:28.136503 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:34:28.136503 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:34:28.136503 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:34:28.136503 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:34:28.136503 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:34:28.136503 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:34:28.136503 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 07:34:28.136503 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 07:34:28.136503 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 07:34:28.137677 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 07:34:28.137677 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:34:28.137677 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:34:28.137677 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:34:28.137677 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:34:28.137677 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:34:28.137677 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:34:28.137677 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:34:28.137677 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:34:28.137677 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:34:28.137677 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:34:28.137677 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:34:28.137677 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:34:28.137677 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:34:28.137677 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:34:28.137677 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:34:28.137677 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:34:28.138780 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 07:34:28.138780 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 07:34:28.138780 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 07:34:28.138780 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 07:34:28.138780 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 07:34:28.138780 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 07:34:28.138780 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:34:28.138780 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:34:28.139350 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 607/1230] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:34:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:34:28.145174 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67058d3e-7163-48ec-9533-f07ae90cb8c7 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:28.252568 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67058d3e-7163-48ec-9533-f07ae90cb8c7 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:28.290717 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a733a3-b2b1-46a9-b838-afb25d9a1c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:28.291372 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a733a3-b2b1-46a9-b838-afb25d9a1c50 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:28.291653 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a733a3-b2b1-46a9-b838-afb25d9a1c50 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:28.291930 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a733a3-b2b1-46a9-b838-afb25d9a1c50 None admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:28.292627 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a733a3-b2b1-46a9-b838-afb25d9a1c50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:34:28.293522 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a733a3-b2b1-46a9-b838-afb25d9a1c50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:28.294963 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a733a3-b2b1-46a9-b838-afb25d9a1c50 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:28.307545 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 624/1231] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 26 07:34:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:34:28.313679 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5ed77-689d-4a0a-aa12-c7798c2d17b4 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:28.380583 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:28.416859 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5ed77-689d-4a0a-aa12-c7798c2d17b4 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:28.450133 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51cc33b-e51d-4fce-8751-bb2c91679f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:28.450850 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51cc33b-e51d-4fce-8751-bb2c91679f2e None admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:28.451165 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51cc33b-e51d-4fce-8751-bb2c91679f2e None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:28.451445 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51cc33b-e51d-4fce-8751-bb2c91679f2e None admin] PATH_INFO: `/v3/projects/becbf57e91454d499dec313ff9eadfae/users/f6c2bc293f1b4daca83e8d6dff66a316/roles/aad163eaa5c8447ca5d5a7d5d861395a` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:28.466151 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51cc33b-e51d-4fce-8751-bb2c91679f2e None admin] RBAC: Authorizing `identity:create_grant(project_id=becbf57e91454d499dec313ff9eadfae, user_id=f6c2bc293f1b4daca83e8d6dff66a316, role_id=aad163eaa5c8447ca5d5a7d5d861395a)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:28.467629 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51cc33b-e51d-4fce-8751-bb2c91679f2e None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:28.595050 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 608/1232] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 26 07:34:28 2022] PUT /identity/v3/projects/becbf57e91454d499dec313ff9eadfae/users/f6c2bc293f1b4daca83e8d6dff66a316/roles/aad163eaa5c8447ca5d5a7d5d861395a => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:34:30.540018 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1c02c-b9a6-446f-9694-9b9a5326051b None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:30.540586 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1c02c-b9a6-446f-9694-9b9a5326051b None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:30.540586 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1c02c-b9a6-446f-9694-9b9a5326051b None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:30.541951 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 625/1233] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:34:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 07:34:30.547672 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a3f1a-dc83-4502-a2b2-e03d7cb65783 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:30.548140 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a3f1a-dc83-4502-a2b2-e03d7cb65783 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:30.548241 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a3f1a-dc83-4502-a2b2-e03d7cb65783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:30.566659 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-213a3f1a-dc83-4502-a2b2-e03d7cb65783 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:34:30.567884 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-213a3f1a-dc83-4502-a2b2-e03d7cb65783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:34:30.638298 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 609/1234] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:34:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:34:30.910889 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1c02c-b9a6-446f-9694-9b9a5326051b None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:30.937323 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:31.022696 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1c02c-b9a6-446f-9694-9b9a5326051b None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:31.060587 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04860de7-b977-4c62-a4f2-657155007c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:31.061221 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04860de7-b977-4c62-a4f2-657155007c60 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:31.061499 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04860de7-b977-4c62-a4f2-657155007c60 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:31.061769 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04860de7-b977-4c62-a4f2-657155007c60 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:31.073469 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04860de7-b977-4c62-a4f2-657155007c60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:34:31.078420 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-04860de7-b977-4c62-a4f2-657155007c60 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 07:34:31.078420 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:34:31.078420 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:34:31.078420 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:34:31.078420 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:34:31.078420 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:34:31.078420 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:34:31.078420 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:34:31.078420 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:34:31.078420 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:34:31.078420 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:34:31.078420 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:34:31.078420 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:34:31.078420 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:34:31.078420 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:34:31.078420 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:34:31.079609 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:34:31.079609 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:34:31.079609 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:34:31.079609 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:34:31.079609 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:34:31.079609 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:34:31.079609 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:34:31.079609 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:34:31.079609 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:34:31.079609 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:34:31.079609 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:34:31.079609 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:34:31.079609 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:34:31.079609 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:34:31.079609 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:34:31.079609 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:34:31.080552 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:34:31.080552 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:34:31.080552 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:34:31.080552 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:34:31.080552 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:34:31.080552 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:34:31.080552 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:34:31.080552 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:34:31.080552 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:34:31.080552 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:34:31.080552 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 07:34:31.080552 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:34:31.080552 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 626/1235] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Aug 26 07:34:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:34:31.086296 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a3f1a-dc83-4502-a2b2-e03d7cb65783 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:31.140294 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:31.197040 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a3f1a-dc83-4502-a2b2-e03d7cb65783 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:31.232418 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d5fe53-c27f-469f-b1b0-38a9e15782b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:31.233025 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5fe53-c27f-469f-b1b0-38a9e15782b0 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:31.233302 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5fe53-c27f-469f-b1b0-38a9e15782b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:31.233571 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5fe53-c27f-469f-b1b0-38a9e15782b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:31.234396 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d5fe53-c27f-469f-b1b0-38a9e15782b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:34:31.234697 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d5fe53-c27f-469f-b1b0-38a9e15782b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:31.236093 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d5fe53-c27f-469f-b1b0-38a9e15782b0 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:31.245023 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 610/1236] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Aug 26 07:34:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:34:31.250996 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04860de7-b977-4c62-a4f2-657155007c60 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:31.336960 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:31.352643 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04860de7-b977-4c62-a4f2-657155007c60 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:31.388060 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf8ec1-01b3-4041-b450-0e859646c30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:31.389289 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf8ec1-01b3-4041-b450-0e859646c30c None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:31.389289 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf8ec1-01b3-4041-b450-0e859646c30c None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:31.389289 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf8ec1-01b3-4041-b450-0e859646c30c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:31.399059 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf8ec1-01b3-4041-b450-0e859646c30c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:31.400525 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf8ec1-01b3-4041-b450-0e859646c30c None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:31.415807 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-b3cf8ec1-01b3-4041-b450-0e859646c30c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:34:31.415807 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:34:31.415807 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:34:31.415807 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:34:31.415807 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:34:31.415807 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:34:31.415807 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:34:31.415807 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:34:31.415807 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:34:31.415807 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:34:31.415807 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:34:31.415807 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:34:31.415807 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:34:31.415807 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:34:31.415807 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:34:31.415807 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:34:31.416989 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:34:31.416989 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:34:31.416989 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:34:31.416989 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:34:31.416989 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:34:31.416989 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:34:31.416989 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:34:31.416989 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:34:31.416989 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:34:31.416989 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:34:31.416989 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:34:31.416989 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:34:31.416989 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:34:31.416989 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:34:31.416989 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:34:31.416989 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:34:31.416989 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:34:31.418218 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:34:31.418218 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:34:31.418218 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:34:31.418218 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 627/1237] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:34:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:34:31.422797 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d5fe53-c27f-469f-b1b0-38a9e15782b0 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:31.531406 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d5fe53-c27f-469f-b1b0-38a9e15782b0 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:31.541086 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:31.566578 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15868311-d152-4cc5-a632-4d47af60279a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:31.567293 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15868311-d152-4cc5-a632-4d47af60279a None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:31.567586 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15868311-d152-4cc5-a632-4d47af60279a None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:31.567808 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15868311-d152-4cc5-a632-4d47af60279a None admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:31.568488 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15868311-d152-4cc5-a632-4d47af60279a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:34:31.568794 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15868311-d152-4cc5-a632-4d47af60279a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:31.570271 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15868311-d152-4cc5-a632-4d47af60279a None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:31.584222 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 611/1238] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:34:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:34:31.591954 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf8ec1-01b3-4041-b450-0e859646c30c None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:31.696543 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf8ec1-01b3-4041-b450-0e859646c30c None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:31.731649 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a780fe-02c5-4955-9afe-7d45fec23844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:31.732311 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a780fe-02c5-4955-9afe-7d45fec23844 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:31.732584 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a780fe-02c5-4955-9afe-7d45fec23844 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:31.732851 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a780fe-02c5-4955-9afe-7d45fec23844 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:31.735625 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:31.741103 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a780fe-02c5-4955-9afe-7d45fec23844 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:31.743295 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a780fe-02c5-4955-9afe-7d45fec23844 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:31.754045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-03a780fe-02c5-4955-9afe-7d45fec23844 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 07:34:31.754045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:34:31.754045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:34:31.754045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:34:31.754045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:34:31.754045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:34:31.754045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:34:31.754045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:34:31.754045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:34:31.754045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:34:31.754045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:34:31.754045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:34:31.754045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 07:34:31.754045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 07:34:31.754045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 07:34:31.754045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 07:34:31.755195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:34:31.755195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:34:31.755195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 07:34:31.755195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:34:31.755195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 07:34:31.755195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:34:31.755195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:34:31.755195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:34:31.755195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:34:31.755195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:34:31.755195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:34:31.755195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:34:31.755195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:34:31.755195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:34:31.755195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:34:31.755195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:34:31.755195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:34:31.755195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:34:31.756366 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:34:31.756366 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:34:31.756366 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 07:34:31.756366 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 07:34:31.756366 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 07:34:31.756366 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 07:34:31.756366 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 07:34:31.756366 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 07:34:31.756366 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 07:34:31.756366 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:34:31.756366 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 628/1239] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:34:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:34:31.761204 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15868311-d152-4cc5-a632-4d47af60279a None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:31.864807 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15868311-d152-4cc5-a632-4d47af60279a None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:31.901039 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee6164-7fb4-4963-8927-9cf28f0781dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:31.901659 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee6164-7fb4-4963-8927-9cf28f0781dd None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:31.901942 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee6164-7fb4-4963-8927-9cf28f0781dd None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:31.902215 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee6164-7fb4-4963-8927-9cf28f0781dd None admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:31.902959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee6164-7fb4-4963-8927-9cf28f0781dd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:34:31.903309 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee6164-7fb4-4963-8927-9cf28f0781dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:31.904742 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee6164-7fb4-4963-8927-9cf28f0781dd None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:31.924550 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 612/1240] 10.222.0.42 () {56 vars in 1143 bytes} [Fri Aug 26 07:34:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:34:31.931308 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a780fe-02c5-4955-9afe-7d45fec23844 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:32.036493 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a780fe-02c5-4955-9afe-7d45fec23844 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:32.073403 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc5987-4936-4224-b481-dc13426ddef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:32.074013 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc5987-4936-4224-b481-dc13426ddef1 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:32.074291 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc5987-4936-4224-b481-dc13426ddef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:32.074562 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc5987-4936-4224-b481-dc13426ddef1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:32.138139 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:32.144468 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc5987-4936-4224-b481-dc13426ddef1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:32.151121 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc5987-4936-4224-b481-dc13426ddef1 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:32.246731 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 629/1241] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:34:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 07:34:32.252610 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee6164-7fb4-4963-8927-9cf28f0781dd None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:32.282099 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:32.362672 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee6164-7fb4-4963-8927-9cf28f0781dd None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:32.409932 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e90b83-41d9-4284-8fe8-c953d5e43a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:32.410483 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e90b83-41d9-4284-8fe8-c953d5e43a3a None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:32.410761 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e90b83-41d9-4284-8fe8-c953d5e43a3a None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:32.411061 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e90b83-41d9-4284-8fe8-c953d5e43a3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:32.423379 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e90b83-41d9-4284-8fe8-c953d5e43a3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:32.425819 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e90b83-41d9-4284-8fe8-c953d5e43a3a None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:32.441053 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-89e90b83-41d9-4284-8fe8-c953d5e43a3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:34:32.441053 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:34:32.441053 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:34:32.441053 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:34:32.441053 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:34:32.441053 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:34:32.441053 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:34:32.441053 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:34:32.441053 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:34:32.441053 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:34:32.441053 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:34:32.441053 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:34:32.441053 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:34:32.441053 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:34:32.441053 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:34:32.441053 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:34:32.442251 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:34:32.442251 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:34:32.442251 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:34:32.442251 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:34:32.442251 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:34:32.442251 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:34:32.442251 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:34:32.442251 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:34:32.442251 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:34:32.442251 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:34:32.442251 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:34:32.442251 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:34:32.442251 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:34:32.442251 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:34:32.442251 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:34:32.442251 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:34:32.442251 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:34:32.448334 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:34:32.448334 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:34:32.448334 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:34:32.448334 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 613/1242] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:34:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:34:32.449102 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc5987-4936-4224-b481-dc13426ddef1 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:32.556392 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:32.562458 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc5987-4936-4224-b481-dc13426ddef1 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:32.597003 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc3624-9801-4c50-852c-5913771ac4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:32.597679 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc3624-9801-4c50-852c-5913771ac4ad None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:32.597860 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc3624-9801-4c50-852c-5913771ac4ad None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:32.598129 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc3624-9801-4c50-852c-5913771ac4ad None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:32.598776 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bc3624-9801-4c50-852c-5913771ac4ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:34:32.599100 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bc3624-9801-4c50-852c-5913771ac4ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:32.600451 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bc3624-9801-4c50-852c-5913771ac4ad None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:32.612619 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 630/1243] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:34:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:34:32.619693 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e90b83-41d9-4284-8fe8-c953d5e43a3a None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:32.703338 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:32.725441 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e90b83-41d9-4284-8fe8-c953d5e43a3a None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:32.761069 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e73878-7ea2-4ff7-8d3e-80f0204e4ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:32.761709 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e73878-7ea2-4ff7-8d3e-80f0204e4ea5 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:32.761995 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e73878-7ea2-4ff7-8d3e-80f0204e4ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:32.762268 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e73878-7ea2-4ff7-8d3e-80f0204e4ea5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:32.771392 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e73878-7ea2-4ff7-8d3e-80f0204e4ea5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:32.776474 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e73878-7ea2-4ff7-8d3e-80f0204e4ea5 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:32.785793 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-66e73878-7ea2-4ff7-8d3e-80f0204e4ea5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:34:32.785793 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:34:32.785793 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:34:32.785793 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:34:32.785793 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:34:32.785793 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:34:32.785793 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:34:32.785793 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:34:32.785793 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:34:32.785793 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:34:32.785793 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:34:32.785793 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:34:32.785793 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 07:34:32.785793 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 07:34:32.785793 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 07:34:32.786966 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 07:34:32.786966 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:34:32.786966 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:34:32.786966 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:34:32.786966 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:34:32.786966 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:34:32.786966 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:34:32.786966 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:34:32.786966 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:34:32.786966 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:34:32.786966 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:34:32.786966 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:34:32.786966 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:34:32.786966 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:34:32.786966 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:34:32.786966 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:34:32.786966 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:34:32.792236 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 07:34:32.792236 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 07:34:32.792236 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 07:34:32.792236 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 07:34:32.792236 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 07:34:32.792236 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 07:34:32.792236 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:34:32.792236 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:34:32.792236 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 614/1244] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:34:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:34:32.794294 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc3624-9801-4c50-852c-5913771ac4ad None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:32.897334 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc3624-9801-4c50-852c-5913771ac4ad None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:32.932114 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd95d2-985f-4cf1-9c13-2c6188677f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:32.932710 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd95d2-985f-4cf1-9c13-2c6188677f58 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:32.932985 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd95d2-985f-4cf1-9c13-2c6188677f58 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:32.933257 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd95d2-985f-4cf1-9c13-2c6188677f58 None admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:32.933947 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd95d2-985f-4cf1-9c13-2c6188677f58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:34:32.934248 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd95d2-985f-4cf1-9c13-2c6188677f58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:32.935698 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd95d2-985f-4cf1-9c13-2c6188677f58 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:32.948440 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 631/1245] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 26 07:34:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:34:32.954742 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e73878-7ea2-4ff7-8d3e-80f0204e4ea5 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:33.060758 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e73878-7ea2-4ff7-8d3e-80f0204e4ea5 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:33.095935 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7612d79-940f-4531-8786-fbb00b2886e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:33.096558 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7612d79-940f-4531-8786-fbb00b2886e1 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:33.096834 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7612d79-940f-4531-8786-fbb00b2886e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:33.097101 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7612d79-940f-4531-8786-fbb00b2886e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:33.097834 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7612d79-940f-4531-8786-fbb00b2886e1 None admin] RBAC: Adding query filter params (role.id=aad163eaa5c8447ca5d5a7d5d861395a, scope.project.id=becbf57e91454d499dec313ff9eadfae, user.id=f6c2bc293f1b4daca83e8d6dff66a316) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:34:33.098137 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7612d79-940f-4531-8786-fbb00b2886e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:33.099605 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7612d79-940f-4531-8786-fbb00b2886e1 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:33.105968 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 615/1246] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:34:32 2022] GET /identity/v3/role_assignments?user.id=f6c2bc293f1b4daca83e8d6dff66a316&scope.project.id=becbf57e91454d499dec313ff9eadfae&role.id=aad163eaa5c8447ca5d5a7d5d861395a => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:34:35.115355 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ee477-f4c3-47fc-9b76-1ee9d53575d6 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:35.115893 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ee477-f4c3-47fc-9b76-1ee9d53575d6 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:35.115893 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ee477-f4c3-47fc-9b76-1ee9d53575d6 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:35.118351 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 632/1247] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:34:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:34:35.123922 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa9e5f-98b8-4cf1-9094-39e52bc0d6e5 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:35.156092 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa9e5f-98b8-4cf1-9094-39e52bc0d6e5 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:35.156092 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa9e5f-98b8-4cf1-9094-39e52bc0d6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:35.156092 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:35.156092 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-72aa9e5f-98b8-4cf1-9094-39e52bc0d6e5 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:34:35.156092 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-72aa9e5f-98b8-4cf1-9094-39e52bc0d6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:34:35.218060 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 616/1248] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:34:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:34:35.497283 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ee477-f4c3-47fc-9b76-1ee9d53575d6 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:35.518227 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:35.603548 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ee477-f4c3-47fc-9b76-1ee9d53575d6 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:35.637555 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96a698-36ff-4802-9dde-2950662d8f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:35.641230 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96a698-36ff-4802-9dde-2950662d8f80 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:35.641230 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96a698-36ff-4802-9dde-2950662d8f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:35.641230 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96a698-36ff-4802-9dde-2950662d8f80 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:35.649257 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d96a698-36ff-4802-9dde-2950662d8f80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:34:35.654101 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-0d96a698-36ff-4802-9dde-2950662d8f80 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:34:35.654101 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:34:35.654101 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:34:35.654101 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:34:35.654101 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:34:35.654101 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:34:35.654101 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:34:35.654101 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:34:35.654101 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:34:35.654101 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:34:35.654101 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:34:35.654101 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:34:35.654101 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:34:35.654101 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:34:35.654101 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:34:35.654101 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:34:35.655228 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:34:35.655228 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:34:35.655228 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:34:35.655228 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:34:35.655228 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:34:35.655228 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:34:35.655228 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:34:35.655228 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:34:35.655228 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:34:35.655228 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:34:35.655228 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:34:35.655228 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:34:35.655228 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:34:35.655228 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:34:35.655228 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:34:35.655228 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:34:35.656462 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:34:35.656462 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:34:35.656462 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:34:35.656462 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:34:35.656462 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:34:35.656462 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:34:35.656462 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:34:35.656462 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:34:35.656462 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:34:35.656462 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:34:35.656462 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:34:35.656462 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:34:35.656462 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 633/1249] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 26 07:34:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 07:34:35.661256 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa9e5f-98b8-4cf1-9094-39e52bc0d6e5 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:35.761028 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa9e5f-98b8-4cf1-9094-39e52bc0d6e5 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:35.790369 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:35.796020 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793657df-3426-470b-98ad-d275529b824d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:35.796657 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793657df-3426-470b-98ad-d275529b824d None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:35.796938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793657df-3426-470b-98ad-d275529b824d None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:35.797209 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793657df-3426-470b-98ad-d275529b824d None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:35.797897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793657df-3426-470b-98ad-d275529b824d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:34:35.798221 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793657df-3426-470b-98ad-d275529b824d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:35.799616 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793657df-3426-470b-98ad-d275529b824d None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:35.808302 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 617/1250] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:34:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:34:35.814169 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96a698-36ff-4802-9dde-2950662d8f80 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:35.893343 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:35.916061 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96a698-36ff-4802-9dde-2950662d8f80 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:35.949778 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09c413-20ad-4788-9f35-330d03fb8f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:35.950397 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09c413-20ad-4788-9f35-330d03fb8f14 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:35.950675 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09c413-20ad-4788-9f35-330d03fb8f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:35.950940 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09c413-20ad-4788-9f35-330d03fb8f14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:35.965164 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09c413-20ad-4788-9f35-330d03fb8f14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:35.966636 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09c413-20ad-4788-9f35-330d03fb8f14 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:35.980438 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-3a09c413-20ad-4788-9f35-330d03fb8f14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:34:35.980438 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:34:35.980438 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:34:35.980438 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:34:35.980438 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:34:35.980438 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:34:35.980438 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:34:35.980438 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:34:35.980438 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:34:35.980438 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:34:35.980438 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:34:35.980438 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:34:35.980438 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:34:35.980438 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:34:35.980438 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:34:35.980438 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:34:35.981556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:34:35.981556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:34:35.981556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:34:35.981556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:34:35.981556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:34:35.981556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:34:35.981556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:34:35.981556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:34:35.981556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:34:35.981556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:34:35.981556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:34:35.981556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:34:35.981556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:34:35.981556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:34:35.981556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:34:35.981556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:34:35.981556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:34:35.982667 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:34:35.982667 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:34:35.982667 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:34:35.982667 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 634/1251] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:34:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:34:35.987575 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793657df-3426-470b-98ad-d275529b824d None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:36.090664 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793657df-3426-470b-98ad-d275529b824d None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:36.124043 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b649afc4-4a1c-413b-9afb-ebef8c5ca9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:36.124677 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b649afc4-4a1c-413b-9afb-ebef8c5ca9c6 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:36.124909 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b649afc4-4a1c-413b-9afb-ebef8c5ca9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:36.125179 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b649afc4-4a1c-413b-9afb-ebef8c5ca9c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:36.125845 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b649afc4-4a1c-413b-9afb-ebef8c5ca9c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:34:36.126152 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b649afc4-4a1c-413b-9afb-ebef8c5ca9c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:36.127631 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b649afc4-4a1c-413b-9afb-ebef8c5ca9c6 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:36.138890 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 618/1252] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:34:36.144587 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09c413-20ad-4788-9f35-330d03fb8f14 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:36.244107 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09c413-20ad-4788-9f35-330d03fb8f14 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:36.269710 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:36.277284 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f8fdc-1773-4944-b9a0-259c971a748f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:36.277904 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f8fdc-1773-4944-b9a0-259c971a748f None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:36.278179 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f8fdc-1773-4944-b9a0-259c971a748f None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:36.278447 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f8fdc-1773-4944-b9a0-259c971a748f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:36.285591 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f8fdc-1773-4944-b9a0-259c971a748f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:36.287113 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f8fdc-1773-4944-b9a0-259c971a748f None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:36.298500 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-b79f8fdc-1773-4944-b9a0-259c971a748f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 07:34:36.298500 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:34:36.298500 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:34:36.298500 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:34:36.298500 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:34:36.298500 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:34:36.298500 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:34:36.298500 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:34:36.298500 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:34:36.298500 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:34:36.298500 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:34:36.298500 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:34:36.298500 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 07:34:36.298500 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 07:34:36.298500 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 07:34:36.298500 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 07:34:36.299645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:34:36.299645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:34:36.299645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 07:34:36.299645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:34:36.299645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 07:34:36.299645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:34:36.299645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:34:36.299645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:34:36.299645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:34:36.299645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:34:36.299645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:34:36.299645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:34:36.299645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:34:36.299645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:34:36.299645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:34:36.299645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:34:36.299645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:34:36.299645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:34:36.300804 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:34:36.300804 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:34:36.300804 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 07:34:36.300804 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 07:34:36.300804 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 07:34:36.300804 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 07:34:36.300804 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 07:34:36.300804 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 07:34:36.300804 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 07:34:36.300804 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:34:36.300804 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 635/1253] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:34:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:34:36.306164 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b649afc4-4a1c-413b-9afb-ebef8c5ca9c6 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:36.363367 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:36.407828 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b649afc4-4a1c-413b-9afb-ebef8c5ca9c6 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:36.442339 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a70adf-8100-45fc-a0e6-2df9fa54b4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:36.442932 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a70adf-8100-45fc-a0e6-2df9fa54b4e4 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:36.443233 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a70adf-8100-45fc-a0e6-2df9fa54b4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:36.443501 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a70adf-8100-45fc-a0e6-2df9fa54b4e4 None admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:36.444215 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a70adf-8100-45fc-a0e6-2df9fa54b4e4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:34:36.444513 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a70adf-8100-45fc-a0e6-2df9fa54b4e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:36.446542 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a70adf-8100-45fc-a0e6-2df9fa54b4e4 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:36.463845 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 619/1254] 10.222.0.42 () {56 vars in 1143 bytes} [Fri Aug 26 07:34:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:34:36.469664 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f8fdc-1773-4944-b9a0-259c971a748f None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:36.569274 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f8fdc-1773-4944-b9a0-259c971a748f None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:36.603458 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d4967-f3f5-42de-bff0-5ba35d0c0759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:36.604103 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d4967-f3f5-42de-bff0-5ba35d0c0759 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:36.604374 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d4967-f3f5-42de-bff0-5ba35d0c0759 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:36.604643 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d4967-f3f5-42de-bff0-5ba35d0c0759 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:36.659245 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:36.671746 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d4967-f3f5-42de-bff0-5ba35d0c0759 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:36.673219 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d4967-f3f5-42de-bff0-5ba35d0c0759 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:36.768803 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 636/1255] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:34:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 07:34:36.775200 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a70adf-8100-45fc-a0e6-2df9fa54b4e4 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:36.873682 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a70adf-8100-45fc-a0e6-2df9fa54b4e4 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:36.887035 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:36.908002 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f61fd1-2b60-48ca-bca2-a06f361ddcb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:36.908639 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f61fd1-2b60-48ca-bca2-a06f361ddcb8 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:36.908918 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f61fd1-2b60-48ca-bca2-a06f361ddcb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:36.909188 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f61fd1-2b60-48ca-bca2-a06f361ddcb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:36.919117 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f61fd1-2b60-48ca-bca2-a06f361ddcb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:36.920506 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f61fd1-2b60-48ca-bca2-a06f361ddcb8 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:36.934494 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-29f61fd1-2b60-48ca-bca2-a06f361ddcb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:34:36.934494 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:34:36.934494 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:34:36.934494 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:34:36.934494 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:34:36.934494 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:34:36.934494 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:34:36.934494 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:34:36.934494 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:34:36.934494 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:34:36.934494 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:34:36.934494 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:34:36.934494 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:34:36.934494 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:34:36.934494 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:34:36.934494 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:34:36.935605 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:34:36.935605 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:34:36.935605 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:34:36.935605 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:34:36.935605 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:34:36.935605 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:34:36.935605 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:34:36.935605 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:34:36.935605 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:34:36.935605 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:34:36.935605 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:34:36.935605 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:34:36.935605 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:34:36.935605 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:34:36.935605 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:34:36.935605 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:34:36.935605 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:34:36.936881 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:34:36.936881 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:34:36.936881 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:34:36.936881 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 620/1256] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:34:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:34:36.941398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d4967-f3f5-42de-bff0-5ba35d0c0759 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:37.040065 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:37.051675 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d4967-f3f5-42de-bff0-5ba35d0c0759 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:37.085136 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecaafdf-1c9d-42c1-a152-c1382164609c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:37.086386 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecaafdf-1c9d-42c1-a152-c1382164609c None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:37.087811 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecaafdf-1c9d-42c1-a152-c1382164609c None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:37.087811 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecaafdf-1c9d-42c1-a152-c1382164609c None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:37.087811 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecaafdf-1c9d-42c1-a152-c1382164609c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:34:37.087811 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecaafdf-1c9d-42c1-a152-c1382164609c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:37.089205 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecaafdf-1c9d-42c1-a152-c1382164609c None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:37.100037 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 637/1257] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:34:37.105792 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f61fd1-2b60-48ca-bca2-a06f361ddcb8 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:37.204535 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f61fd1-2b60-48ca-bca2-a06f361ddcb8 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:37.237869 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e632bc7-c18d-4526-8619-36dd36bfa5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:37.238499 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e632bc7-c18d-4526-8619-36dd36bfa5aa None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:37.238781 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e632bc7-c18d-4526-8619-36dd36bfa5aa None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:37.239082 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e632bc7-c18d-4526-8619-36dd36bfa5aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:37.246183 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e632bc7-c18d-4526-8619-36dd36bfa5aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:37.247655 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e632bc7-c18d-4526-8619-36dd36bfa5aa None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:37.259672 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-3e632bc7-c18d-4526-8619-36dd36bfa5aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:34:37.259672 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:34:37.259672 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:34:37.259672 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:34:37.259672 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:34:37.259672 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:34:37.259672 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:34:37.259672 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:34:37.259672 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:34:37.259672 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:34:37.259672 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:34:37.259672 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:34:37.259672 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 07:34:37.259672 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 07:34:37.259672 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 07:34:37.260768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 07:34:37.260768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:34:37.260768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:34:37.260768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:34:37.260768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:34:37.260768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:34:37.260768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:34:37.260768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:34:37.260768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:34:37.260768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:34:37.260768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:34:37.260768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:34:37.260768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:34:37.260768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:34:37.260768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:34:37.260768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:34:37.260768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:34:37.261988 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 07:34:37.261988 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 07:34:37.261988 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 07:34:37.261988 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 07:34:37.261988 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 07:34:37.261988 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 07:34:37.261988 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:34:37.261988 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:34:37.261988 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 621/1258] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:34:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:34:37.266607 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecaafdf-1c9d-42c1-a152-c1382164609c None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:37.368182 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecaafdf-1c9d-42c1-a152-c1382164609c None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:37.402685 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359dfbe-466b-4e36-a60c-22b16a3f32a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:37.403315 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359dfbe-466b-4e36-a60c-22b16a3f32a6 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:37.403603 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359dfbe-466b-4e36-a60c-22b16a3f32a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:37.403893 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359dfbe-466b-4e36-a60c-22b16a3f32a6 None admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:37.404595 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359dfbe-466b-4e36-a60c-22b16a3f32a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:34:37.404927 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359dfbe-466b-4e36-a60c-22b16a3f32a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:37.406345 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359dfbe-466b-4e36-a60c-22b16a3f32a6 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:37.418739 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 638/1259] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 26 07:34:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:34:37.425037 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e632bc7-c18d-4526-8619-36dd36bfa5aa None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:37.452334 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:37.526951 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e632bc7-c18d-4526-8619-36dd36bfa5aa None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:37.560853 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0aca73-b9c0-4d18-9eae-27a9f418ce13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:37.561454 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0aca73-b9c0-4d18-9eae-27a9f418ce13 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:37.561736 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0aca73-b9c0-4d18-9eae-27a9f418ce13 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:37.562006 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0aca73-b9c0-4d18-9eae-27a9f418ce13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:37.562723 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0aca73-b9c0-4d18-9eae-27a9f418ce13 None admin] RBAC: Adding query filter params (role.id=07ed857b2feb472f9fa9e7fe0b08582b, scope.project.id=becbf57e91454d499dec313ff9eadfae, user.id=f6c2bc293f1b4daca83e8d6dff66a316) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:34:37.563056 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0aca73-b9c0-4d18-9eae-27a9f418ce13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:37.564522 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0aca73-b9c0-4d18-9eae-27a9f418ce13 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:37.570344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 622/1260] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:34:37 2022] GET /identity/v3/role_assignments?user.id=f6c2bc293f1b4daca83e8d6dff66a316&scope.project.id=becbf57e91454d499dec313ff9eadfae&role.id=07ed857b2feb472f9fa9e7fe0b08582b => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:34:39.447996 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049c614-a48a-4aae-b66f-c6b03e47dc3a None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:39.448773 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049c614-a48a-4aae-b66f-c6b03e47dc3a None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:39.448773 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049c614-a48a-4aae-b66f-c6b03e47dc3a None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:39.449866 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 639/1261] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:34:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:34:39.455432 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe81a76-0a4b-49b0-9402-d30e53cebaad None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:39.455913 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe81a76-0a4b-49b0-9402-d30e53cebaad None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:39.456024 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe81a76-0a4b-49b0-9402-d30e53cebaad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:39.474181 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-2fe81a76-0a4b-49b0-9402-d30e53cebaad None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:34:39.475417 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-2fe81a76-0a4b-49b0-9402-d30e53cebaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:34:39.548684 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 623/1262] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:34:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:34:39.821646 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e049c614-a48a-4aae-b66f-c6b03e47dc3a None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:39.832625 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:39.929045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e049c614-a48a-4aae-b66f-c6b03e47dc3a None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:39.964545 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f6ba7-1043-4826-abc7-ae851e6c562e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:39.965260 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f6ba7-1043-4826-abc7-ae851e6c562e None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:39.965489 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f6ba7-1043-4826-abc7-ae851e6c562e None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:39.965723 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f6ba7-1043-4826-abc7-ae851e6c562e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:39.976439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f6ba7-1043-4826-abc7-ae851e6c562e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:34:39.981185 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-417f6ba7-1043-4826-abc7-ae851e6c562e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:34:39.981185 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:34:39.981185 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:34:39.981185 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:34:39.981185 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:34:39.981185 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:34:39.981185 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:34:39.981185 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:34:39.981185 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:34:39.981185 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:34:39.981185 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:34:39.981185 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:34:39.981185 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:34:39.981185 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:34:39.981185 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:34:39.981185 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:34:39.982313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:34:39.982313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:34:39.982313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:34:39.982313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:34:39.982313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:34:39.982313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:34:39.982313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:34:39.982313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:34:39.982313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:34:39.982313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:34:39.982313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:34:39.982313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:34:39.982313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:34:39.982313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:34:39.982313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:34:39.982313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:34:39.983612 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:34:39.983612 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:34:39.983612 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:34:39.983612 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:34:39.983612 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:34:39.983612 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:34:39.983612 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:34:39.983612 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:34:39.983612 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:34:39.983612 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:34:39.983612 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:34:39.983612 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:34:39.983612 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 640/1263] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 26 07:34:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:34:39.988437 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe81a76-0a4b-49b0-9402-d30e53cebaad None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:40.009249 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:40.094163 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe81a76-0a4b-49b0-9402-d30e53cebaad None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:40.130964 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f287cb-9a6b-4224-8cdf-27643ef46729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:40.131597 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f287cb-9a6b-4224-8cdf-27643ef46729 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:40.131876 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f287cb-9a6b-4224-8cdf-27643ef46729 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:40.132673 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f287cb-9a6b-4224-8cdf-27643ef46729 None admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:40.133391 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f287cb-9a6b-4224-8cdf-27643ef46729 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:34:40.133687 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f287cb-9a6b-4224-8cdf-27643ef46729 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:40.135092 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f287cb-9a6b-4224-8cdf-27643ef46729 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:40.143530 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 624/1264] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:34:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:34:40.150171 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f6ba7-1043-4826-abc7-ae851e6c562e None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:40.219206 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:40.254111 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f6ba7-1043-4826-abc7-ae851e6c562e None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:40.287945 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c35aaa-40ef-4b55-8c1e-d3393aabb919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:40.288763 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c35aaa-40ef-4b55-8c1e-d3393aabb919 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:40.289050 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c35aaa-40ef-4b55-8c1e-d3393aabb919 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:40.289321 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c35aaa-40ef-4b55-8c1e-d3393aabb919 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:40.303010 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c35aaa-40ef-4b55-8c1e-d3393aabb919 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:40.305185 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c35aaa-40ef-4b55-8c1e-d3393aabb919 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:40.322590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-c7c35aaa-40ef-4b55-8c1e-d3393aabb919 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:34:40.322590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:34:40.322590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:34:40.322590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:34:40.322590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:34:40.322590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:34:40.322590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:34:40.322590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:34:40.322590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:34:40.322590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:34:40.322590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:34:40.322590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:34:40.322590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:34:40.322590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:34:40.322590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:34:40.322590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:34:40.323747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:34:40.323747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:34:40.323747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:34:40.323747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:34:40.323747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:34:40.323747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:34:40.323747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:34:40.323747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:34:40.323747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:34:40.323747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:34:40.323747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:34:40.323747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:34:40.323747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:34:40.323747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:34:40.323747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:34:40.323747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:34:40.323747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:34:40.324977 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:34:40.324977 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:34:40.324977 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:34:40.325461 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 641/1265] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:34:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:34:40.329621 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f287cb-9a6b-4224-8cdf-27643ef46729 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:40.415955 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:40.442434 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f287cb-9a6b-4224-8cdf-27643ef46729 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:40.477430 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dbd831-833f-4a4c-9fdc-97c2178bafc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:40.478189 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dbd831-833f-4a4c-9fdc-97c2178bafc5 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:40.478472 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dbd831-833f-4a4c-9fdc-97c2178bafc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:40.478748 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dbd831-833f-4a4c-9fdc-97c2178bafc5 None admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:40.479429 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dbd831-833f-4a4c-9fdc-97c2178bafc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:34:40.479741 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dbd831-833f-4a4c-9fdc-97c2178bafc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:40.481136 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dbd831-833f-4a4c-9fdc-97c2178bafc5 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:40.493625 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 625/1266] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:34:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:34:40.499505 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c35aaa-40ef-4b55-8c1e-d3393aabb919 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:40.604126 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c35aaa-40ef-4b55-8c1e-d3393aabb919 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:40.625867 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:40.640353 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d8646-5b6a-47e8-ae5c-da5d608185e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:40.640883 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d8646-5b6a-47e8-ae5c-da5d608185e3 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:40.641162 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d8646-5b6a-47e8-ae5c-da5d608185e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:40.641434 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d8646-5b6a-47e8-ae5c-da5d608185e3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:40.649696 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d8646-5b6a-47e8-ae5c-da5d608185e3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:40.651196 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d8646-5b6a-47e8-ae5c-da5d608185e3 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:40.662521 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-8a5d8646-5b6a-47e8-ae5c-da5d608185e3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 07:34:40.662521 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:34:40.662521 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:34:40.662521 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:34:40.662521 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:34:40.662521 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:34:40.662521 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:34:40.662521 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:34:40.662521 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:34:40.662521 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:34:40.662521 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:34:40.662521 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:34:40.662521 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 07:34:40.662521 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 07:34:40.662521 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 07:34:40.662521 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 07:34:40.664229 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:34:40.664229 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:34:40.664229 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 07:34:40.664229 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:34:40.664229 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 07:34:40.664229 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:34:40.664229 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:34:40.664229 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:34:40.664229 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:34:40.664229 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:34:40.664229 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:34:40.664229 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:34:40.664229 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:34:40.664229 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:34:40.664229 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:34:40.664229 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:34:40.664229 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:34:40.664229 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:34:40.665683 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:34:40.665683 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:34:40.665683 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 07:34:40.665683 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 07:34:40.665683 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 07:34:40.665683 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 07:34:40.665683 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 07:34:40.665683 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 07:34:40.665683 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 07:34:40.665683 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:34:40.665683 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 642/1267] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:34:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:34:40.670308 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dbd831-833f-4a4c-9fdc-97c2178bafc5 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:40.780700 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dbd831-833f-4a4c-9fdc-97c2178bafc5 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:40.822854 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749133e-eddb-4431-b14b-d6ac7617d1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:40.823520 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749133e-eddb-4431-b14b-d6ac7617d1ff None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:40.823795 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749133e-eddb-4431-b14b-d6ac7617d1ff None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:40.824063 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749133e-eddb-4431-b14b-d6ac7617d1ff None admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:40.824791 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7749133e-eddb-4431-b14b-d6ac7617d1ff None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:34:40.825094 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7749133e-eddb-4431-b14b-d6ac7617d1ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:40.826514 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7749133e-eddb-4431-b14b-d6ac7617d1ff None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:40.836661 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:40.844829 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 626/1268] 10.222.0.42 () {56 vars in 1143 bytes} [Fri Aug 26 07:34:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:34:40.851436 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d8646-5b6a-47e8-ae5c-da5d608185e3 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:40.956374 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d8646-5b6a-47e8-ae5c-da5d608185e3 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:40.994661 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c855748-2fd6-4218-a486-c34c5ec177b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:40.995349 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c855748-2fd6-4218-a486-c34c5ec177b0 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:40.995830 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c855748-2fd6-4218-a486-c34c5ec177b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:40.996331 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c855748-2fd6-4218-a486-c34c5ec177b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:41.012210 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c855748-2fd6-4218-a486-c34c5ec177b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:41.014848 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c855748-2fd6-4218-a486-c34c5ec177b0 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:41.029138 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-2c855748-2fd6-4218-a486-c34c5ec177b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:34:41.029138 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:34:41.029138 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:34:41.029138 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:34:41.029138 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:34:41.029138 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:34:41.029138 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:34:41.029138 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:34:41.029138 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:34:41.029138 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:34:41.029138 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:34:41.029138 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:34:41.029138 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:34:41.029138 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:34:41.029138 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:34:41.029138 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:34:41.030388 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:34:41.030388 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:34:41.030388 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:34:41.030388 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:34:41.030388 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:34:41.030388 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:34:41.030388 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:34:41.030388 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:34:41.030388 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:34:41.030388 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:34:41.030388 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:34:41.030388 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:34:41.030388 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:34:41.030388 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:34:41.030388 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:34:41.030388 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:34:41.030388 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:34:41.031521 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:34:41.031521 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:34:41.031521 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:34:41.031521 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 643/1269] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:34:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:34:41.036247 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749133e-eddb-4431-b14b-d6ac7617d1ff None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:41.145497 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749133e-eddb-4431-b14b-d6ac7617d1ff None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:41.181977 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5746a-f22f-47f4-afc4-1c8f286ce857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:41.182585 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5746a-f22f-47f4-afc4-1c8f286ce857 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:41.182861 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5746a-f22f-47f4-afc4-1c8f286ce857 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:41.183161 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5746a-f22f-47f4-afc4-1c8f286ce857 None admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:41.183803 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d5746a-f22f-47f4-afc4-1c8f286ce857 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:34:41.184097 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d5746a-f22f-47f4-afc4-1c8f286ce857 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:41.185456 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d5746a-f22f-47f4-afc4-1c8f286ce857 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:41.197458 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 627/1270] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:34:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:34:41.203576 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c855748-2fd6-4218-a486-c34c5ec177b0 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:41.242464 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:41.311837 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c855748-2fd6-4218-a486-c34c5ec177b0 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:41.350440 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61add2-4618-4e69-93c2-a44274eb9e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:41.351128 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61add2-4618-4e69-93c2-a44274eb9e28 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:41.351512 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61add2-4618-4e69-93c2-a44274eb9e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:41.352011 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61add2-4618-4e69-93c2-a44274eb9e28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:41.359137 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c61add2-4618-4e69-93c2-a44274eb9e28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:41.360614 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c61add2-4618-4e69-93c2-a44274eb9e28 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:41.372556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-7c61add2-4618-4e69-93c2-a44274eb9e28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:34:41.372556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:34:41.372556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:34:41.372556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:34:41.372556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:34:41.372556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:34:41.372556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:34:41.372556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:34:41.372556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:34:41.372556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:34:41.372556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:34:41.372556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:34:41.372556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 07:34:41.372556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 07:34:41.372556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 07:34:41.373746 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 07:34:41.373746 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:34:41.373746 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:34:41.373746 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:34:41.373746 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:34:41.373746 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:34:41.373746 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:34:41.373746 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:34:41.373746 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:34:41.373746 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:34:41.373746 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:34:41.373746 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:34:41.373746 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:34:41.373746 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:34:41.373746 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:34:41.373746 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:34:41.373746 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:34:41.374830 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 07:34:41.374830 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 07:34:41.374830 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 07:34:41.374830 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 07:34:41.374830 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 07:34:41.374830 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 07:34:41.374830 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:34:41.374830 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:34:41.374830 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 644/1271] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:34:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:34:41.380013 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5746a-f22f-47f4-afc4-1c8f286ce857 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:41.451903 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:41.498170 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5746a-f22f-47f4-afc4-1c8f286ce857 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:41.535873 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c9322-705c-493a-9348-6eb45d3d99b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:41.536486 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c9322-705c-493a-9348-6eb45d3d99b1 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:41.536768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c9322-705c-493a-9348-6eb45d3d99b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:41.537039 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c9322-705c-493a-9348-6eb45d3d99b1 None admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:41.537744 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c9322-705c-493a-9348-6eb45d3d99b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:34:41.538128 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c9322-705c-493a-9348-6eb45d3d99b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:41.540208 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c9322-705c-493a-9348-6eb45d3d99b1 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:41.553429 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 628/1272] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 26 07:34:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:34:41.560259 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61add2-4618-4e69-93c2-a44274eb9e28 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:41.659675 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:41.668957 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61add2-4618-4e69-93c2-a44274eb9e28 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:41.704073 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70fd652-6e62-4015-8442-ee60504fb450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:41.704762 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fd652-6e62-4015-8442-ee60504fb450 None admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:41.705041 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fd652-6e62-4015-8442-ee60504fb450 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:41.705314 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fd652-6e62-4015-8442-ee60504fb450 None admin] PATH_INFO: `/v3/projects/becbf57e91454d499dec313ff9eadfae/users/f6c2bc293f1b4daca83e8d6dff66a316/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:41.707250 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70fd652-6e62-4015-8442-ee60504fb450 None admin] RBAC: Authorizing `identity:create_grant(project_id=becbf57e91454d499dec313ff9eadfae, user_id=f6c2bc293f1b4daca83e8d6dff66a316, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:41.708683 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70fd652-6e62-4015-8442-ee60504fb450 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:41.830614 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 645/1273] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Aug 26 07:34:41 2022] PUT /identity/v3/projects/becbf57e91454d499dec313ff9eadfae/users/f6c2bc293f1b4daca83e8d6dff66a316/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:34:43.855378 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef43d17-47f1-41fd-9844-0038b431a717 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:43.855912 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef43d17-47f1-41fd-9844-0038b431a717 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:43.855912 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef43d17-47f1-41fd-9844-0038b431a717 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:43.857305 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 629/1274] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:34:43.862753 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdfe1d4-dbb8-45f8-b77d-9bf697386335 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:43.863252 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdfe1d4-dbb8-45f8-b77d-9bf697386335 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:43.863355 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdfe1d4-dbb8-45f8-b77d-9bf697386335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:43.882526 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-6bdfe1d4-dbb8-45f8-b77d-9bf697386335 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:34:43.885600 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-6bdfe1d4-dbb8-45f8-b77d-9bf697386335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:34:43.953085 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 646/1275] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:34:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:34:44.227530 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef43d17-47f1-41fd-9844-0038b431a717 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:44.339604 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef43d17-47f1-41fd-9844-0038b431a717 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:44.359041 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:44.380024 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302f2c6-ca7d-408f-9752-02f5db2f8a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:44.380663 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302f2c6-ca7d-408f-9752-02f5db2f8a01 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:44.380940 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302f2c6-ca7d-408f-9752-02f5db2f8a01 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:44.381213 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302f2c6-ca7d-408f-9752-02f5db2f8a01 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:44.391859 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a302f2c6-ca7d-408f-9752-02f5db2f8a01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 07:34:44.396640 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-a302f2c6-ca7d-408f-9752-02f5db2f8a01 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:34:44.396640 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:34:44.396640 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:34:44.396640 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:34:44.396640 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:34:44.396640 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:34:44.396640 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:34:44.396640 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:34:44.396640 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:34:44.396640 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:34:44.396640 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:34:44.396640 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:34:44.396640 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 07:34:44.396640 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 07:34:44.396640 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 07:34:44.396640 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 07:34:44.401787 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 07:34:44.401787 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 07:34:44.401787 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 07:34:44.401787 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 07:34:44.401787 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:34:44.401787 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:34:44.401787 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:34:44.401787 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:34:44.401787 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:34:44.401787 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:34:44.401787 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:34:44.401787 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:34:44.401787 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:34:44.401787 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:34:44.401787 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:34:44.401787 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:34:44.402937 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:34:44.402937 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:34:44.402937 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:34:44.402937 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:34:44.402937 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 07:34:44.402937 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 07:34:44.402937 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 07:34:44.402937 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 07:34:44.402937 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 07:34:44.402937 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 07:34:44.402937 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 07:34:44.402937 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:34:44.402937 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 630/1276] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Aug 26 07:34:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:34:44.404926 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdfe1d4-dbb8-45f8-b77d-9bf697386335 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:44.515177 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:44.533601 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdfe1d4-dbb8-45f8-b77d-9bf697386335 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:44.580790 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ae4d1-6d4f-43fd-9266-d4417a6aa102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:44.580790 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ae4d1-6d4f-43fd-9266-d4417a6aa102 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:44.580790 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ae4d1-6d4f-43fd-9266-d4417a6aa102 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:44.580790 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ae4d1-6d4f-43fd-9266-d4417a6aa102 None admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:44.583407 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ae4d1-6d4f-43fd-9266-d4417a6aa102 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:34:44.583407 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ae4d1-6d4f-43fd-9266-d4417a6aa102 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:44.583407 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ae4d1-6d4f-43fd-9266-d4417a6aa102 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:44.583407 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 647/1277] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Aug 26 07:34:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:34:44.588043 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302f2c6-ca7d-408f-9752-02f5db2f8a01 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:44.711633 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302f2c6-ca7d-408f-9752-02f5db2f8a01 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:44.750189 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088e699-cbd8-4be4-a652-b3a0b16ca213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:44.750819 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088e699-cbd8-4be4-a652-b3a0b16ca213 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:44.751122 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088e699-cbd8-4be4-a652-b3a0b16ca213 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:44.760530 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088e699-cbd8-4be4-a652-b3a0b16ca213 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:44.762410 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088e699-cbd8-4be4-a652-b3a0b16ca213 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:44.763940 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088e699-cbd8-4be4-a652-b3a0b16ca213 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:44.781959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-0088e699-cbd8-4be4-a652-b3a0b16ca213 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:34:44.781959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:34:44.781959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:34:44.781959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:34:44.781959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:34:44.781959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:34:44.781959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:34:44.781959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:34:44.781959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:34:44.781959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:34:44.781959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:34:44.781959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:34:44.781959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:34:44.781959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:34:44.781959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:34:44.781959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:34:44.783185 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:34:44.783185 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:34:44.783185 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:34:44.783185 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:34:44.783185 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:34:44.783185 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:34:44.783185 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:34:44.783185 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:34:44.783185 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:34:44.783185 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:34:44.783185 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:34:44.783185 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:34:44.783185 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:34:44.783185 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:34:44.783185 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:34:44.783185 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:34:44.783185 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:34:44.784162 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:34:44.784162 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:34:44.784162 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:34:44.784162 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 631/1278] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:34:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:34:44.790332 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ae4d1-6d4f-43fd-9266-d4417a6aa102 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:44.926187 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ae4d1-6d4f-43fd-9266-d4417a6aa102 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:44.963731 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451843f-ddd2-4b23-b30c-fd7618f38236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:44.964343 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451843f-ddd2-4b23-b30c-fd7618f38236 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:44.964622 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451843f-ddd2-4b23-b30c-fd7618f38236 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:44.964893 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451843f-ddd2-4b23-b30c-fd7618f38236 None admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:44.965544 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a451843f-ddd2-4b23-b30c-fd7618f38236 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:34:44.965850 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a451843f-ddd2-4b23-b30c-fd7618f38236 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:44.967249 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a451843f-ddd2-4b23-b30c-fd7618f38236 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:44.980545 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 648/1279] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:34:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:34:44.986695 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088e699-cbd8-4be4-a652-b3a0b16ca213 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:45.018220 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:45.090130 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088e699-cbd8-4be4-a652-b3a0b16ca213 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:45.126220 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ed352-450d-4d05-943e-fd2fce8664f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:45.126855 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ed352-450d-4d05-943e-fd2fce8664f7 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:45.127163 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ed352-450d-4d05-943e-fd2fce8664f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:45.127432 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ed352-450d-4d05-943e-fd2fce8664f7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:45.135469 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755ed352-450d-4d05-943e-fd2fce8664f7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:45.136915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755ed352-450d-4d05-943e-fd2fce8664f7 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:45.149362 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-755ed352-450d-4d05-943e-fd2fce8664f7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 07:34:45.149362 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:34:45.149362 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:34:45.149362 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:34:45.149362 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:34:45.149362 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:34:45.149362 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:34:45.149362 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:34:45.149362 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:34:45.149362 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:34:45.149362 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:34:45.149362 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:34:45.149362 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 07:34:45.149362 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 07:34:45.149362 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 07:34:45.149362 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 07:34:45.150938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:34:45.150938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:34:45.150938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 07:34:45.150938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:34:45.150938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 07:34:45.150938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 07:34:45.150938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:34:45.150938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:34:45.150938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:34:45.150938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:34:45.150938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:34:45.150938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:34:45.150938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:34:45.150938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:34:45.150938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:34:45.150938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:34:45.150938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:34:45.150938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:34:45.152656 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:34:45.152656 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:34:45.152656 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 07:34:45.152656 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 07:34:45.152656 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 07:34:45.152656 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 07:34:45.152656 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 07:34:45.152656 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 07:34:45.152656 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 07:34:45.152656 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:34:45.152656 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 632/1280] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:34:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:34:45.157026 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451843f-ddd2-4b23-b30c-fd7618f38236 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:45.160985 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:45.278139 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451843f-ddd2-4b23-b30c-fd7618f38236 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:45.313328 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a7003-0aa0-48b4-afde-9e6de4730e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:45.313935 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a7003-0aa0-48b4-afde-9e6de4730e78 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:45.314240 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a7003-0aa0-48b4-afde-9e6de4730e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:45.314508 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a7003-0aa0-48b4-afde-9e6de4730e78 None admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:45.315264 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a7003-0aa0-48b4-afde-9e6de4730e78 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:34:45.315563 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a7003-0aa0-48b4-afde-9e6de4730e78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:45.317010 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a7003-0aa0-48b4-afde-9e6de4730e78 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:45.337300 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 649/1281] 10.222.0.42 () {56 vars in 1143 bytes} [Fri Aug 26 07:34:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:34:45.343348 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ed352-450d-4d05-943e-fd2fce8664f7 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:45.443985 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:45.455777 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ed352-450d-4d05-943e-fd2fce8664f7 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:45.490773 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a4f29-006f-4c17-a37a-f72ef879a407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:45.491934 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a4f29-006f-4c17-a37a-f72ef879a407 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:45.492398 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a4f29-006f-4c17-a37a-f72ef879a407 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:45.492516 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a4f29-006f-4c17-a37a-f72ef879a407 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:45.559310 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a4f29-006f-4c17-a37a-f72ef879a407 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:45.560759 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a4f29-006f-4c17-a37a-f72ef879a407 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:45.654374 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:45.664605 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 633/1282] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Aug 26 07:34:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 07:34:45.670503 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a7003-0aa0-48b4-afde-9e6de4730e78 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:45.736664 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:45.778030 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a7003-0aa0-48b4-afde-9e6de4730e78 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:45.815912 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e034bcf-79df-4b62-884b-ca9439692c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:45.816557 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e034bcf-79df-4b62-884b-ca9439692c2d None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:45.816832 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e034bcf-79df-4b62-884b-ca9439692c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:45.817098 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e034bcf-79df-4b62-884b-ca9439692c2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:45.827744 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e034bcf-79df-4b62-884b-ca9439692c2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:45.829270 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e034bcf-79df-4b62-884b-ca9439692c2d None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:45.844153 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-1e034bcf-79df-4b62-884b-ca9439692c2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:34:45.844153 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:34:45.844153 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:34:45.844153 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:34:45.844153 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:34:45.844153 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:34:45.844153 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:34:45.844153 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:34:45.844153 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:34:45.844153 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:34:45.844153 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:34:45.844153 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:34:45.844153 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 07:34:45.844153 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 07:34:45.844153 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 07:34:45.844153 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 07:34:45.845250 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:34:45.845250 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:34:45.845250 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:34:45.845250 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:34:45.845250 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:34:45.845250 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:34:45.845250 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:34:45.845250 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:34:45.845250 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:34:45.845250 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:34:45.845250 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:34:45.845250 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:34:45.845250 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:34:45.845250 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:34:45.845250 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:34:45.845250 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:34:45.845250 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 07:34:45.846473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 07:34:45.846473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 07:34:45.846473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:34:45.846473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 650/1283] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:34:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:34:45.851986 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a4f29-006f-4c17-a37a-f72ef879a407 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:45.953911 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a4f29-006f-4c17-a37a-f72ef879a407 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:45.991954 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e800a04-53bd-4988-a3e3-47ec4691c0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:45.992770 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e800a04-53bd-4988-a3e3-47ec4691c0e5 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:45.992770 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e800a04-53bd-4988-a3e3-47ec4691c0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:45.993036 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e800a04-53bd-4988-a3e3-47ec4691c0e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:45.993681 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e800a04-53bd-4988-a3e3-47ec4691c0e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:34:45.993984 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e800a04-53bd-4988-a3e3-47ec4691c0e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:45.995391 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e800a04-53bd-4988-a3e3-47ec4691c0e5 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:46.006840 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 634/1284] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Aug 26 07:34:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:34:46.012698 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e034bcf-79df-4b62-884b-ca9439692c2d None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:46.118622 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e034bcf-79df-4b62-884b-ca9439692c2d None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:46.134214 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:46.157450 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00e5ef-9e2f-4efe-90aa-42f0c11c2cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:46.158083 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00e5ef-9e2f-4efe-90aa-42f0c11c2cf3 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:46.158357 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00e5ef-9e2f-4efe-90aa-42f0c11c2cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:46.158621 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00e5ef-9e2f-4efe-90aa-42f0c11c2cf3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:46.166278 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00e5ef-9e2f-4efe-90aa-42f0c11c2cf3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:46.167740 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00e5ef-9e2f-4efe-90aa-42f0c11c2cf3 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:46.180078 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application [None req-bc00e5ef-9e2f-4efe-90aa-42f0c11c2cf3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:34:46.180078 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:34:46.180078 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:34:46.180078 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:34:46.180078 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:34:46.180078 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:34:46.180078 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:34:46.180078 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:34:46.180078 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:34:46.180078 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:34:46.180078 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:34:46.180078 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:34:46.180078 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 07:34:46.180078 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 07:34:46.180078 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 07:34:46.181115 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 07:34:46.181115 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:34:46.181115 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:34:46.181115 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:34:46.181115 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:34:46.181115 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:34:46.181115 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:34:46.181115 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:34:46.181115 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application with Lock( Aug 26 07:34:46.181115 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:34:46.181115 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:34:46.181115 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:34:46.181115 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:34:46.181115 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:34:46.181115 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:34:46.181115 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:34:46.181115 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:34:46.182747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 07:34:46.182747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 07:34:46.182747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 07:34:46.182747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 07:34:46.182747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 07:34:46.182747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 07:34:46.182747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 07:34:46.182747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: ERROR keystone.server.flask.application Aug 26 07:34:46.183516 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 651/1285] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Aug 26 07:34:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:34:46.187005 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e800a04-53bd-4988-a3e3-47ec4691c0e5 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:46.250946 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:46.300602 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e800a04-53bd-4988-a3e3-47ec4691c0e5 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:46.333894 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958a330-55e7-4c31-b20a-79443fb9d988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:46.334496 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958a330-55e7-4c31-b20a-79443fb9d988 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:46.334772 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958a330-55e7-4c31-b20a-79443fb9d988 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:46.336133 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958a330-55e7-4c31-b20a-79443fb9d988 None admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:46.336495 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958a330-55e7-4c31-b20a-79443fb9d988 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:34:46.336795 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958a330-55e7-4c31-b20a-79443fb9d988 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:46.343167 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958a330-55e7-4c31-b20a-79443fb9d988 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:46.351440 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 635/1286] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Aug 26 07:34:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:34:46.357967 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00e5ef-9e2f-4efe-90aa-42f0c11c2cf3 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:46.465008 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00e5ef-9e2f-4efe-90aa-42f0c11c2cf3 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:46.505077 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494d544-e443-40db-8f01-7b92b4b32088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:46.505584 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494d544-e443-40db-8f01-7b92b4b32088 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:46.505853 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494d544-e443-40db-8f01-7b92b4b32088 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:46.506118 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494d544-e443-40db-8f01-7b92b4b32088 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:46.506862 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c494d544-e443-40db-8f01-7b92b4b32088 None admin] RBAC: Adding query filter params (role.id=07ed857b2feb472f9fa9e7fe0b08582b, scope.project.id=becbf57e91454d499dec313ff9eadfae, user.id=f6c2bc293f1b4daca83e8d6dff66a316) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:34:46.507202 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c494d544-e443-40db-8f01-7b92b4b32088 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:46.508861 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c494d544-e443-40db-8f01-7b92b4b32088 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:46.515006 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 652/1287] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Aug 26 07:34:46 2022] GET /identity/v3/role_assignments?user.id=f6c2bc293f1b4daca83e8d6dff66a316&scope.project.id=becbf57e91454d499dec313ff9eadfae&role.id=07ed857b2feb472f9fa9e7fe0b08582b => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:34:48.559171 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791e332-5807-47af-a03c-bca86a2def39 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:48.559822 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791e332-5807-47af-a03c-bca86a2def39 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:48.559822 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791e332-5807-47af-a03c-bca86a2def39 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:48.561073 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 636/1288] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:34:48.566418 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d9ea1-60b6-4192-95f0-638bfaad3383 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:48.566855 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d9ea1-60b6-4192-95f0-638bfaad3383 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:48.566946 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d9ea1-60b6-4192-95f0-638bfaad3383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:48.586133 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-e62d9ea1-60b6-4192-95f0-638bfaad3383 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:34:48.587370 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-e62d9ea1-60b6-4192-95f0-638bfaad3383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:34:48.619347 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:48.657304 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 653/1289] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:34:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:34:48.933637 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791e332-5807-47af-a03c-bca86a2def39 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:49.039003 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791e332-5807-47af-a03c-bca86a2def39 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:49.051253 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:49.076040 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30063dce-4538-4889-a135-06e0fd10c78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:49.076668 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30063dce-4538-4889-a135-06e0fd10c78c None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:49.076942 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30063dce-4538-4889-a135-06e0fd10c78c None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:49.077206 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30063dce-4538-4889-a135-06e0fd10c78c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:49.077782 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30063dce-4538-4889-a135-06e0fd10c78c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:49.079203 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30063dce-4538-4889-a135-06e0fd10c78c None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:49.088341 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-30063dce-4538-4889-a135-06e0fd10c78c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 07:34:49.088341 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:34:49.088341 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 07:34:49.088341 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 07:34:49.088341 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 07:34:49.088341 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 07:34:49.088341 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 07:34:49.088341 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:34:49.088341 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 07:34:49.088341 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:34:49.088341 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 07:34:49.088341 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:34:49.088341 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:34:49.088341 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:34:49.088341 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:34:49.088341 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:34:49.088341 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:34:49.089497 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:34:49.089497 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:34:49.089497 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:34:49.089497 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:34:49.089497 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:34:49.089497 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:34:49.089497 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 07:34:49.089497 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 07:34:49.089497 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 07:34:49.089497 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 07:34:49.089497 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:34:49.089497 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:34:49.089497 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:34:49.089497 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:34:49.089497 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:34:49.089497 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:34:49.090536 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:34:49.090536 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:34:49.090536 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:34:49.090536 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:34:49.090536 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:34:49.090536 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:34:49.090536 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:34:49.090536 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:34:49.090536 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:34:49.090536 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:34:49.090536 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 07:34:49.090536 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:34:49.090536 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 07:34:49.090536 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:34:49.090536 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 637/1290] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Aug 26 07:34:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:34:49.095625 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d9ea1-60b6-4192-95f0-638bfaad3383 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:49.200093 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d9ea1-60b6-4192-95f0-638bfaad3383 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:49.243077 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b5c6e-d0ca-4c6f-b693-7665521a66cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:49.243692 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b5c6e-d0ca-4c6f-b693-7665521a66cd None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:49.243972 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b5c6e-d0ca-4c6f-b693-7665521a66cd None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:49.244243 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b5c6e-d0ca-4c6f-b693-7665521a66cd None admin] PATH_INFO: `/v3/services` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:49.244878 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b5c6e-d0ca-4c6f-b693-7665521a66cd None admin] RBAC: Adding query filter params (name=placement) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:34:49.245181 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b5c6e-d0ca-4c6f-b693-7665521a66cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:49.246557 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b5c6e-d0ca-4c6f-b693-7665521a66cd None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:49.251580 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 654/1291] 10.222.0.42 () {56 vars in 1116 bytes} [Fri Aug 26 07:34:49 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:34:49.258386 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30063dce-4538-4889-a135-06e0fd10c78c None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:49.372633 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30063dce-4538-4889-a135-06e0fd10c78c None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:49.407232 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4e71f-b12d-4555-a5bb-aff8eb283c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:49.407831 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4e71f-b12d-4555-a5bb-aff8eb283c48 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:49.408105 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4e71f-b12d-4555-a5bb-aff8eb283c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:49.408370 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4e71f-b12d-4555-a5bb-aff8eb283c48 None admin] PATH_INFO: `/v3/services` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:49.408998 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4e71f-b12d-4555-a5bb-aff8eb283c48 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:34:49.409294 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4e71f-b12d-4555-a5bb-aff8eb283c48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:49.410699 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4e71f-b12d-4555-a5bb-aff8eb283c48 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:49.418485 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 638/1292] 10.222.0.42 () {56 vars in 1116 bytes} [Fri Aug 26 07:34:49 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:34:51.363988 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea0534-5fa0-4139-88e2-64364808cd16 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:51.364637 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea0534-5fa0-4139-88e2-64364808cd16 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:51.364637 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea0534-5fa0-4139-88e2-64364808cd16 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:51.365857 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 655/1293] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:34:51.372105 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3462f72-7c70-4c89-8821-86dee2c2474c None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:51.372593 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3462f72-7c70-4c89-8821-86dee2c2474c None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:51.372700 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3462f72-7c70-4c89-8821-86dee2c2474c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:51.391855 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-f3462f72-7c70-4c89-8821-86dee2c2474c None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:34:51.393049 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-f3462f72-7c70-4c89-8821-86dee2c2474c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:34:51.424514 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:51.462529 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 639/1294] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:34:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:34:51.737857 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea0534-5fa0-4139-88e2-64364808cd16 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:51.770061 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:51.849784 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea0534-5fa0-4139-88e2-64364808cd16 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:51.886356 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8ef3d-e796-4969-98a0-1c1a1f346c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:51.886960 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8ef3d-e796-4969-98a0-1c1a1f346c09 None admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:51.887265 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8ef3d-e796-4969-98a0-1c1a1f346c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:51.887529 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8ef3d-e796-4969-98a0-1c1a1f346c09 None admin] PATH_INFO: `/v3/services` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:51.888177 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf8ef3d-e796-4969-98a0-1c1a1f346c09 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:51.889537 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf8ef3d-e796-4969-98a0-1c1a1f346c09 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:52.014660 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 656/1295] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Aug 26 07:34:51 2022] POST /identity/v3/services => generated 246 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:34:53.991336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d768571-37bd-4f2c-b3ea-2fd875171e2a None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:53.991891 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d768571-37bd-4f2c-b3ea-2fd875171e2a None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:53.991891 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d768571-37bd-4f2c-b3ea-2fd875171e2a None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:53.993217 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 640/1296] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:34:53.998619 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19742b8c-f543-445c-93ba-116f098e41ef None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:54.003214 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19742b8c-f543-445c-93ba-116f098e41ef None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:54.003214 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19742b8c-f543-445c-93ba-116f098e41ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:54.017787 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-19742b8c-f543-445c-93ba-116f098e41ef None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:34:54.018903 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-19742b8c-f543-445c-93ba-116f098e41ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:34:54.095941 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 657/1297] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:34:53 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:34:54.376320 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d768571-37bd-4f2c-b3ea-2fd875171e2a None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:54.485822 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d768571-37bd-4f2c-b3ea-2fd875171e2a None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:54.521741 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d99d6-2c34-4e22-bfe7-e15489132bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:54.522912 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d99d6-2c34-4e22-bfe7-e15489132bef None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:54.523320 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d99d6-2c34-4e22-bfe7-e15489132bef None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:54.523594 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d99d6-2c34-4e22-bfe7-e15489132bef None admin] PATH_INFO: `/v3/services/placement` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:54.524188 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d99d6-2c34-4e22-bfe7-e15489132bef None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:54.525562 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d99d6-2c34-4e22-bfe7-e15489132bef None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:54.535182 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-d17d99d6-2c34-4e22-bfe7-e15489132bef None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 07:34:54.535182 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:34:54.535182 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 07:34:54.535182 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 07:34:54.535182 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 07:34:54.535182 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 07:34:54.535182 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 07:34:54.535182 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:34:54.535182 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 07:34:54.535182 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:34:54.535182 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 07:34:54.535182 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:34:54.535182 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:34:54.535182 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:34:54.535182 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:34:54.535182 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:34:54.535182 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:34:54.536538 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:34:54.536538 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:34:54.536538 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:34:54.536538 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:34:54.536538 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:34:54.536538 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:34:54.536538 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 07:34:54.536538 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 07:34:54.536538 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 07:34:54.536538 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 07:34:54.536538 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:34:54.536538 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:34:54.536538 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:34:54.536538 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:34:54.536538 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:34:54.536538 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:34:54.537471 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:34:54.537471 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:34:54.537471 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:34:54.537471 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:34:54.537471 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:34:54.537471 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:34:54.537471 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:34:54.537471 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:34:54.537471 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:34:54.537471 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:34:54.537471 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 07:34:54.537471 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:34:54.537471 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 07:34:54.537471 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:34:54.537471 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 641/1298] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Aug 26 07:34:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:34:54.543290 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19742b8c-f543-445c-93ba-116f098e41ef None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:54.561599 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:54.645835 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19742b8c-f543-445c-93ba-116f098e41ef None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:54.682834 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad148d-85af-422b-b9ad-9df6c2f0d5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:54.683507 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad148d-85af-422b-b9ad-9df6c2f0d5e3 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:54.683783 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad148d-85af-422b-b9ad-9df6c2f0d5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:54.684050 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad148d-85af-422b-b9ad-9df6c2f0d5e3 None admin] PATH_INFO: `/v3/services` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:54.684683 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad148d-85af-422b-b9ad-9df6c2f0d5e3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:34:54.684989 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad148d-85af-422b-b9ad-9df6c2f0d5e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:54.686419 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad148d-85af-422b-b9ad-9df6c2f0d5e3 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:54.691997 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 658/1299] 10.222.0.42 () {56 vars in 1116 bytes} [Fri Aug 26 07:34:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:34:54.698667 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d99d6-2c34-4e22-bfe7-e15489132bef None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:54.732937 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:54.803237 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d99d6-2c34-4e22-bfe7-e15489132bef None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:54.839166 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19041b-430b-43b4-99c2-6611f03d2dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:54.839790 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19041b-430b-43b4-99c2-6611f03d2dab None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:54.840074 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19041b-430b-43b4-99c2-6611f03d2dab None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:54.840348 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19041b-430b-43b4-99c2-6611f03d2dab None admin] PATH_INFO: `/v3/endpoints` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:54.841069 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d19041b-430b-43b4-99c2-6611f03d2dab None admin] RBAC: Adding query filter params (interface=public, service_id=d866b09ebfb84044a7141c941213dd6a, region_id=RegionOne) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:34:54.841370 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d19041b-430b-43b4-99c2-6611f03d2dab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:54.842749 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d19041b-430b-43b4-99c2-6611f03d2dab None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:54.855500 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 642/1300] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Aug 26 07:34:54 2022] GET /identity/v3/endpoints?service_id=d866b09ebfb84044a7141c941213dd6a&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:34:54.861408 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad148d-85af-422b-b9ad-9df6c2f0d5e3 None admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:54.950339 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:54.970306 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad148d-85af-422b-b9ad-9df6c2f0d5e3 None admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:55.003854 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca5d13-1213-40d4-a19a-d98f8f1cfdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:55.004562 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca5d13-1213-40d4-a19a-d98f8f1cfdd2 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:55.004724 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca5d13-1213-40d4-a19a-d98f8f1cfdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:55.004991 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca5d13-1213-40d4-a19a-d98f8f1cfdd2 None admin] PATH_INFO: `/v3/services` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:55.005590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca5d13-1213-40d4-a19a-d98f8f1cfdd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:55.007605 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca5d13-1213-40d4-a19a-d98f8f1cfdd2 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:55.014488 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 659/1301] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Aug 26 07:34:54 2022] GET /identity/v3/services => generated 2191 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:34:56.953039 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f3649-bc46-49cc-beee-603e221f5bed None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:56.953611 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f3649-bc46-49cc-beee-603e221f5bed None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:56.953611 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f3649-bc46-49cc-beee-603e221f5bed None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:56.954928 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 643/1302] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:34:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:34:56.961663 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010cb59-c2aa-4f5b-9c73-7218f0f1f9dc None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:56.962182 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010cb59-c2aa-4f5b-9c73-7218f0f1f9dc None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:56.962344 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010cb59-c2aa-4f5b-9c73-7218f0f1f9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:56.981689 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-0010cb59-c2aa-4f5b-9c73-7218f0f1f9dc None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:34:56.982903 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-0010cb59-c2aa-4f5b-9c73-7218f0f1f9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:34:57.057371 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 660/1303] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:34:56 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 07:34:57.343274 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f3649-bc46-49cc-beee-603e221f5bed None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:57.440426 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:57.448268 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f3649-bc46-49cc-beee-603e221f5bed None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:57.481840 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241fc6d1-429c-402f-bc2e-13782a89c9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:57.482471 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241fc6d1-429c-402f-bc2e-13782a89c9f0 None admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:57.482747 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241fc6d1-429c-402f-bc2e-13782a89c9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:57.483057 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241fc6d1-429c-402f-bc2e-13782a89c9f0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:57.483625 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241fc6d1-429c-402f-bc2e-13782a89c9f0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:57.484999 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241fc6d1-429c-402f-bc2e-13782a89c9f0 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:57.494724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application [None req-241fc6d1-429c-402f-bc2e-13782a89c9f0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 07:34:57.494724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:34:57.494724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 07:34:57.494724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 07:34:57.494724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 07:34:57.494724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 07:34:57.494724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 07:34:57.494724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:34:57.494724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 07:34:57.494724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:34:57.494724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 07:34:57.494724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:34:57.494724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 07:34:57.494724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 07:34:57.494724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 07:34:57.494724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 07:34:57.494724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 07:34:57.496012 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 07:34:57.496012 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 07:34:57.496012 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 07:34:57.496012 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 07:34:57.496012 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 07:34:57.496012 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 07:34:57.496012 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 07:34:57.496012 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 07:34:57.496012 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 07:34:57.496012 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 07:34:57.496012 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 07:34:57.496012 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 07:34:57.496012 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 07:34:57.496012 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 07:34:57.496012 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 07:34:57.496012 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 07:34:57.496930 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 07:34:57.496930 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application with Lock( Aug 26 07:34:57.496930 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 07:34:57.496930 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self._enter() Aug 26 07:34:57.496930 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 07:34:57.496930 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 07:34:57.496930 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 07:34:57.496930 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application return self.creator() Aug 26 07:34:57.496930 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 07:34:57.496930 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application created_value = creator( Aug 26 07:34:57.496930 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 07:34:57.496930 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 07:34:57.496930 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 07:34:57.496930 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: ERROR keystone.server.flask.application Aug 26 07:34:57.496930 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 644/1304] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Aug 26 07:34:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 07:34:57.502362 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010cb59-c2aa-4f5b-9c73-7218f0f1f9dc None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:57.586130 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:34:57.609446 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010cb59-c2aa-4f5b-9c73-7218f0f1f9dc None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:57.643979 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884e8b7-d7fc-4c60-8ac1-f4dc7e99dd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:57.644599 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884e8b7-d7fc-4c60-8ac1-f4dc7e99dd80 None admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:57.644877 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884e8b7-d7fc-4c60-8ac1-f4dc7e99dd80 None admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:57.645147 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884e8b7-d7fc-4c60-8ac1-f4dc7e99dd80 None admin] PATH_INFO: `/v3/services` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:57.645785 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f884e8b7-d7fc-4c60-8ac1-f4dc7e99dd80 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:34:57.646083 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f884e8b7-d7fc-4c60-8ac1-f4dc7e99dd80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:57.648197 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f884e8b7-d7fc-4c60-8ac1-f4dc7e99dd80 None admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:57.653805 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 661/1305] 10.222.0.42 () {56 vars in 1116 bytes} [Fri Aug 26 07:34:57 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:34:57.660326 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241fc6d1-429c-402f-bc2e-13782a89c9f0 None admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:34:57.770366 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241fc6d1-429c-402f-bc2e-13782a89c9f0 None admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:34:57.805506 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226cb491-992c-402d-972d-d81c2c107248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:34:57.806116 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cb491-992c-402d-972d-d81c2c107248 None admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:34:57.806393 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cb491-992c-402d-972d-d81c2c107248 None admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:34:57.806661 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cb491-992c-402d-972d-d81c2c107248 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:34:57.807347 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226cb491-992c-402d-972d-d81c2c107248 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:34:57.808695 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226cb491-992c-402d-972d-d81c2c107248 None admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:34:57.925879 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 645/1306] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:34:57 2022] POST /identity/v3/endpoints => generated 331 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:35:07.655086 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=30 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:35:07.921099 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:43:35.882602 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a616c7-a93b-4729-8cfe-fd3d1980f917 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:43:35.888273 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a616c7-a93b-4729-8cfe-fd3d1980f917 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:43:35.888273 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a616c7-a93b-4729-8cfe-fd3d1980f917 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:43:35.888273 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 662/1307] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:43:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:43:35.890666 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a8e14-59de-4de2-8097-29deaf2f57b4 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:43:35.891483 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a8e14-59de-4de2-8097-29deaf2f57b4 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:43:35.892048 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a8e14-59de-4de2-8097-29deaf2f57b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:43:36.066268 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-687a8e14-59de-4de2-8097-29deaf2f57b4 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:43:36.069390 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-687a8e14-59de-4de2-8097-29deaf2f57b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:43:36.327506 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 646/1308] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:43:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:43:36.628863 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b1e79-7167-4e51-a456-8c7e8cc645f6 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:43:36.629373 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b1e79-7167-4e51-a456-8c7e8cc645f6 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:43:36.629816 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b1e79-7167-4e51-a456-8c7e8cc645f6 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:43:36.631327 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 663/1309] 10.222.0.42 () {54 vars in 965 bytes} [Fri Aug 26 07:43:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:43:36.638096 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbb60b-9f01-43df-a12b-e3037b232732 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:43:36.638591 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbb60b-9f01-43df-a12b-e3037b232732 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:43:36.639039 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbb60b-9f01-43df-a12b-e3037b232732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:43:36.747874 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-6bbbb60b-9f01-43df-a12b-e3037b232732 None None] MFA Rules not processed for user `a5ea9916c82647f3a645f1a4258f558b`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:43:36.752843 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-6bbbb60b-9f01-43df-a12b-e3037b232732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:43:36.783898 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:43:36.868330 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 647/1310] 10.222.0.42 () {58 vars in 1062 bytes} [Fri Aug 26 07:43:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:43:36.875815 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b1e79-7167-4e51-a456-8c7e8cc645f6 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:43:36.878600 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-f44b1e79-7167-4e51-a456-8c7e8cc645f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:43:37.006543 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b1e79-7167-4e51-a456-8c7e8cc645f6 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:43:37.091257 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2760d9-4da2-40f1-a554-ba9a47672f87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:43:37.092287 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2760d9-4da2-40f1-a554-ba9a47672f87 service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:43:37.092795 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2760d9-4da2-40f1-a554-ba9a47672f87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:43:37.093281 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2760d9-4da2-40f1-a554-ba9a47672f87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:43:37.095490 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-0f2760d9-4da2-40f1-a554-ba9a47672f87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:43:37.157733 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:43:37.221365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2760d9-4da2-40f1-a554-ba9a47672f87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:43:37.223239 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2760d9-4da2-40f1-a554-ba9a47672f87 service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:43:37.249636 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 664/1311] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:43:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:43:39.565710 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac218ec-31d9-4c95-a700-c12c2ac8527f None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:43:39.566313 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac218ec-31d9-4c95-a700-c12c2ac8527f None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:43:39.566313 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac218ec-31d9-4c95-a700-c12c2ac8527f None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:43:39.568849 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 648/1312] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:43:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:43:39.573197 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a02fa-0a64-4f5d-acbd-7ec36920f1a2 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:43:39.573641 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a02fa-0a64-4f5d-acbd-7ec36920f1a2 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:43:39.573738 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a02fa-0a64-4f5d-acbd-7ec36920f1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:43:39.646164 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-266a02fa-0a64-4f5d-acbd-7ec36920f1a2 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:43:39.647420 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-266a02fa-0a64-4f5d-acbd-7ec36920f1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:43:39.754392 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 665/1313] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:43:40.042305 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac218ec-31d9-4c95-a700-c12c2ac8527f None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:43:40.043960 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-3ac218ec-31d9-4c95-a700-c12c2ac8527f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:43:40.149353 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac218ec-31d9-4c95-a700-c12c2ac8527f None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:43:40.221756 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:43:40.225389 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d921ee-0e4f-4bda-b599-78c72d08553f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:43:40.226117 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d921ee-0e4f-4bda-b599-78c72d08553f service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:43:40.226497 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d921ee-0e4f-4bda-b599-78c72d08553f service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:43:40.227099 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d921ee-0e4f-4bda-b599-78c72d08553f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:43:40.228738 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-b6d921ee-0e4f-4bda-b599-78c72d08553f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:43:40.343056 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d921ee-0e4f-4bda-b599-78c72d08553f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:43:40.344503 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d921ee-0e4f-4bda-b599-78c72d08553f service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:43:40.363525 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 649/1314] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:43:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:43:42.815266 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc034df-f532-43ff-9250-fe8c1a12887f None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:43:42.815774 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc034df-f532-43ff-9250-fe8c1a12887f None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:43:42.815900 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc034df-f532-43ff-9250-fe8c1a12887f None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:43:42.817130 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 666/1315] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:43:42.822478 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d66e36-c94e-468c-b6b7-28b7e0c0917f None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:43:42.822866 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d66e36-c94e-468c-b6b7-28b7e0c0917f None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:43:42.823073 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d66e36-c94e-468c-b6b7-28b7e0c0917f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:43:42.888888 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-36d66e36-c94e-468c-b6b7-28b7e0c0917f None None] MFA Rules not processed for user `34b57a5a2a6d428493fc9e9f0cc5a6ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:43:42.890106 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-36d66e36-c94e-468c-b6b7-28b7e0c0917f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:43:42.942537 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:43:42.988025 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 650/1316] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:43:42 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:43:43.276360 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc034df-f532-43ff-9250-fe8c1a12887f None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:43:43.277941 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-dfc034df-f532-43ff-9250-fe8c1a12887f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:43:43.288740 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:43:43.382429 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc034df-f532-43ff-9250-fe8c1a12887f None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:43:43.459781 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c3069-24dd-40ea-a7ba-1855b3468fb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:43:43.460743 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c3069-24dd-40ea-a7ba-1855b3468fb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:43:43.461200 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c3069-24dd-40ea-a7ba-1855b3468fb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:43:43.461771 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c3069-24dd-40ea-a7ba-1855b3468fb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:43:43.464246 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-c60c3069-24dd-40ea-a7ba-1855b3468fb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:43:43.545195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:43:43.592373 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60c3069-24dd-40ea-a7ba-1855b3468fb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:43:43.593807 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60c3069-24dd-40ea-a7ba-1855b3468fb3 service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:43:43.612356 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 667/1317] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:43:43 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:43:46.296700 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5fabc9-7f5a-4d67-9b7d-88a681d4e7a1 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:43:46.297254 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5fabc9-7f5a-4d67-9b7d-88a681d4e7a1 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:43:46.297254 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5fabc9-7f5a-4d67-9b7d-88a681d4e7a1 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:43:46.298685 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 651/1318] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:43:46.304010 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54d5bc-a78b-498b-bb6d-4d02ccc5e764 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:43:46.304435 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54d5bc-a78b-498b-bb6d-4d02ccc5e764 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:43:46.304547 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54d5bc-a78b-498b-bb6d-4d02ccc5e764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:43:46.371069 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-4f54d5bc-a78b-498b-bb6d-4d02ccc5e764 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:43:46.372308 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-4f54d5bc-a78b-498b-bb6d-4d02ccc5e764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:43:46.482270 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 668/1319] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:43:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:43:46.769239 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5fabc9-7f5a-4d67-9b7d-88a681d4e7a1 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:43:46.770783 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-1b5fabc9-7f5a-4d67-9b7d-88a681d4e7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:43:46.882352 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5fabc9-7f5a-4d67-9b7d-88a681d4e7a1 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:43:46.957722 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00338144-a546-4089-8ff0-87739114bf3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:43:46.958329 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00338144-a546-4089-8ff0-87739114bf3d service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:43:46.958605 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00338144-a546-4089-8ff0-87739114bf3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:43:46.958874 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00338144-a546-4089-8ff0-87739114bf3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:43:46.960508 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-00338144-a546-4089-8ff0-87739114bf3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:43:46.967759 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:43:47.068278 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00338144-a546-4089-8ff0-87739114bf3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:43:47.069633 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00338144-a546-4089-8ff0-87739114bf3d service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:43:47.087983 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 652/1320] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:43:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:43:50.113496 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2892a0-3eea-4ed1-a0a6-94c5b089c553 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:43:50.114003 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2892a0-3eea-4ed1-a0a6-94c5b089c553 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:43:50.114113 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2892a0-3eea-4ed1-a0a6-94c5b089c553 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:43:50.115451 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 669/1321] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:43:50.120858 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93d3d3-e4c2-42cc-a1a7-861ffd3dbd5f None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:43:50.121254 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93d3d3-e4c2-42cc-a1a7-861ffd3dbd5f None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:43:50.121479 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93d3d3-e4c2-42cc-a1a7-861ffd3dbd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:43:50.190681 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-ea93d3d3-e4c2-42cc-a1a7-861ffd3dbd5f None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:43:50.191967 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-ea93d3d3-e4c2-42cc-a1a7-861ffd3dbd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:43:50.253001 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:43:50.294783 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 653/1322] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:43:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:43:50.596428 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2892a0-3eea-4ed1-a0a6-94c5b089c553 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:43:50.597972 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-de2892a0-3eea-4ed1-a0a6-94c5b089c553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:43:50.618638 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:43:50.705238 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2892a0-3eea-4ed1-a0a6-94c5b089c553 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:43:50.783840 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55c2a9-6220-4e4e-85dd-c9bcc6fd2ac1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:43:50.784237 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55c2a9-6220-4e4e-85dd-c9bcc6fd2ac1 service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:43:50.784514 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55c2a9-6220-4e4e-85dd-c9bcc6fd2ac1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:43:50.784779 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55c2a9-6220-4e4e-85dd-c9bcc6fd2ac1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:43:50.786393 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-bd55c2a9-6220-4e4e-85dd-c9bcc6fd2ac1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:43:50.859321 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:43:50.898643 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd55c2a9-6220-4e4e-85dd-c9bcc6fd2ac1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:43:50.900127 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd55c2a9-6220-4e4e-85dd-c9bcc6fd2ac1 service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:43:50.918816 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 670/1323] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:43:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:43:52.921180 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40139c70-fad8-4734-9fcc-f3d8ead8447b None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:43:52.921787 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40139c70-fad8-4734-9fcc-f3d8ead8447b None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:43:52.921787 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40139c70-fad8-4734-9fcc-f3d8ead8447b None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:43:52.923454 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 654/1324] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:43:52.928518 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6c896-a779-41d7-8789-3b64a2aea7c3 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:43:52.928910 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6c896-a779-41d7-8789-3b64a2aea7c3 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:43:52.929056 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6c896-a779-41d7-8789-3b64a2aea7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:43:52.995759 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-bfa6c896-a779-41d7-8789-3b64a2aea7c3 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:43:52.996936 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-bfa6c896-a779-41d7-8789-3b64a2aea7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:43:53.092153 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 671/1325] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:43:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:43:53.375426 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40139c70-fad8-4734-9fcc-f3d8ead8447b None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:43:53.377136 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-40139c70-fad8-4734-9fcc-f3d8ead8447b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:43:53.484560 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40139c70-fad8-4734-9fcc-f3d8ead8447b None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:43:53.565446 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a8c3c-8dfb-4fbb-a1fe-e68644ccb5eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:43:53.566057 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a8c3c-8dfb-4fbb-a1fe-e68644ccb5eb service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:43:53.566335 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a8c3c-8dfb-4fbb-a1fe-e68644ccb5eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:43:53.566602 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a8c3c-8dfb-4fbb-a1fe-e68644ccb5eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:43:53.568247 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-d62a8c3c-8dfb-4fbb-a1fe-e68644ccb5eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:43:53.587644 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:43:53.681134 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a8c3c-8dfb-4fbb-a1fe-e68644ccb5eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:43:53.682574 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a8c3c-8dfb-4fbb-a1fe-e68644ccb5eb service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:43:53.702107 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 655/1326] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:43:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:43:55.751547 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3222b-39c2-4d2d-b16a-3a160f73f29b None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:43:55.752253 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3222b-39c2-4d2d-b16a-3a160f73f29b None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:43:55.752530 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3222b-39c2-4d2d-b16a-3a160f73f29b None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:43:55.753934 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 672/1327] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:43:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:43:55.762407 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216fd67-9230-44cf-9278-3b040062cc75 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:43:55.762407 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216fd67-9230-44cf-9278-3b040062cc75 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:43:55.762407 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216fd67-9230-44cf-9278-3b040062cc75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:43:55.831634 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-c216fd67-9230-44cf-9278-3b040062cc75 None None] MFA Rules not processed for user `34b57a5a2a6d428493fc9e9f0cc5a6ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:43:55.832856 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-c216fd67-9230-44cf-9278-3b040062cc75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:43:55.900867 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:43:55.933130 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 656/1328] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:43:55 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:43:56.216198 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3222b-39c2-4d2d-b16a-3a160f73f29b None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:43:56.217819 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-99f3222b-39c2-4d2d-b16a-3a160f73f29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:43:56.254005 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:43:56.341768 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3222b-39c2-4d2d-b16a-3a160f73f29b None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:43:56.422100 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0da984-773e-48f3-a3da-391fe1b81e65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:43:56.422667 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0da984-773e-48f3-a3da-391fe1b81e65 service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:43:56.422938 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0da984-773e-48f3-a3da-391fe1b81e65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:43:56.423323 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0da984-773e-48f3-a3da-391fe1b81e65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:43:56.424953 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-af0da984-773e-48f3-a3da-391fe1b81e65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:43:56.511078 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:43:56.545413 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0da984-773e-48f3-a3da-391fe1b81e65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:43:56.546850 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0da984-773e-48f3-a3da-391fe1b81e65 service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:43:56.567200 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 673/1329] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:43:56 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:43:58.932756 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4666c0-d8cb-4121-b442-c193dff51bdc None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:43:58.933293 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4666c0-d8cb-4121-b442-c193dff51bdc None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:43:58.933386 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4666c0-d8cb-4121-b442-c193dff51bdc None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:43:58.934672 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 657/1330] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:43:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:43:58.940490 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a6012-edb4-4dcb-bc73-aaf106150440 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:43:58.940899 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a6012-edb4-4dcb-bc73-aaf106150440 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:43:58.941043 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a6012-edb4-4dcb-bc73-aaf106150440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:43:59.008545 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-a19a6012-edb4-4dcb-bc73-aaf106150440 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:43:59.009762 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-a19a6012-edb4-4dcb-bc73-aaf106150440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:43:59.104819 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 674/1331] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:43:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:43:59.383687 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4666c0-d8cb-4121-b442-c193dff51bdc None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:43:59.385256 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-ea4666c0-d8cb-4121-b442-c193dff51bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:43:59.487848 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4666c0-d8cb-4121-b442-c193dff51bdc None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:43:59.559455 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542a60d-7f77-438a-af2d-4649d70cfdff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:43:59.560058 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542a60d-7f77-438a-af2d-4649d70cfdff service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:43:59.560335 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542a60d-7f77-438a-af2d-4649d70cfdff service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:43:59.560603 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542a60d-7f77-438a-af2d-4649d70cfdff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:43:59.562216 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-a542a60d-7f77-438a-af2d-4649d70cfdff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:43:59.589408 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:43:59.674017 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a542a60d-7f77-438a-af2d-4649d70cfdff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:43:59.675412 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a542a60d-7f77-438a-af2d-4649d70cfdff service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:43:59.693570 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 658/1332] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:43:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:44:01.691227 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cecc1-e37a-429b-8da9-a23b81bb4b5b None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:01.691765 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cecc1-e37a-429b-8da9-a23b81bb4b5b None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:01.691765 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cecc1-e37a-429b-8da9-a23b81bb4b5b None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:01.693078 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 675/1333] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:44:01.698290 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57b8e8-69d3-4766-a8ca-f0d3895831e2 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:01.698673 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57b8e8-69d3-4766-a8ca-f0d3895831e2 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:01.698836 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57b8e8-69d3-4766-a8ca-f0d3895831e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:01.764573 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-eb57b8e8-69d3-4766-a8ca-f0d3895831e2 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:44:01.765239 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-eb57b8e8-69d3-4766-a8ca-f0d3895831e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:01.838758 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:44:01.860638 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 659/1334] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:44:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:44:02.146341 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1cecc1-e37a-429b-8da9-a23b81bb4b5b None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:44:02.147928 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-1f1cecc1-e37a-429b-8da9-a23b81bb4b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:02.187555 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:44:02.251251 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1cecc1-e37a-429b-8da9-a23b81bb4b5b None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:44:02.323204 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361f642-0e24-4af8-b7c8-901658c48749 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:44:02.323807 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361f642-0e24-4af8-b7c8-901658c48749 service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:02.324082 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361f642-0e24-4af8-b7c8-901658c48749 service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:02.324348 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361f642-0e24-4af8-b7c8-901658c48749 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:02.325926 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-4361f642-0e24-4af8-b7c8-901658c48749 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:02.408760 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:44:02.434202 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4361f642-0e24-4af8-b7c8-901658c48749 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:44:02.435688 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4361f642-0e24-4af8-b7c8-901658c48749 service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:44:02.454146 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 676/1335] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:44:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:44:05.020679 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29161439-d7fd-4d42-b091-dfa568c1e0eb None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:05.021269 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29161439-d7fd-4d42-b091-dfa568c1e0eb None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:05.021269 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29161439-d7fd-4d42-b091-dfa568c1e0eb None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:05.022478 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 660/1336] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:44:05.027547 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659c035-41c0-49e4-a3bc-1ce249a3b2fd None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:05.027999 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659c035-41c0-49e4-a3bc-1ce249a3b2fd None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:05.028105 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659c035-41c0-49e4-a3bc-1ce249a3b2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:05.095116 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-d659c035-41c0-49e4-a3bc-1ce249a3b2fd None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:44:05.096315 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-d659c035-41c0-49e4-a3bc-1ce249a3b2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:05.192559 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 677/1337] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:44:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:44:05.479697 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29161439-d7fd-4d42-b091-dfa568c1e0eb None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:44:05.481280 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-29161439-d7fd-4d42-b091-dfa568c1e0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:05.587630 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29161439-d7fd-4d42-b091-dfa568c1e0eb None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:44:05.661051 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f123054-65cc-40e6-9be7-0009f285243e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:44:05.661663 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f123054-65cc-40e6-9be7-0009f285243e service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:05.661943 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f123054-65cc-40e6-9be7-0009f285243e service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:05.662215 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f123054-65cc-40e6-9be7-0009f285243e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:05.663865 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-4f123054-65cc-40e6-9be7-0009f285243e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:05.699723 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:44:05.775235 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f123054-65cc-40e6-9be7-0009f285243e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:44:05.780682 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f123054-65cc-40e6-9be7-0009f285243e service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:44:05.796776 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 661/1338] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:44:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:44:09.991191 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1589b-ec2a-439f-9b9e-9dd0e78cbbca None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:09.991717 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1589b-ec2a-439f-9b9e-9dd0e78cbbca None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:09.991848 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1589b-ec2a-439f-9b9e-9dd0e78cbbca None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:09.993194 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 678/1339] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:44:09.998736 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6f055-b0e1-4130-83a2-3a726b0eceb4 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:09.999331 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6f055-b0e1-4130-83a2-3a726b0eceb4 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:09.999447 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6f055-b0e1-4130-83a2-3a726b0eceb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:10.066664 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-d6f6f055-b0e1-4130-83a2-3a726b0eceb4 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:44:10.067938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-d6f6f055-b0e1-4130-83a2-3a726b0eceb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:10.158498 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:44:10.169508 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 662/1340] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:44:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:44:10.471521 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49ff42-63d0-4235-91d0-ea532d139d77 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:10.471812 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49ff42-63d0-4235-91d0-ea532d139d77 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:10.472116 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49ff42-63d0-4235-91d0-ea532d139d77 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:10.473443 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 679/1341] 10.222.0.42 () {54 vars in 965 bytes} [Fri Aug 26 07:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:44:10.479615 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20114583-bfa2-4183-ad0e-49b7af1802a4 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:10.479899 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20114583-bfa2-4183-ad0e-49b7af1802a4 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:10.480172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20114583-bfa2-4183-ad0e-49b7af1802a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:10.561220 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-20114583-bfa2-4183-ad0e-49b7af1802a4 None None] MFA Rules not processed for user `a5ea9916c82647f3a645f1a4258f558b`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:44:10.562519 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-20114583-bfa2-4183-ad0e-49b7af1802a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:10.640724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 663/1342] 10.222.0.42 () {58 vars in 1062 bytes} [Fri Aug 26 07:44:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:44:10.649692 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49ff42-63d0-4235-91d0-ea532d139d77 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:44:10.651213 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-4c49ff42-63d0-4235-91d0-ea532d139d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:10.701570 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:44:10.760095 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49ff42-63d0-4235-91d0-ea532d139d77 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:44:10.836883 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3008ebf-0575-421a-ae4f-2af137a2633e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:44:10.837496 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3008ebf-0575-421a-ae4f-2af137a2633e service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:10.837777 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3008ebf-0575-421a-ae4f-2af137a2633e service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:10.838053 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3008ebf-0575-421a-ae4f-2af137a2633e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:10.839681 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-d3008ebf-0575-421a-ae4f-2af137a2633e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:10.935664 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:44:10.957242 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3008ebf-0575-421a-ae4f-2af137a2633e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:44:10.958681 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3008ebf-0575-421a-ae4f-2af137a2633e service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:44:10.978164 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 680/1343] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:44:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:44:14.515518 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35434e65-1aaa-4bf5-abfd-bddf98d070c2 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:14.516046 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35434e65-1aaa-4bf5-abfd-bddf98d070c2 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:14.516046 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35434e65-1aaa-4bf5-abfd-bddf98d070c2 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:14.517425 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 664/1344] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:44:14.523554 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb578b1f-280c-4c42-a42b-daf1cb7cc47e None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:14.524115 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb578b1f-280c-4c42-a42b-daf1cb7cc47e None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:14.524393 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb578b1f-280c-4c42-a42b-daf1cb7cc47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:14.616019 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-fb578b1f-280c-4c42-a42b-daf1cb7cc47e None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:44:14.617311 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-fb578b1f-280c-4c42-a42b-daf1cb7cc47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:14.730948 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 681/1345] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:44:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:44:15.044670 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35434e65-1aaa-4bf5-abfd-bddf98d070c2 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:44:15.046330 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-35434e65-1aaa-4bf5-abfd-bddf98d070c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:15.171548 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:44:15.196835 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35434e65-1aaa-4bf5-abfd-bddf98d070c2 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:44:15.286704 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58283f1-3f6a-4731-a350-af587385315a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:44:15.287354 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58283f1-3f6a-4731-a350-af587385315a service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:15.287631 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58283f1-3f6a-4731-a350-af587385315a service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:15.287901 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58283f1-3f6a-4731-a350-af587385315a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:15.289520 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-e58283f1-3f6a-4731-a350-af587385315a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:15.416292 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58283f1-3f6a-4731-a350-af587385315a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:44:15.417778 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58283f1-3f6a-4731-a350-af587385315a service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:44:15.437260 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 665/1346] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:44:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:44:19.666240 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1197d-bdf6-4994-bf16-e112f17f284b None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:19.666812 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1197d-bdf6-4994-bf16-e112f17f284b None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:19.666812 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1197d-bdf6-4994-bf16-e112f17f284b None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:19.668295 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 682/1347] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:44:19.674503 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c44de-f608-45c0-9f0a-0a51780ce1f5 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:19.675032 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c44de-f608-45c0-9f0a-0a51780ce1f5 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:19.675157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c44de-f608-45c0-9f0a-0a51780ce1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:19.691852 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:44:19.751659 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-046c44de-f608-45c0-9f0a-0a51780ce1f5 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:44:19.752901 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-046c44de-f608-45c0-9f0a-0a51780ce1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:19.859341 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 666/1348] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:44:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:44:20.145846 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1197d-bdf6-4994-bf16-e112f17f284b None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:44:20.147390 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-c4b1197d-bdf6-4994-bf16-e112f17f284b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:20.213613 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:44:20.267305 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1197d-bdf6-4994-bf16-e112f17f284b None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:44:20.344720 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09363f-8c04-4dd5-8630-5cc283546e3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:44:20.345337 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09363f-8c04-4dd5-8630-5cc283546e3d service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:20.345616 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09363f-8c04-4dd5-8630-5cc283546e3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:20.345897 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09363f-8c04-4dd5-8630-5cc283546e3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:20.347566 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-bb09363f-8c04-4dd5-8630-5cc283546e3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:20.462850 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:44:20.466317 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09363f-8c04-4dd5-8630-5cc283546e3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:44:20.467847 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09363f-8c04-4dd5-8630-5cc283546e3d service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:44:20.487298 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 683/1349] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:44:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:44:25.402789 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb57c56-fbe7-4f3b-afd1-c3fa60c6fbc5 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:25.404658 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb57c56-fbe7-4f3b-afd1-c3fa60c6fbc5 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:25.405173 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb57c56-fbe7-4f3b-afd1-c3fa60c6fbc5 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:25.413152 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 667/1350] 10.222.0.42 () {54 vars in 921 bytes} [Fri Aug 26 07:44:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:44:25.414174 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987fe2b-8507-4a5f-89da-83a6d334d904 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:25.414174 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987fe2b-8507-4a5f-89da-83a6d334d904 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:25.414616 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987fe2b-8507-4a5f-89da-83a6d334d904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:25.508053 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-a987fe2b-8507-4a5f-89da-83a6d334d904 None None] MFA Rules not processed for user `f6c2bc293f1b4daca83e8d6dff66a316`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:44:25.509454 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-a987fe2b-8507-4a5f-89da-83a6d334d904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:25.687793 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 684/1351] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Aug 26 07:44:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:44:29.857419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=59 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:44:29.895341 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee996d73-8248-4c0a-b971-bc6e60534663 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:29.895655 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee996d73-8248-4c0a-b971-bc6e60534663 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:29.895914 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee996d73-8248-4c0a-b971-bc6e60534663 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:29.897360 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 668/1352] 10.222.0.42 () {54 vars in 921 bytes} [Fri Aug 26 07:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:44:29.902465 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b3d6a-e1cc-4946-8894-5b15931e006e None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:29.902942 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b3d6a-e1cc-4946-8894-5b15931e006e None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:29.903243 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b3d6a-e1cc-4946-8894-5b15931e006e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:29.959516 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:44:29.983366 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-838b3d6a-e1cc-4946-8894-5b15931e006e None None] MFA Rules not processed for user `f6c2bc293f1b4daca83e8d6dff66a316`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:44:29.985298 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-838b3d6a-e1cc-4946-8894-5b15931e006e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:30.100688 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 685/1353] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Aug 26 07:44:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:44:31.523772 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f5b01-c156-4fb9-b26b-4cdbcfc3a249 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:31.524301 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f5b01-c156-4fb9-b26b-4cdbcfc3a249 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:31.524540 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f5b01-c156-4fb9-b26b-4cdbcfc3a249 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:31.525919 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 669/1354] 10.222.0.42 () {54 vars in 921 bytes} [Fri Aug 26 07:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:44:31.532133 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b03691-1907-49a4-968b-1e3c9be2f7f6 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:31.532563 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b03691-1907-49a4-968b-1e3c9be2f7f6 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:31.532679 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b03691-1907-49a4-968b-1e3c9be2f7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:31.611079 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-b8b03691-1907-49a4-968b-1e3c9be2f7f6 None None] MFA Rules not processed for user `f6c2bc293f1b4daca83e8d6dff66a316`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:44:31.612297 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-b8b03691-1907-49a4-968b-1e3c9be2f7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:31.654352 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:44:31.721655 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 686/1355] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Aug 26 07:44:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:44:35.355339 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85910df-fa72-4def-b374-1fb8635c7eed None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:35.356292 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85910df-fa72-4def-b374-1fb8635c7eed None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:35.356292 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85910df-fa72-4def-b374-1fb8635c7eed None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:35.357383 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 670/1356] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:44:35.365491 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bff6e6-c5fe-4181-853e-1f29a2c80a22 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:35.365942 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bff6e6-c5fe-4181-853e-1f29a2c80a22 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:35.366041 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bff6e6-c5fe-4181-853e-1f29a2c80a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:35.450383 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-c2bff6e6-c5fe-4181-853e-1f29a2c80a22 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:44:35.452510 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-c2bff6e6-c5fe-4181-853e-1f29a2c80a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:35.584624 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 687/1357] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:44:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:44:35.886018 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ac5a7-09e2-464d-b4f9-50f9b85bf041 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:35.886307 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ac5a7-09e2-464d-b4f9-50f9b85bf041 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:35.886583 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ac5a7-09e2-464d-b4f9-50f9b85bf041 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:35.888197 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 671/1358] 10.222.0.42 () {54 vars in 962 bytes} [Fri Aug 26 07:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:44:35.896921 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953113d-90cc-4412-814e-cad2f46d42fd None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:35.898428 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953113d-90cc-4412-814e-cad2f46d42fd None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:35.898428 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953113d-90cc-4412-814e-cad2f46d42fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:35.919538 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:44:35.991545 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-9953113d-90cc-4412-814e-cad2f46d42fd None None] MFA Rules not processed for user `bc92c0a0a2cc4722868e6877bac93ada`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:44:35.992767 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-9953113d-90cc-4412-814e-cad2f46d42fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:36.115805 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 688/1359] 10.222.0.42 () {58 vars in 1059 bytes} [Fri Aug 26 07:44:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:44:36.123497 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ac5a7-09e2-464d-b4f9-50f9b85bf041 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:44:36.125856 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-651ac5a7-09e2-464d-b4f9-50f9b85bf041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:36.299810 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ac5a7-09e2-464d-b4f9-50f9b85bf041 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:44:36.409066 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:44:36.457371 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676517a7-ea9e-42a6-810d-fae0c7f10edd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc92c0a0a2cc4722868e6877bac93ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:44:36.457986 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676517a7-ea9e-42a6-810d-fae0c7f10edd service nova] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:36.458265 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676517a7-ea9e-42a6-810d-fae0c7f10edd service nova] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:36.458536 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676517a7-ea9e-42a6-810d-fae0c7f10edd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:36.460552 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-676517a7-ea9e-42a6-810d-fae0c7f10edd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:36.585968 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676517a7-ea9e-42a6-810d-fae0c7f10edd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:44:36.587702 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676517a7-ea9e-42a6-810d-fae0c7f10edd service nova] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:44:36.610210 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 672/1360] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:44:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 07:44:38.771302 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72e771-f426-4081-a07a-1a57cc5e0cef None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:38.771747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72e771-f426-4081-a07a-1a57cc5e0cef None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:38.771863 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72e771-f426-4081-a07a-1a57cc5e0cef None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:38.773318 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 689/1361] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:44:38.778407 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e8119-97a1-4895-8cef-75856c7aa8d8 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:38.778847 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e8119-97a1-4895-8cef-75856c7aa8d8 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:38.778951 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e8119-97a1-4895-8cef-75856c7aa8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:38.851007 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-fa9e8119-97a1-4895-8cef-75856c7aa8d8 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:44:38.852230 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-fa9e8119-97a1-4895-8cef-75856c7aa8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:38.892395 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:44:38.967402 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 673/1362] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:44:39.257447 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72e771-f426-4081-a07a-1a57cc5e0cef None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:44:39.258950 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-bc72e771-f426-4081-a07a-1a57cc5e0cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:39.332015 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:44:39.421676 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72e771-f426-4081-a07a-1a57cc5e0cef None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:44:39.546162 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd2917-1f4a-48c7-9c84-80a689d8c28a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc92c0a0a2cc4722868e6877bac93ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:44:39.547469 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd2917-1f4a-48c7-9c84-80a689d8c28a service nova] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:39.547761 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd2917-1f4a-48c7-9c84-80a689d8c28a service nova] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:39.548041 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd2917-1f4a-48c7-9c84-80a689d8c28a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:39.549698 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-83bd2917-1f4a-48c7-9c84-80a689d8c28a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:39.577901 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:44:39.657665 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd2917-1f4a-48c7-9c84-80a689d8c28a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:44:39.659547 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd2917-1f4a-48c7-9c84-80a689d8c28a service nova] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:44:39.680811 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 690/1363] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:44:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:44:42.134516 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0ca48-4903-4ba2-ac01-d594b6b73dbb None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:42.135071 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0ca48-4903-4ba2-ac01-d594b6b73dbb None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:42.135071 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0ca48-4903-4ba2-ac01-d594b6b73dbb None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:42.136428 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 674/1364] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:44:42.142512 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbcfcb-7beb-47f8-b42b-ee6f14051c2e None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:42.142922 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbcfcb-7beb-47f8-b42b-ee6f14051c2e None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:42.143119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbcfcb-7beb-47f8-b42b-ee6f14051c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:42.214376 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-54cbcfcb-7beb-47f8-b42b-ee6f14051c2e None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:44:42.215608 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-54cbcfcb-7beb-47f8-b42b-ee6f14051c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:42.324487 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:44:42.336241 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 691/1365] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:44:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:44:42.625093 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856c975-c097-47e7-beb8-cfc3b041be7c None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:42.625542 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856c975-c097-47e7-beb8-cfc3b041be7c None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:42.625897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856c975-c097-47e7-beb8-cfc3b041be7c None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:42.627354 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 675/1366] 10.222.0.42 () {54 vars in 962 bytes} [Fri Aug 26 07:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:44:42.633111 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6793d-458b-4c2e-8150-e10f256c305d None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:42.633401 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6793d-458b-4c2e-8150-e10f256c305d None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:42.633695 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6793d-458b-4c2e-8150-e10f256c305d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:42.715539 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-b1b6793d-458b-4c2e-8150-e10f256c305d None None] MFA Rules not processed for user `bc92c0a0a2cc4722868e6877bac93ada`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:44:42.716740 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-b1b6793d-458b-4c2e-8150-e10f256c305d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:42.855404 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 692/1367] 10.222.0.42 () {58 vars in 1059 bytes} [Fri Aug 26 07:44:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:44:42.863667 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856c975-c097-47e7-beb8-cfc3b041be7c None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:44:42.865481 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-b856c975-c097-47e7-beb8-cfc3b041be7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:43.022912 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856c975-c097-47e7-beb8-cfc3b041be7c None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:44:43.043429 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:44:43.146912 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a902a-4bde-41a1-884e-d7d3e193511f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc92c0a0a2cc4722868e6877bac93ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:44:43.147630 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a902a-4bde-41a1-884e-d7d3e193511f service nova] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:43.147879 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a902a-4bde-41a1-884e-d7d3e193511f service nova] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:43.148078 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a902a-4bde-41a1-884e-d7d3e193511f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:43.149658 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-f04a902a-4bde-41a1-884e-d7d3e193511f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:43.245702 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04a902a-4bde-41a1-884e-d7d3e193511f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:44:43.248541 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04a902a-4bde-41a1-884e-d7d3e193511f service nova] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:44:43.269183 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 676/1368] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:44:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:44:43.754587 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db0d81-cc48-4a3a-bc73-445dcc3a9899 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:43.755122 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db0d81-cc48-4a3a-bc73-445dcc3a9899 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:43.755122 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db0d81-cc48-4a3a-bc73-445dcc3a9899 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:43.756409 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 693/1369] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:44:43.765174 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e0eed-6ec9-48d5-8881-3831fc86c8d2 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:43.767748 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e0eed-6ec9-48d5-8881-3831fc86c8d2 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:43.768091 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e0eed-6ec9-48d5-8881-3831fc86c8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:43.801399 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:44:43.843062 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-020e0eed-6ec9-48d5-8881-3831fc86c8d2 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:44:43.844457 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-020e0eed-6ec9-48d5-8881-3831fc86c8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:43.946387 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 677/1370] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:44:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:44:44.532423 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b93c72-189e-43b5-9342-49b5d55c7ff8 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:44.532423 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b93c72-189e-43b5-9342-49b5d55c7ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:44.532423 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b93c72-189e-43b5-9342-49b5d55c7ff8 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:44.533922 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 694/1371] 10.222.0.42 () {54 vars in 964 bytes} [Fri Aug 26 07:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:44:44.538917 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8c56e-a039-45c5-b008-da12a6f5c994 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:44.539521 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8c56e-a039-45c5-b008-da12a6f5c994 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:44.539521 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8c56e-a039-45c5-b008-da12a6f5c994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:44.620552 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-6eb8c56e-a039-45c5-b008-da12a6f5c994 None None] MFA Rules not processed for user `f23fe4069f39499c9ed8e27566eddc77`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:44:44.621767 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-6eb8c56e-a039-45c5-b008-da12a6f5c994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:44.673473 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:44:44.706835 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 678/1372] 10.222.0.42 () {58 vars in 1061 bytes} [Fri Aug 26 07:44:44 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:44:44.714345 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b93c72-189e-43b5-9342-49b5d55c7ff8 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:44:44.715887 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-35b93c72-189e-43b5-9342-49b5d55c7ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:44.781825 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:44:44.857472 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b93c72-189e-43b5-9342-49b5d55c7ff8 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:44:44.939990 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473df03-e365-49ab-8298-f0dcaace5538 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:44:44.939990 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473df03-e365-49ab-8298-f0dcaace5538 service cinder] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:44.939990 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473df03-e365-49ab-8298-f0dcaace5538 service cinder] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:44.939990 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473df03-e365-49ab-8298-f0dcaace5538 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:44.941103 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-8473df03-e365-49ab-8298-f0dcaace5538 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:45.068135 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:44:45.083259 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473df03-e365-49ab-8298-f0dcaace5538 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:44:45.084918 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473df03-e365-49ab-8298-f0dcaace5538 service cinder] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:44:45.107054 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 695/1373] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:44:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:44:45.526221 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489c8b6-62bc-467a-8a2c-c2fd3f8c5c2d None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:45.526617 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489c8b6-62bc-467a-8a2c-c2fd3f8c5c2d None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:45.526967 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489c8b6-62bc-467a-8a2c-c2fd3f8c5c2d None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:45.528428 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 679/1374] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:44:45.533946 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfa9b2-0fcc-4c02-b44b-8348d726e14e None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:45.534236 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfa9b2-0fcc-4c02-b44b-8348d726e14e None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:45.534510 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfa9b2-0fcc-4c02-b44b-8348d726e14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:45.602473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-9bdfa9b2-0fcc-4c02-b44b-8348d726e14e None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:44:45.603717 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-9bdfa9b2-0fcc-4c02-b44b-8348d726e14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:45.704530 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 696/1375] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:44:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:44:46.000820 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489c8b6-62bc-467a-8a2c-c2fd3f8c5c2d None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:44:46.002475 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-f489c8b6-62bc-467a-8a2c-c2fd3f8c5c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:46.150871 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489c8b6-62bc-467a-8a2c-c2fd3f8c5c2d None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:44:46.204963 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:44:46.270019 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e90175-5029-4d9f-8dcf-ca24ccf52261 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc92c0a0a2cc4722868e6877bac93ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:44:46.270634 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e90175-5029-4d9f-8dcf-ca24ccf52261 service nova] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:46.270915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e90175-5029-4d9f-8dcf-ca24ccf52261 service nova] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:46.271233 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e90175-5029-4d9f-8dcf-ca24ccf52261 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:46.272992 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-38e90175-5029-4d9f-8dcf-ca24ccf52261 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:46.363529 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e90175-5029-4d9f-8dcf-ca24ccf52261 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:44:46.365140 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e90175-5029-4d9f-8dcf-ca24ccf52261 service nova] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:44:46.384017 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 680/1376] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:44:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:44:48.495798 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277fb35-d89c-44b7-af2d-1b7b7f7f850f None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:48.496566 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277fb35-d89c-44b7-af2d-1b7b7f7f850f None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:48.496566 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277fb35-d89c-44b7-af2d-1b7b7f7f850f None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:48.497712 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 697/1377] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:44:48.505265 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb69e9b-a9ec-4fdf-9731-80d91499f3c1 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:48.505894 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb69e9b-a9ec-4fdf-9731-80d91499f3c1 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:48.506458 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb69e9b-a9ec-4fdf-9731-80d91499f3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:48.583828 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-4bb69e9b-a9ec-4fdf-9731-80d91499f3c1 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:44:48.584959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-4bb69e9b-a9ec-4fdf-9731-80d91499f3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:48.591755 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:44:48.701097 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 681/1378] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:44:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:44:49.021373 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277fb35-d89c-44b7-af2d-1b7b7f7f850f None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:44:49.023010 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-7277fb35-d89c-44b7-af2d-1b7b7f7f850f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:49.099929 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:44:49.207424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277fb35-d89c-44b7-af2d-1b7b7f7f850f None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:44:49.362374 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5afd65-d886-4c20-924c-d09c229bf328 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc92c0a0a2cc4722868e6877bac93ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:44:49.362967 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5afd65-d886-4c20-924c-d09c229bf328 service nova] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:49.363271 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5afd65-d886-4c20-924c-d09c229bf328 service nova] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:49.363541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5afd65-d886-4c20-924c-d09c229bf328 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:49.365303 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-5a5afd65-d886-4c20-924c-d09c229bf328 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:49.387661 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:44:49.471468 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5afd65-d886-4c20-924c-d09c229bf328 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:44:49.473564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5afd65-d886-4c20-924c-d09c229bf328 service nova] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:44:49.495407 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 698/1379] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:44:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:44:51.590462 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2929df-b190-44c1-9442-5d021a655c2e None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:51.591001 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2929df-b190-44c1-9442-5d021a655c2e None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:51.591001 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2929df-b190-44c1-9442-5d021a655c2e None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:51.592498 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 682/1380] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:44:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:44:51.597827 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1262a04-2bda-4c00-8fd0-229945489256 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:51.598626 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1262a04-2bda-4c00-8fd0-229945489256 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:51.598905 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1262a04-2bda-4c00-8fd0-229945489256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:51.674635 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-c1262a04-2bda-4c00-8fd0-229945489256 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:44:51.676670 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-c1262a04-2bda-4c00-8fd0-229945489256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:51.793483 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:44:51.800350 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 699/1381] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:44:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:44:52.096507 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2929df-b190-44c1-9442-5d021a655c2e None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:44:52.098062 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-fa2929df-b190-44c1-9442-5d021a655c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:52.247699 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:44:52.258949 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2929df-b190-44c1-9442-5d021a655c2e None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:44:52.381106 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64251485-faba-43e9-8fbc-f5195fb13ac7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc92c0a0a2cc4722868e6877bac93ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:44:52.381706 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64251485-faba-43e9-8fbc-f5195fb13ac7 service nova] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:52.381977 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64251485-faba-43e9-8fbc-f5195fb13ac7 service nova] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:52.382243 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64251485-faba-43e9-8fbc-f5195fb13ac7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:52.383864 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-64251485-faba-43e9-8fbc-f5195fb13ac7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:52.478080 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64251485-faba-43e9-8fbc-f5195fb13ac7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:44:52.479710 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64251485-faba-43e9-8fbc-f5195fb13ac7 service nova] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:44:52.491573 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:44:52.500958 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 683/1382] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:44:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 07:44:54.845558 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589e86b-d398-4895-8eaa-ca4edc5d5eb4 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:54.846264 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589e86b-d398-4895-8eaa-ca4edc5d5eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:54.846372 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589e86b-d398-4895-8eaa-ca4edc5d5eb4 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:54.848028 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 700/1383] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:44:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:44:54.854571 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48fb1c-70bd-43aa-bb6c-f91603f709fc None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:54.855063 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48fb1c-70bd-43aa-bb6c-f91603f709fc None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:54.855173 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48fb1c-70bd-43aa-bb6c-f91603f709fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:54.924099 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-9b48fb1c-70bd-43aa-bb6c-f91603f709fc None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:44:54.925331 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-9b48fb1c-70bd-43aa-bb6c-f91603f709fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:55.047984 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 684/1384] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:44:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:44:55.406731 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589e86b-d398-4895-8eaa-ca4edc5d5eb4 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:44:55.408866 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-a589e86b-d398-4895-8eaa-ca4edc5d5eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:55.598941 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589e86b-d398-4895-8eaa-ca4edc5d5eb4 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:44:55.668042 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:44:55.716152 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607cb688-fcca-45f4-9134-3e4872b8449e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc92c0a0a2cc4722868e6877bac93ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:44:55.718384 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607cb688-fcca-45f4-9134-3e4872b8449e service nova] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:55.718384 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607cb688-fcca-45f4-9134-3e4872b8449e service nova] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:55.718384 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607cb688-fcca-45f4-9134-3e4872b8449e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:55.719826 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-607cb688-fcca-45f4-9134-3e4872b8449e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:55.819022 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607cb688-fcca-45f4-9134-3e4872b8449e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:44:55.820661 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607cb688-fcca-45f4-9134-3e4872b8449e service nova] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:44:55.839697 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 701/1385] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:44:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:44:57.971318 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406e0d6-323f-4a86-8969-ec57273ff191 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:57.971913 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406e0d6-323f-4a86-8969-ec57273ff191 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:57.972050 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406e0d6-323f-4a86-8969-ec57273ff191 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:57.973763 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 685/1386] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:44:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:44:57.979397 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3b060-d360-4570-b2bf-71736be65fa0 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:57.979979 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3b060-d360-4570-b2bf-71736be65fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:57.980096 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3b060-d360-4570-b2bf-71736be65fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:58.078308 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-d9e3b060-d360-4570-b2bf-71736be65fa0 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:44:58.079805 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-d9e3b060-d360-4570-b2bf-71736be65fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:58.121855 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:44:58.209462 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 702/1387] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:44:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:44:58.519899 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406e0d6-323f-4a86-8969-ec57273ff191 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:44:58.521645 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-0406e0d6-323f-4a86-8969-ec57273ff191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:58.602058 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:44:58.688328 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406e0d6-323f-4a86-8969-ec57273ff191 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:44:58.809706 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4639f-859d-4c1c-8ca0-ba73a9f11ce7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc92c0a0a2cc4722868e6877bac93ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:44:58.810326 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4639f-859d-4c1c-8ca0-ba73a9f11ce7 service nova] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:44:58.810738 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4639f-859d-4c1c-8ca0-ba73a9f11ce7 service nova] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:44:58.811074 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4639f-859d-4c1c-8ca0-ba73a9f11ce7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:44:58.812705 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-87f4639f-859d-4c1c-8ca0-ba73a9f11ce7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:44:58.852982 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:44:58.905513 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f4639f-859d-4c1c-8ca0-ba73a9f11ce7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:44:58.907156 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f4639f-859d-4c1c-8ca0-ba73a9f11ce7 service nova] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:44:58.925385 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 686/1388] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:44:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:45:00.562325 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f01fc-bd21-4d14-addd-62fe125b9db1 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:00.562843 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f01fc-bd21-4d14-addd-62fe125b9db1 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:00.562843 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f01fc-bd21-4d14-addd-62fe125b9db1 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:00.564094 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 703/1389] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:45:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:45:00.569438 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af8c31-e4f1-4e4b-baf9-1fe43e75e016 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:00.569856 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af8c31-e4f1-4e4b-baf9-1fe43e75e016 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:00.569989 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af8c31-e4f1-4e4b-baf9-1fe43e75e016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:00.637199 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-75af8c31-e4f1-4e4b-baf9-1fe43e75e016 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:45:00.638425 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-75af8c31-e4f1-4e4b-baf9-1fe43e75e016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:00.740979 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 687/1390] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:45:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:45:01.002953 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48677426-eadc-4a89-b4f4-fc1fec7fc89a None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:01.003276 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48677426-eadc-4a89-b4f4-fc1fec7fc89a None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:01.003560 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48677426-eadc-4a89-b4f4-fc1fec7fc89a None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:01.004981 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 704/1391] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:45:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:45:01.010305 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44062f81-3b1c-4231-9b91-5c6e54af8067 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:01.010590 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44062f81-3b1c-4231-9b91-5c6e54af8067 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:01.010861 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44062f81-3b1c-4231-9b91-5c6e54af8067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:01.030140 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:01.046959 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668741b8-01ce-4ea1-be16-80bfa9983232 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:01.047244 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668741b8-01ce-4ea1-be16-80bfa9983232 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:01.047564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668741b8-01ce-4ea1-be16-80bfa9983232 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:01.049058 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 705/1392] 10.222.0.42 () {54 vars in 967 bytes} [Fri Aug 26 07:45:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 07:45:01.056270 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a631a-d037-4f78-a7e6-35655669ca1c None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:01.056679 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a631a-d037-4f78-a7e6-35655669ca1c None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:01.057061 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a631a-d037-4f78-a7e6-35655669ca1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:01.099356 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-44062f81-3b1c-4231-9b91-5c6e54af8067 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:45:01.100598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-44062f81-3b1c-4231-9b91-5c6e54af8067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:01.155409 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-ae0a631a-d037-4f78-a7e6-35655669ca1c None None] MFA Rules not processed for user `2df7725203304d8fbe3a768656cabf23`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:45:01.156795 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-ae0a631a-d037-4f78-a7e6-35655669ca1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:01.214530 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 688/1393] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:45:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:45:01.238801 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 706/1394] 10.222.0.42 () {58 vars in 1064 bytes} [Fri Aug 26 07:45:01 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:45:01.248539 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44062f81-3b1c-4231-9b91-5c6e54af8067 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:45:01.248539 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-44062f81-3b1c-4231-9b91-5c6e54af8067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:01.353800 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44062f81-3b1c-4231-9b91-5c6e54af8067 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:45:01.362220 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:01.434305 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414cd527-9afb-4168-b8a1-ec5d17b9f5be service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df7725203304d8fbe3a768656cabf23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:45:01.435100 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cd527-9afb-4168-b8a1-ec5d17b9f5be service glance] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:01.435378 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cd527-9afb-4168-b8a1-ec5d17b9f5be service glance] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:01.436216 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cd527-9afb-4168-b8a1-ec5d17b9f5be service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:01.437816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-414cd527-9afb-4168-b8a1-ec5d17b9f5be service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:01.512024 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a631a-d037-4f78-a7e6-35655669ca1c None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:45:01.513646 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-ae0a631a-d037-4f78-a7e6-35655669ca1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:01.550958 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:01.556786 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414cd527-9afb-4168-b8a1-ec5d17b9f5be service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:45:01.558387 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414cd527-9afb-4168-b8a1-ec5d17b9f5be service glance] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:45:01.578126 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 689/1395] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:45:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:45:01.657530 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a631a-d037-4f78-a7e6-35655669ca1c None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:45:01.774320 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae74c4-3621-4ddc-bde2-a2c74331da1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc92c0a0a2cc4722868e6877bac93ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:45:01.774934 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae74c4-3621-4ddc-bde2-a2c74331da1a service nova] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:01.775238 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae74c4-3621-4ddc-bde2-a2c74331da1a service nova] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:01.775511 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae74c4-3621-4ddc-bde2-a2c74331da1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:01.777113 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-53ae74c4-3621-4ddc-bde2-a2c74331da1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:01.797141 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:01.878762 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ae74c4-3621-4ddc-bde2-a2c74331da1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:45:01.880391 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ae74c4-3621-4ddc-bde2-a2c74331da1a service nova] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:45:01.898644 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 707/1396] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:45:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 07:45:02.577213 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de14eb-e644-41b9-b613-76b9bb6863de None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:02.577505 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de14eb-e644-41b9-b613-76b9bb6863de None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:02.577783 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de14eb-e644-41b9-b613-76b9bb6863de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:02.625637 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:02.648455 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-24de14eb-e644-41b9-b613-76b9bb6863de None None] MFA Rules not processed for user `30dc2621143f4604b53bb44b82e8efbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:45:02.649684 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-24de14eb-e644-41b9-b613-76b9bb6863de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:02.743985 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 690/1397] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Aug 26 07:45:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:45:02.793981 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b015200-321d-4211-8e4c-511606e2179c None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:02.794484 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b015200-321d-4211-8e4c-511606e2179c None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:02.794678 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b015200-321d-4211-8e4c-511606e2179c None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:02.796781 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 708/1398] 10.222.0.42 () {54 vars in 943 bytes} [Fri Aug 26 07:45:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:45:02.803426 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e397eeb-1ea0-48b7-9e00-e1923089dd2b None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:02.803787 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e397eeb-1ea0-48b7-9e00-e1923089dd2b None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:02.804089 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e397eeb-1ea0-48b7-9e00-e1923089dd2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:02.882707 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-3e397eeb-1ea0-48b7-9e00-e1923089dd2b None None] MFA Rules not processed for user `3142255c263e44a189db82c621f87e7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:45:02.883950 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-3e397eeb-1ea0-48b7-9e00-e1923089dd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:02.948764 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:02.995752 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 691/1399] 10.222.0.42 () {58 vars in 1040 bytes} [Fri Aug 26 07:45:02 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:45:03.005728 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b015200-321d-4211-8e4c-511606e2179c None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:45:03.007302 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-4b015200-321d-4211-8e4c-511606e2179c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:03.153767 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b015200-321d-4211-8e4c-511606e2179c None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:45:03.164095 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:03.261542 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44104be-160c-442b-8c9c-29697dc87028 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3142255c263e44a189db82c621f87e7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:45:03.262175 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44104be-160c-442b-8c9c-29697dc87028 service swift] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:03.262449 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44104be-160c-442b-8c9c-29697dc87028 service swift] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:03.262714 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44104be-160c-442b-8c9c-29697dc87028 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:03.264607 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-d44104be-160c-442b-8c9c-29697dc87028 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:03.350439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44104be-160c-442b-8c9c-29697dc87028 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:45:03.352065 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44104be-160c-442b-8c9c-29697dc87028 service swift] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:45:03.362312 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 709/1400] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 26 07:45:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 07:45:04.140881 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b5cd9-c263-4a3a-a943-476e8f52f39b None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:04.141447 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b5cd9-c263-4a3a-a943-476e8f52f39b None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:04.141447 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b5cd9-c263-4a3a-a943-476e8f52f39b None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:04.146852 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 692/1401] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:45:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:45:04.150008 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05e1b8-9f89-4bec-9d80-a88f14134ec6 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:04.150447 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05e1b8-9f89-4bec-9d80-a88f14134ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:04.150732 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05e1b8-9f89-4bec-9d80-a88f14134ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:04.207791 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:04.232136 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-da05e1b8-9f89-4bec-9d80-a88f14134ec6 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:45:04.234344 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-da05e1b8-9f89-4bec-9d80-a88f14134ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:04.349671 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 710/1402] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:45:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:45:04.649987 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b5cd9-c263-4a3a-a943-476e8f52f39b None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:45:04.651709 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-e63b5cd9-c263-4a3a-a943-476e8f52f39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:04.853254 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b5cd9-c263-4a3a-a943-476e8f52f39b None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:45:04.905450 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:04.992282 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a87e1-b793-4e89-8286-32f5f84a6ffd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc92c0a0a2cc4722868e6877bac93ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:45:04.993004 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a87e1-b793-4e89-8286-32f5f84a6ffd service nova] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:04.993345 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a87e1-b793-4e89-8286-32f5f84a6ffd service nova] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:04.993685 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a87e1-b793-4e89-8286-32f5f84a6ffd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:04.995474 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-aa5a87e1-b793-4e89-8286-32f5f84a6ffd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:05.090826 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a87e1-b793-4e89-8286-32f5f84a6ffd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:45:05.093279 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a87e1-b793-4e89-8286-32f5f84a6ffd service nova] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:45:05.112118 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 693/1403] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:45:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:45:07.455388 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec6566-b828-43a5-8923-eaf95de224a3 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:07.455914 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec6566-b828-43a5-8923-eaf95de224a3 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:07.455914 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec6566-b828-43a5-8923-eaf95de224a3 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:07.457205 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 711/1404] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:45:07.462459 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6f692-b975-4861-8bdf-652b1acaecd6 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:07.462882 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6f692-b975-4861-8bdf-652b1acaecd6 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:07.463148 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6f692-b975-4861-8bdf-652b1acaecd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:07.532097 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:07.540536 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-71f6f692-b975-4861-8bdf-652b1acaecd6 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:45:07.543404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-71f6f692-b975-4861-8bdf-652b1acaecd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:07.651942 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 694/1405] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:45:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:45:07.947345 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec6566-b828-43a5-8923-eaf95de224a3 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:45:07.948903 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-20ec6566-b828-43a5-8923-eaf95de224a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:08.081397 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:08.114977 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec6566-b828-43a5-8923-eaf95de224a3 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:45:08.250998 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5fbac-1cf6-40ce-b200-33720ada5d86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc92c0a0a2cc4722868e6877bac93ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:45:08.251631 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5fbac-1cf6-40ce-b200-33720ada5d86 service nova] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:08.251911 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5fbac-1cf6-40ce-b200-33720ada5d86 service nova] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:08.252184 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5fbac-1cf6-40ce-b200-33720ada5d86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:08.253800 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-bfe5fbac-1cf6-40ce-b200-33720ada5d86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:08.358601 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:08.369666 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe5fbac-1cf6-40ce-b200-33720ada5d86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:45:08.372258 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe5fbac-1cf6-40ce-b200-33720ada5d86 service nova] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:45:08.393046 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 712/1406] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:45:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:45:10.518105 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7addc8-d9b7-4e63-b0d7-45d436e5e120 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:10.518687 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7addc8-d9b7-4e63-b0d7-45d436e5e120 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:10.518997 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7addc8-d9b7-4e63-b0d7-45d436e5e120 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:10.520691 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 695/1407] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:45:10.527146 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5a639-8d88-48b4-bf1e-8cb19bd8c5e2 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:10.527146 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5a639-8d88-48b4-bf1e-8cb19bd8c5e2 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:10.527146 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5a639-8d88-48b4-bf1e-8cb19bd8c5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:10.606957 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-64b5a639-8d88-48b4-bf1e-8cb19bd8c5e2 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:45:10.609520 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-64b5a639-8d88-48b4-bf1e-8cb19bd8c5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:10.725374 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 713/1408] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:45:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:45:11.021320 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7addc8-d9b7-4e63-b0d7-45d436e5e120 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:45:11.022956 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-6c7addc8-d9b7-4e63-b0d7-45d436e5e120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:11.152842 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:11.188606 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7addc8-d9b7-4e63-b0d7-45d436e5e120 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:45:11.397045 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73097c-3f20-4a9d-9cee-d063d75b912f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc92c0a0a2cc4722868e6877bac93ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:45:11.397748 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73097c-3f20-4a9d-9cee-d063d75b912f service nova] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:11.398026 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73097c-3f20-4a9d-9cee-d063d75b912f service nova] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:11.398292 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73097c-3f20-4a9d-9cee-d063d75b912f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:11.400156 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-6b73097c-3f20-4a9d-9cee-d063d75b912f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:11.520333 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:11.524290 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b73097c-3f20-4a9d-9cee-d063d75b912f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:45:11.525932 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b73097c-3f20-4a9d-9cee-d063d75b912f service nova] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:45:11.548984 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 696/1409] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:45:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:45:20.723591 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=74 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:21.559805 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=7 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:27.300771 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b18ee-15b1-4c5d-b6c1-37af9178303a None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:27.301309 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b18ee-15b1-4c5d-b6c1-37af9178303a None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:27.301309 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b18ee-15b1-4c5d-b6c1-37af9178303a None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:27.302658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 714/1410] 10.222.0.42 () {54 vars in 918 bytes} [Fri Aug 26 07:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:45:27.307764 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac4ec6-61a5-4e50-b315-0ec6111ef7e7 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:27.308243 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac4ec6-61a5-4e50-b315-0ec6111ef7e7 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:27.308350 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac4ec6-61a5-4e50-b315-0ec6111ef7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:27.392124 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-b8ac4ec6-61a5-4e50-b315-0ec6111ef7e7 None None] MFA Rules not processed for user `f6c2bc293f1b4daca83e8d6dff66a316`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:45:27.393248 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-b8ac4ec6-61a5-4e50-b315-0ec6111ef7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:27.501287 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 697/1411] 10.222.0.42 () {58 vars in 1015 bytes} [Fri Aug 26 07:45:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:45:27.515819 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9a0e2-dac5-4b8a-9b88-101235584f8c None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:27.516104 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9a0e2-dac5-4b8a-9b88-101235584f8c None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:27.516376 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9a0e2-dac5-4b8a-9b88-101235584f8c None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:27.517759 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 715/1412] 10.222.0.42 () {54 vars in 918 bytes} [Fri Aug 26 07:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:45:27.522401 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89763e8b-040a-4a48-8396-5e1ade11e20d None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:27.522686 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89763e8b-040a-4a48-8396-5e1ade11e20d None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:27.522958 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89763e8b-040a-4a48-8396-5e1ade11e20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:27.595399 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:27.598039 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-89763e8b-040a-4a48-8396-5e1ade11e20d None None] MFA Rules not processed for user `bc92c0a0a2cc4722868e6877bac93ada`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:45:27.599270 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-89763e8b-040a-4a48-8396-5e1ade11e20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:27.715320 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 698/1413] 10.222.0.42 () {58 vars in 1015 bytes} [Fri Aug 26 07:45:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:45:30.133970 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e1578-7e01-4eb9-a737-1cc2de7a3784 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:30.134506 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e1578-7e01-4eb9-a737-1cc2de7a3784 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:30.134506 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e1578-7e01-4eb9-a737-1cc2de7a3784 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:30.137138 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 716/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 07:45:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:45:30.141351 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21618dc0-7a88-43ad-b6ca-b5a6fdaca1a4 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:30.141820 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21618dc0-7a88-43ad-b6ca-b5a6fdaca1a4 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:30.141921 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21618dc0-7a88-43ad-b6ca-b5a6fdaca1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:30.208999 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-21618dc0-7a88-43ad-b6ca-b5a6fdaca1a4 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:45:30.210197 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-21618dc0-7a88-43ad-b6ca-b5a6fdaca1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:30.265714 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:30.310031 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 699/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 07:45:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:45:30.619654 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e1578-7e01-4eb9-a737-1cc2de7a3784 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:45:30.621178 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-352e1578-7e01-4eb9-a737-1cc2de7a3784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:30.766823 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e1578-7e01-4eb9-a737-1cc2de7a3784 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:45:30.838575 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:30.879226 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f40f2b-316a-4432-b70d-db3427fd85f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc92c0a0a2cc4722868e6877bac93ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:45:30.879844 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f40f2b-316a-4432-b70d-db3427fd85f6 service nova] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:30.880133 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f40f2b-316a-4432-b70d-db3427fd85f6 service nova] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:30.880628 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f40f2b-316a-4432-b70d-db3427fd85f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:30.882574 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-64f40f2b-316a-4432-b70d-db3427fd85f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:30.975421 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f40f2b-316a-4432-b70d-db3427fd85f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:45:30.977001 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f40f2b-316a-4432-b70d-db3427fd85f6 service nova] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:45:30.994814 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 717/1416] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:45:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:45:31.883983 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381331fa-0063-4dbc-8659-c6b8ece6279a None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:31.884548 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381331fa-0063-4dbc-8659-c6b8ece6279a None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:31.884548 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381331fa-0063-4dbc-8659-c6b8ece6279a None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:31.885864 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 700/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 07:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:45:31.890810 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d18cc-527c-4f05-b03f-b35fccf3efe5 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:31.891297 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d18cc-527c-4f05-b03f-b35fccf3efe5 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:31.891396 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d18cc-527c-4f05-b03f-b35fccf3efe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:31.965470 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-743d18cc-527c-4f05-b03f-b35fccf3efe5 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:45:31.967463 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-743d18cc-527c-4f05-b03f-b35fccf3efe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:31.994218 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:32.063058 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 718/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 07:45:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:45:32.217313 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381331fa-0063-4dbc-8659-c6b8ece6279a None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:45:32.218885 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-381331fa-0063-4dbc-8659-c6b8ece6279a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:32.365109 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381331fa-0063-4dbc-8659-c6b8ece6279a None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:45:32.406034 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:32.484958 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb160dde-b83a-4ac9-a5d4-0f06cd65f0e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc92c0a0a2cc4722868e6877bac93ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:45:32.485878 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb160dde-b83a-4ac9-a5d4-0f06cd65f0e7 service nova] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:32.486313 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb160dde-b83a-4ac9-a5d4-0f06cd65f0e7 service nova] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:32.486765 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb160dde-b83a-4ac9-a5d4-0f06cd65f0e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:32.488763 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-fb160dde-b83a-4ac9-a5d4-0f06cd65f0e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:32.578717 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb160dde-b83a-4ac9-a5d4-0f06cd65f0e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:45:32.580385 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb160dde-b83a-4ac9-a5d4-0f06cd65f0e7 service nova] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:45:32.598438 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 701/1419] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:45:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:45:33.495841 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd66fd-803a-4951-83be-1d17d11d5849 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:33.496448 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd66fd-803a-4951-83be-1d17d11d5849 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:33.496448 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd66fd-803a-4951-83be-1d17d11d5849 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:33.499299 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 719/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 07:45:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:45:33.504739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b569c7-4ecc-4093-9117-4608cddebf60 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:33.505176 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b569c7-4ecc-4093-9117-4608cddebf60 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:33.505277 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b569c7-4ecc-4093-9117-4608cddebf60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:33.558541 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:33.580666 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-b0b569c7-4ecc-4093-9117-4608cddebf60 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:45:33.581885 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-b0b569c7-4ecc-4093-9117-4608cddebf60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:33.678050 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 702/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 07:45:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:45:33.843837 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd66fd-803a-4951-83be-1d17d11d5849 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:45:33.845460 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-7cfd66fd-803a-4951-83be-1d17d11d5849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:33.990511 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd66fd-803a-4951-83be-1d17d11d5849 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:45:34.002820 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:34.104999 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ace551-9143-41fd-a150-abdbc92ee594 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc92c0a0a2cc4722868e6877bac93ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:45:34.105561 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ace551-9143-41fd-a150-abdbc92ee594 service nova] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:34.105851 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ace551-9143-41fd-a150-abdbc92ee594 service nova] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:34.106210 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ace551-9143-41fd-a150-abdbc92ee594 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:34.108405 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-66ace551-9143-41fd-a150-abdbc92ee594 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:34.197466 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ace551-9143-41fd-a150-abdbc92ee594 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:45:34.199286 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ace551-9143-41fd-a150-abdbc92ee594 service nova] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:45:34.218368 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 720/1422] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:45:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:45:35.091704 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad012b-8dbe-4699-960c-87805413d43e None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:35.092233 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad012b-8dbe-4699-960c-87805413d43e None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:35.092233 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad012b-8dbe-4699-960c-87805413d43e None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:35.093492 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 703/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 07:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:45:35.098581 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a397333-2dc7-4970-a3bb-4ab8e446f87d None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:35.099011 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a397333-2dc7-4970-a3bb-4ab8e446f87d None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:35.099168 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a397333-2dc7-4970-a3bb-4ab8e446f87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:35.125342 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:35.186097 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-2a397333-2dc7-4970-a3bb-4ab8e446f87d None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:45:35.187394 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-2a397333-2dc7-4970-a3bb-4ab8e446f87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:35.285234 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 721/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 07:45:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:45:35.436105 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad012b-8dbe-4699-960c-87805413d43e None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:45:35.437664 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-3aad012b-8dbe-4699-960c-87805413d43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:35.554001 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:35.591345 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad012b-8dbe-4699-960c-87805413d43e None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:45:35.703721 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216707f-cffc-4244-99af-437acde1fa55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc92c0a0a2cc4722868e6877bac93ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:45:35.704239 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216707f-cffc-4244-99af-437acde1fa55 service nova] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:35.704521 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216707f-cffc-4244-99af-437acde1fa55 service nova] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:35.704787 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216707f-cffc-4244-99af-437acde1fa55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:35.706369 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-f216707f-cffc-4244-99af-437acde1fa55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:35.783622 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:35.796832 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f216707f-cffc-4244-99af-437acde1fa55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:45:35.802677 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f216707f-cffc-4244-99af-437acde1fa55 service nova] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:45:35.816986 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 704/1425] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:45:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:45:36.679541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703312ad-9f07-413e-b588-7d2f36c282d5 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:36.680102 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703312ad-9f07-413e-b588-7d2f36c282d5 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:36.680102 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703312ad-9f07-413e-b588-7d2f36c282d5 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:36.681431 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 722/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 07:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:45:36.688174 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8f0b4-c2e9-4b75-b80d-b4c55cafad69 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:36.688657 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8f0b4-c2e9-4b75-b80d-b4c55cafad69 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:36.688754 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8f0b4-c2e9-4b75-b80d-b4c55cafad69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:36.769994 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-fab8f0b4-c2e9-4b75-b80d-b4c55cafad69 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:45:36.771502 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-fab8f0b4-c2e9-4b75-b80d-b4c55cafad69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:36.875158 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 705/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 07:45:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:45:37.022897 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703312ad-9f07-413e-b588-7d2f36c282d5 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:45:37.024500 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-703312ad-9f07-413e-b588-7d2f36c282d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:37.114684 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:37.177782 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703312ad-9f07-413e-b588-7d2f36c282d5 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:45:37.294145 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d843ff-986e-4e40-9325-02dd2306961d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc92c0a0a2cc4722868e6877bac93ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:45:37.294759 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d843ff-986e-4e40-9325-02dd2306961d service nova] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:37.295137 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d843ff-986e-4e40-9325-02dd2306961d service nova] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:37.295430 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d843ff-986e-4e40-9325-02dd2306961d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:37.297076 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-78d843ff-986e-4e40-9325-02dd2306961d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:37.346001 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:37.388403 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d843ff-986e-4e40-9325-02dd2306961d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:45:37.390108 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d843ff-986e-4e40-9325-02dd2306961d service nova] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:45:37.408229 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 723/1428] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:45:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:45:38.318259 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba55086-1c57-4e2b-a998-b33b6101cc73 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:38.320706 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba55086-1c57-4e2b-a998-b33b6101cc73 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:38.320706 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba55086-1c57-4e2b-a998-b33b6101cc73 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:38.320706 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 706/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 07:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:45:38.325666 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d298ae2-e0c0-40f5-8d82-ea18221c0921 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:38.326160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d298ae2-e0c0-40f5-8d82-ea18221c0921 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:38.326284 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d298ae2-e0c0-40f5-8d82-ea18221c0921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:38.403712 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-3d298ae2-e0c0-40f5-8d82-ea18221c0921 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:45:38.404981 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-3d298ae2-e0c0-40f5-8d82-ea18221c0921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:38.504439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 724/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 07:45:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:45:38.655653 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba55086-1c57-4e2b-a998-b33b6101cc73 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:45:38.657179 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-5ba55086-1c57-4e2b-a998-b33b6101cc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:38.706994 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:38.922710 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba55086-1c57-4e2b-a998-b33b6101cc73 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:45:39.034278 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af069d-70ed-4396-856e-5c1d3d3a16b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc92c0a0a2cc4722868e6877bac93ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:45:39.034888 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af069d-70ed-4396-856e-5c1d3d3a16b5 service nova] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:39.035186 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af069d-70ed-4396-856e-5c1d3d3a16b5 service nova] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:39.035453 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af069d-70ed-4396-856e-5c1d3d3a16b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:39.037083 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-e6af069d-70ed-4396-856e-5c1d3d3a16b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:39.043866 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:39.125351 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6af069d-70ed-4396-856e-5c1d3d3a16b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:45:39.126943 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6af069d-70ed-4396-856e-5c1d3d3a16b5 service nova] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:45:39.145511 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 707/1431] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:45:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:45:40.050628 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fccf0b-fec4-46c9-bb73-9ed11ff340fb None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:40.051194 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fccf0b-fec4-46c9-bb73-9ed11ff340fb None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:40.051194 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fccf0b-fec4-46c9-bb73-9ed11ff340fb None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:40.052574 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 725/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 07:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:45:40.057577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f81956-649e-47f0-bf5e-837ce673d07b None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:40.057976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f81956-649e-47f0-bf5e-837ce673d07b None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:40.058126 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f81956-649e-47f0-bf5e-837ce673d07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:40.139635 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-a5f81956-649e-47f0-bf5e-837ce673d07b None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:45:40.141439 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-a5f81956-649e-47f0-bf5e-837ce673d07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:40.211660 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:40.240110 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 708/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 07:45:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:45:40.394018 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fccf0b-fec4-46c9-bb73-9ed11ff340fb None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:45:40.395569 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-e5fccf0b-fec4-46c9-bb73-9ed11ff340fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:40.413492 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:40.541075 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fccf0b-fec4-46c9-bb73-9ed11ff340fb None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:45:40.627980 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:40.654226 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f9d71-46de-4fad-9a3c-fe6727f00ee5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc92c0a0a2cc4722868e6877bac93ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:45:40.654771 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f9d71-46de-4fad-9a3c-fe6727f00ee5 service nova] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:40.655087 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f9d71-46de-4fad-9a3c-fe6727f00ee5 service nova] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:40.655369 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f9d71-46de-4fad-9a3c-fe6727f00ee5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:40.657670 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-9e8f9d71-46de-4fad-9a3c-fe6727f00ee5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:40.748026 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8f9d71-46de-4fad-9a3c-fe6727f00ee5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:45:40.749606 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8f9d71-46de-4fad-9a3c-fe6727f00ee5 service nova] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:45:40.768798 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 726/1434] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:45:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:45:41.637755 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b94e69-134f-4b04-8e1a-320eafeadf08 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:41.638303 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b94e69-134f-4b04-8e1a-320eafeadf08 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:41.638303 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b94e69-134f-4b04-8e1a-320eafeadf08 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:41.639677 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 709/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 07:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:45:41.644601 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361203c-3927-4944-8f40-045827705254 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:41.645056 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361203c-3927-4944-8f40-045827705254 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:41.645170 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361203c-3927-4944-8f40-045827705254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:41.720968 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-7361203c-3927-4944-8f40-045827705254 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:45:41.722177 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-7361203c-3927-4944-8f40-045827705254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:41.763919 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:41.819497 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 727/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 07:45:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:45:41.979176 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b94e69-134f-4b04-8e1a-320eafeadf08 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:45:41.980595 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-60b94e69-134f-4b04-8e1a-320eafeadf08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:42.127195 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b94e69-134f-4b04-8e1a-320eafeadf08 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:45:42.190895 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:42.250217 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f11f34-35bf-4299-ae08-a6b40e55b8d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc92c0a0a2cc4722868e6877bac93ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:45:42.250743 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f11f34-35bf-4299-ae08-a6b40e55b8d3 service nova] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:42.251057 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f11f34-35bf-4299-ae08-a6b40e55b8d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:42.251335 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f11f34-35bf-4299-ae08-a6b40e55b8d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:42.252948 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-f4f11f34-35bf-4299-ae08-a6b40e55b8d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:42.342080 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f11f34-35bf-4299-ae08-a6b40e55b8d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:45:42.343724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f11f34-35bf-4299-ae08-a6b40e55b8d3 service nova] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:45:42.361256 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 710/1437] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:45:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:45:43.237923 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13409f-9160-4b91-bdaa-3da22ecc0f09 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:43.238467 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13409f-9160-4b91-bdaa-3da22ecc0f09 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:43.238467 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13409f-9160-4b91-bdaa-3da22ecc0f09 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:43.239841 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 728/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 07:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:45:43.244867 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ef074-0357-43f6-8055-ade3fd9d5f88 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:43.245292 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ef074-0357-43f6-8055-ade3fd9d5f88 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:43.245447 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ef074-0357-43f6-8055-ade3fd9d5f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:43.321299 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-a99ef074-0357-43f6-8055-ade3fd9d5f88 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:45:43.322507 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-a99ef074-0357-43f6-8055-ade3fd9d5f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:43.325155 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:43.422138 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 711/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 07:45:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:45:43.580349 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b13409f-9160-4b91-bdaa-3da22ecc0f09 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:45:43.581793 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-1b13409f-9160-4b91-bdaa-3da22ecc0f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:43.727687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b13409f-9160-4b91-bdaa-3da22ecc0f09 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:45:43.754837 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:43.841992 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac7087-350e-4ccb-9bb2-aef067ac196d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc92c0a0a2cc4722868e6877bac93ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:45:43.842524 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac7087-350e-4ccb-9bb2-aef067ac196d service nova] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:43.842806 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac7087-350e-4ccb-9bb2-aef067ac196d service nova] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:43.843114 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac7087-350e-4ccb-9bb2-aef067ac196d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:43.844720 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-d6ac7087-350e-4ccb-9bb2-aef067ac196d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:43.936497 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac7087-350e-4ccb-9bb2-aef067ac196d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:45:43.939230 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac7087-350e-4ccb-9bb2-aef067ac196d service nova] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:45:43.959894 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 729/1440] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:45:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:45:45.800851 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754b71a-a62b-435a-b4a7-74641127ddd7 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:45.801393 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754b71a-a62b-435a-b4a7-74641127ddd7 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:45.801393 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754b71a-a62b-435a-b4a7-74641127ddd7 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:45.802723 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 712/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 07:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:45:45.808221 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333df279-2e0d-4540-91c0-01cadf7af54f None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:45.808639 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333df279-2e0d-4540-91c0-01cadf7af54f None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:45.808834 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333df279-2e0d-4540-91c0-01cadf7af54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:45.853146 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:45.879251 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-333df279-2e0d-4540-91c0-01cadf7af54f None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:45:45.880477 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-333df279-2e0d-4540-91c0-01cadf7af54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:45.979534 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 730/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 07:45:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:45:46.268843 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754b71a-a62b-435a-b4a7-74641127ddd7 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:45:46.270439 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-b754b71a-a62b-435a-b4a7-74641127ddd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:46.377635 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754b71a-a62b-435a-b4a7-74641127ddd7 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:45:46.411012 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:46.453510 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d6676-5aeb-48b1-9298-51b128cbb2c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:45:46.454115 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d6676-5aeb-48b1-9298-51b128cbb2c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:46.454389 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d6676-5aeb-48b1-9298-51b128cbb2c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:46.454661 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d6676-5aeb-48b1-9298-51b128cbb2c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:46.456281 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-786d6676-5aeb-48b1-9298-51b128cbb2c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:46.566915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d6676-5aeb-48b1-9298-51b128cbb2c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:45:46.568300 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d6676-5aeb-48b1-9298-51b128cbb2c2 service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:45:46.587957 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 713/1443] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:45:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:45:48.651196 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d239d-6b18-4db9-a942-17948c00c01d None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:48.651763 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d239d-6b18-4db9-a942-17948c00c01d None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:48.651763 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d239d-6b18-4db9-a942-17948c00c01d None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:48.654278 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 731/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 07:45:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 07:45:48.659785 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2796151-3889-4264-9bcc-b535e1226cf5 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:48.660245 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2796151-3889-4264-9bcc-b535e1226cf5 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:48.660367 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2796151-3889-4264-9bcc-b535e1226cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:48.726921 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-f2796151-3889-4264-9bcc-b535e1226cf5 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:45:48.728155 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-f2796151-3889-4264-9bcc-b535e1226cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:48.741665 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:48.828566 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 714/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 07:45:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:45:49.120994 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d239d-6b18-4db9-a942-17948c00c01d None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:45:49.122558 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-0c3d239d-6b18-4db9-a942-17948c00c01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:49.228493 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d239d-6b18-4db9-a942-17948c00c01d None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:45:49.241676 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:49.303500 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f9d3c-dfc3-4e04-b5ea-0f228f70d009 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:45:49.304107 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f9d3c-dfc3-4e04-b5ea-0f228f70d009 service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:49.304383 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f9d3c-dfc3-4e04-b5ea-0f228f70d009 service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:49.304643 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f9d3c-dfc3-4e04-b5ea-0f228f70d009 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:49.306250 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-357f9d3c-dfc3-4e04-b5ea-0f228f70d009 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:49.415531 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f9d3c-dfc3-4e04-b5ea-0f228f70d009 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:45:49.416987 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f9d3c-dfc3-4e04-b5ea-0f228f70d009 service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:45:49.435186 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 732/1446] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:45:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:45:51.747554 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243f8af-0503-41e7-9328-c2465c86e2ad None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:51.748608 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243f8af-0503-41e7-9328-c2465c86e2ad None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:51.748761 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243f8af-0503-41e7-9328-c2465c86e2ad None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:51.750085 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 715/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 07:45:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:45:51.755579 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d5c67-e708-4d0b-b600-48d60d9cbc04 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:51.756037 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d5c67-e708-4d0b-b600-48d60d9cbc04 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:51.756145 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d5c67-e708-4d0b-b600-48d60d9cbc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:51.806074 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:51.824419 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-de4d5c67-e708-4d0b-b600-48d60d9cbc04 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:45:51.825810 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-de4d5c67-e708-4d0b-b600-48d60d9cbc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:51.924323 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 733/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 07:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:45:52.211658 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243f8af-0503-41e7-9328-c2465c86e2ad None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:45:52.213192 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-9243f8af-0503-41e7-9328-c2465c86e2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:52.320188 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243f8af-0503-41e7-9328-c2465c86e2ad None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:45:52.362310 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:52.396156 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeccf281-d283-4b5f-b67f-402062ab6b10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:45:52.396760 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeccf281-d283-4b5f-b67f-402062ab6b10 service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:52.397036 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeccf281-d283-4b5f-b67f-402062ab6b10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:52.397303 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeccf281-d283-4b5f-b67f-402062ab6b10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:52.398886 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-aeccf281-d283-4b5f-b67f-402062ab6b10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:52.514700 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeccf281-d283-4b5f-b67f-402062ab6b10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:45:52.516092 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeccf281-d283-4b5f-b67f-402062ab6b10 service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:45:52.535229 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 716/1449] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:45:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:45:54.598468 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800500b-681e-45ac-a163-29494d644cae None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:54.599027 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800500b-681e-45ac-a163-29494d644cae None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:54.599027 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800500b-681e-45ac-a163-29494d644cae None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:54.600377 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 734/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 07:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:45:54.605962 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb65b8-e2af-4c4a-bb0b-acfecf99caf2 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:54.606403 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb65b8-e2af-4c4a-bb0b-acfecf99caf2 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:54.606786 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb65b8-e2af-4c4a-bb0b-acfecf99caf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:54.671618 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-6adb65b8-e2af-4c4a-bb0b-acfecf99caf2 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:45:54.672824 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-6adb65b8-e2af-4c4a-bb0b-acfecf99caf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:54.693266 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:54.773633 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 717/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 07:45:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:45:55.060702 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800500b-681e-45ac-a163-29494d644cae None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:45:55.062248 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-a800500b-681e-45ac-a163-29494d644cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:55.178156 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800500b-681e-45ac-a163-29494d644cae None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:45:55.198623 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:55.254007 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b01d2-07d5-48cb-a59e-912d6f5fbd8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:45:55.254614 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b01d2-07d5-48cb-a59e-912d6f5fbd8c service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:55.254893 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b01d2-07d5-48cb-a59e-912d6f5fbd8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:55.255189 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b01d2-07d5-48cb-a59e-912d6f5fbd8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:55.256782 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-318b01d2-07d5-48cb-a59e-912d6f5fbd8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:55.367755 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b01d2-07d5-48cb-a59e-912d6f5fbd8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:45:55.369193 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b01d2-07d5-48cb-a59e-912d6f5fbd8c service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:45:55.389228 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 735/1452] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:45:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:45:57.423084 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a92499-2e47-49e8-8794-9b93e9c6e6ef None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:57.423626 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a92499-2e47-49e8-8794-9b93e9c6e6ef None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:57.423626 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a92499-2e47-49e8-8794-9b93e9c6e6ef None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:57.424895 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 718/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 07:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:45:57.430208 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551b6dc-82ac-4b25-88d9-4b6f69092d53 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:57.430637 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551b6dc-82ac-4b25-88d9-4b6f69092d53 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:57.430761 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551b6dc-82ac-4b25-88d9-4b6f69092d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:57.499205 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:57.502080 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-1551b6dc-82ac-4b25-88d9-4b6f69092d53 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:45:57.503354 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-1551b6dc-82ac-4b25-88d9-4b6f69092d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:57.606770 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 736/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 07:45:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:45:57.889733 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a92499-2e47-49e8-8794-9b93e9c6e6ef None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:45:57.891456 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-79a92499-2e47-49e8-8794-9b93e9c6e6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:57.994542 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a92499-2e47-49e8-8794-9b93e9c6e6ef None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:45:58.043633 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:45:58.068744 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe11786-7ce9-4890-ac82-cf4d2fb4ffdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:45:58.069353 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe11786-7ce9-4890-ac82-cf4d2fb4ffdf service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:45:58.069634 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe11786-7ce9-4890-ac82-cf4d2fb4ffdf service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:45:58.069907 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe11786-7ce9-4890-ac82-cf4d2fb4ffdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:45:58.071530 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-bfe11786-7ce9-4890-ac82-cf4d2fb4ffdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:45:58.185858 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe11786-7ce9-4890-ac82-cf4d2fb4ffdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:45:58.187328 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe11786-7ce9-4890-ac82-cf4d2fb4ffdf service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:45:58.208424 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 719/1455] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:45:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:46:00.187564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ae339-ed39-4cd0-ab2a-a0ac9c9d4efe None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:46:00.188112 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ae339-ed39-4cd0-ab2a-a0ac9c9d4efe None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:46:00.188112 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ae339-ed39-4cd0-ab2a-a0ac9c9d4efe None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:46:00.189454 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 737/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 07:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:46:00.194975 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1dad2-7d2e-4c90-8c7c-fc168045b4bc None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:46:00.195517 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1dad2-7d2e-4c90-8c7c-fc168045b4bc None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:46:00.195603 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1dad2-7d2e-4c90-8c7c-fc168045b4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:46:00.262498 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-e4d1dad2-7d2e-4c90-8c7c-fc168045b4bc None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:46:00.263755 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-e4d1dad2-7d2e-4c90-8c7c-fc168045b4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:46:00.296132 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:46:00.365575 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 720/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 07:46:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:46:00.660187 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ae339-ed39-4cd0-ab2a-a0ac9c9d4efe None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:46:00.661716 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-c73ae339-ed39-4cd0-ab2a-a0ac9c9d4efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:46:00.765625 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ae339-ed39-4cd0-ab2a-a0ac9c9d4efe None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:46:00.794193 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:46:00.840986 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03973d26-8d98-46d9-a998-0b0ba8082235 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:46:00.841595 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03973d26-8d98-46d9-a998-0b0ba8082235 service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:46:00.841874 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03973d26-8d98-46d9-a998-0b0ba8082235 service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:46:00.842146 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03973d26-8d98-46d9-a998-0b0ba8082235 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:46:00.843781 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-03973d26-8d98-46d9-a998-0b0ba8082235 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:46:00.969238 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03973d26-8d98-46d9-a998-0b0ba8082235 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:46:00.970586 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03973d26-8d98-46d9-a998-0b0ba8082235 service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:46:00.989018 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 738/1458] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:46:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:46:03.121291 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc5b6e-0cbd-4e81-91e1-a4bba8bb3e8a None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:46:03.122154 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc5b6e-0cbd-4e81-91e1-a4bba8bb3e8a None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:46:03.122154 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc5b6e-0cbd-4e81-91e1-a4bba8bb3e8a None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:46:03.123323 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 721/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 07:46:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:46:03.129091 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc26df7-e956-4f4d-85b8-814b8d613127 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:46:03.129539 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc26df7-e956-4f4d-85b8-814b8d613127 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:46:03.129655 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc26df7-e956-4f4d-85b8-814b8d613127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:46:03.196946 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-fcc26df7-e956-4f4d-85b8-814b8d613127 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:46:03.198174 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-fcc26df7-e956-4f4d-85b8-814b8d613127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:46:03.208148 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:46:03.297384 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 739/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 07:46:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:46:03.591365 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc5b6e-0cbd-4e81-91e1-a4bba8bb3e8a None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:46:03.593353 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-6adc5b6e-0cbd-4e81-91e1-a4bba8bb3e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:46:03.710163 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc5b6e-0cbd-4e81-91e1-a4bba8bb3e8a None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:46:03.767774 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:46:03.786557 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabdcd92-bce8-4960-85b9-44e1af6777c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:46:03.787199 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdcd92-bce8-4960-85b9-44e1af6777c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:46:03.787476 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdcd92-bce8-4960-85b9-44e1af6777c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:46:03.787747 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdcd92-bce8-4960-85b9-44e1af6777c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:46:03.789344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-fabdcd92-bce8-4960-85b9-44e1af6777c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:46:03.900497 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabdcd92-bce8-4960-85b9-44e1af6777c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:46:03.902543 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabdcd92-bce8-4960-85b9-44e1af6777c8 service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:46:03.921077 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 722/1461] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:46:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:46:05.892890 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ca462-bbf3-414c-a7e5-03536671ddcd None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:46:05.893472 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ca462-bbf3-414c-a7e5-03536671ddcd None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:46:05.893472 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ca462-bbf3-414c-a7e5-03536671ddcd None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:46:05.894789 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 740/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 07:46:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:46:05.901914 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104d973-bf1f-45a7-aa5f-9eb679e44977 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:46:05.902663 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104d973-bf1f-45a7-aa5f-9eb679e44977 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:46:05.902663 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104d973-bf1f-45a7-aa5f-9eb679e44977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:46:05.970210 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-1104d973-bf1f-45a7-aa5f-9eb679e44977 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:46:05.971460 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-1104d973-bf1f-45a7-aa5f-9eb679e44977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:46:06.009344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:46:06.067231 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 723/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 07:46:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:46:06.362581 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ca462-bbf3-414c-a7e5-03536671ddcd None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:46:06.364186 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-685ca462-bbf3-414c-a7e5-03536671ddcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:46:06.467801 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ca462-bbf3-414c-a7e5-03536671ddcd None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:46:06.505999 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:46:06.543589 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d03f0-eda3-45aa-8033-e6d08184c651 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:46:06.544199 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d03f0-eda3-45aa-8033-e6d08184c651 service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:46:06.544472 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d03f0-eda3-45aa-8033-e6d08184c651 service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:46:06.544756 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d03f0-eda3-45aa-8033-e6d08184c651 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:46:06.546339 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-974d03f0-eda3-45aa-8033-e6d08184c651 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:46:06.728119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d03f0-eda3-45aa-8033-e6d08184c651 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:46:06.729572 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d03f0-eda3-45aa-8033-e6d08184c651 service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:46:06.750194 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 741/1464] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:46:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:46:08.701034 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736ee61-ac4e-4886-a031-3e34359983b3 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:46:08.701594 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736ee61-ac4e-4886-a031-3e34359983b3 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:46:08.701594 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736ee61-ac4e-4886-a031-3e34359983b3 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:46:08.703212 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 724/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 07:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:46:08.708568 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008a244-7f3a-449a-abd4-1897b1439624 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:46:08.708981 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008a244-7f3a-449a-abd4-1897b1439624 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:46:08.709156 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008a244-7f3a-449a-abd4-1897b1439624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:46:08.775982 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-e008a244-7f3a-449a-abd4-1897b1439624 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:46:08.777308 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-e008a244-7f3a-449a-abd4-1897b1439624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:46:08.795632 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:46:08.873456 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 742/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 07:46:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:46:09.160209 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736ee61-ac4e-4886-a031-3e34359983b3 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:46:09.161740 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-f736ee61-ac4e-4886-a031-3e34359983b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:46:09.264859 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736ee61-ac4e-4886-a031-3e34359983b3 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:46:09.330922 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:46:09.337554 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd9b5c-d84a-4b0a-8ab4-d3cda0097b96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:46:09.338169 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd9b5c-d84a-4b0a-8ab4-d3cda0097b96 service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:46:09.338448 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd9b5c-d84a-4b0a-8ab4-d3cda0097b96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:46:09.338721 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd9b5c-d84a-4b0a-8ab4-d3cda0097b96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:46:09.340996 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-ddcd9b5c-d84a-4b0a-8ab4-d3cda0097b96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:46:09.449397 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd9b5c-d84a-4b0a-8ab4-d3cda0097b96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:46:09.450739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd9b5c-d84a-4b0a-8ab4-d3cda0097b96 service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:46:09.470777 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 725/1467] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:46:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:46:11.393039 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d134c-aad6-40e9-abee-a2db6385c607 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:46:11.393613 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d134c-aad6-40e9-abee-a2db6385c607 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:46:11.393613 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d134c-aad6-40e9-abee-a2db6385c607 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:46:11.394903 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 743/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 07:46:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:46:11.400413 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c22dabf-ba51-4e07-9cbd-d3ca00b96953 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:46:11.400846 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c22dabf-ba51-4e07-9cbd-d3ca00b96953 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:46:11.401083 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c22dabf-ba51-4e07-9cbd-d3ca00b96953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:46:11.467927 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-3c22dabf-ba51-4e07-9cbd-d3ca00b96953 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:46:11.469139 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-3c22dabf-ba51-4e07-9cbd-d3ca00b96953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:46:11.517111 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:46:11.567062 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 726/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 07:46:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:46:11.848155 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d134c-aad6-40e9-abee-a2db6385c607 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:46:11.849688 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-518d134c-aad6-40e9-abee-a2db6385c607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:46:11.954407 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d134c-aad6-40e9-abee-a2db6385c607 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:46:12.119342 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:46:12.145712 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd2e31-b317-4767-8b3a-d653c63a2a72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:46:12.146313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd2e31-b317-4767-8b3a-d653c63a2a72 service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:46:12.146580 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd2e31-b317-4767-8b3a-d653c63a2a72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:46:12.146857 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd2e31-b317-4767-8b3a-d653c63a2a72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:46:12.148454 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-00cd2e31-b317-4767-8b3a-d653c63a2a72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:46:12.267238 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd2e31-b317-4767-8b3a-d653c63a2a72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:46:12.268693 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd2e31-b317-4767-8b3a-d653c63a2a72 service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:46:12.286239 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 744/1470] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:46:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:46:21.565203 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=22 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:46:22.284031 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=66 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:46:32.052346 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823aa6c-d526-468f-a49f-af6c8db7f3d2 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:46:32.052874 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823aa6c-d526-468f-a49f-af6c8db7f3d2 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:46:32.052874 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823aa6c-d526-468f-a49f-af6c8db7f3d2 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:46:32.054186 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 727/1471] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:46:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:46:32.059559 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d22c2-da93-4481-b366-7174671d1768 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:46:32.067303 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d22c2-da93-4481-b366-7174671d1768 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:46:32.067303 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d22c2-da93-4481-b366-7174671d1768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:46:32.126456 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-893d22c2-da93-4481-b366-7174671d1768 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:46:32.127686 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-893d22c2-da93-4481-b366-7174671d1768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:46:32.223666 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 745/1472] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:46:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:46:32.539062 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b6f7b-4d97-404f-b412-5b0501153d49 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:46:32.539350 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b6f7b-4d97-404f-b412-5b0501153d49 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:46:32.539628 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b6f7b-4d97-404f-b412-5b0501153d49 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:46:32.541005 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 728/1473] 10.222.0.42 () {54 vars in 967 bytes} [Fri Aug 26 07:46:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:46:32.546176 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7e5e4-1968-4e08-b479-43b2f5dd6255 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:46:32.546461 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7e5e4-1968-4e08-b479-43b2f5dd6255 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:46:32.546739 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7e5e4-1968-4e08-b479-43b2f5dd6255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:46:32.624786 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-a2c7e5e4-1968-4e08-b479-43b2f5dd6255 None None] MFA Rules not processed for user `2df7725203304d8fbe3a768656cabf23`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:46:32.625993 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-a2c7e5e4-1968-4e08-b479-43b2f5dd6255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:46:32.646560 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:46:32.702643 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 746/1474] 10.222.0.42 () {58 vars in 1064 bytes} [Fri Aug 26 07:46:32 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:46:32.710668 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b6f7b-4d97-404f-b412-5b0501153d49 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:46:32.712220 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-548b6f7b-4d97-404f-b412-5b0501153d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:46:32.818209 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b6f7b-4d97-404f-b412-5b0501153d49 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:46:32.892010 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78765349-c3ca-4478-aeeb-76fc356a0001 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df7725203304d8fbe3a768656cabf23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:46:32.892529 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78765349-c3ca-4478-aeeb-76fc356a0001 service glance] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:46:32.892833 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78765349-c3ca-4478-aeeb-76fc356a0001 service glance] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:46:32.893124 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78765349-c3ca-4478-aeeb-76fc356a0001 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:46:32.894786 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-78765349-c3ca-4478-aeeb-76fc356a0001 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:46:32.948698 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:46:33.002098 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78765349-c3ca-4478-aeeb-76fc356a0001 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:46:33.003552 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78765349-c3ca-4478-aeeb-76fc356a0001 service glance] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:46:33.024611 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 729/1475] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:46:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:46:35.019629 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65d689-afe0-47d2-b5f1-e4130a26b8f5 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:46:35.020203 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65d689-afe0-47d2-b5f1-e4130a26b8f5 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:46:35.020203 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65d689-afe0-47d2-b5f1-e4130a26b8f5 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:46:35.021486 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 747/1476] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:46:35.026884 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df677864-103e-4743-bac7-8952b910bdcc None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:46:35.027366 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df677864-103e-4743-bac7-8952b910bdcc None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:46:35.027470 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df677864-103e-4743-bac7-8952b910bdcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:46:35.092212 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-df677864-103e-4743-bac7-8952b910bdcc None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:46:35.093418 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-df677864-103e-4743-bac7-8952b910bdcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:46:35.191539 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 730/1477] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:46:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:46:35.477387 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65d689-afe0-47d2-b5f1-e4130a26b8f5 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:46:35.479150 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-4d65d689-afe0-47d2-b5f1-e4130a26b8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:46:35.624038 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65d689-afe0-47d2-b5f1-e4130a26b8f5 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:46:35.673778 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:46:35.718058 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7437308-7596-4cb2-8474-0913718ae099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:46:35.718652 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7437308-7596-4cb2-8474-0913718ae099 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:46:35.718931 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7437308-7596-4cb2-8474-0913718ae099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:46:35.719220 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7437308-7596-4cb2-8474-0913718ae099 admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:46:35.719851 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7437308-7596-4cb2-8474-0913718ae099 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:46:35.721575 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: WARNING py.warnings [None req-b7437308-7596-4cb2-8474-0913718ae099 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 07:46:35.721575 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: warnings.warn(msg) Aug 26 07:46:35.721575 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: Aug 26 07:46:35.722693 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7437308-7596-4cb2-8474-0913718ae099 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:46:35.743320 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 748/1478] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Aug 26 07:46:35 2022] GET /identity/v3/projects => generated 2553 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:46:37.722231 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854767d2-021b-42d5-96cc-a7b3953cd158 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:46:37.722796 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854767d2-021b-42d5-96cc-a7b3953cd158 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:46:37.722906 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854767d2-021b-42d5-96cc-a7b3953cd158 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:46:37.724425 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 731/1479] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:46:37.730531 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3f245-7290-4924-870d-4974db0a9460 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:46:37.731029 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3f245-7290-4924-870d-4974db0a9460 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:46:37.731140 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3f245-7290-4924-870d-4974db0a9460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:46:37.796337 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-1ac3f245-7290-4924-870d-4974db0a9460 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:46:37.797546 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-1ac3f245-7290-4924-870d-4974db0a9460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:46:37.896192 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 749/1480] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:46:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:46:38.204556 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854767d2-021b-42d5-96cc-a7b3953cd158 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:46:38.206112 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-854767d2-021b-42d5-96cc-a7b3953cd158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:46:38.216090 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:46:38.356405 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854767d2-021b-42d5-96cc-a7b3953cd158 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:46:38.437954 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:46:38.472456 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6e0ac-911f-4141-b3d3-2d8e8562c981 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc92c0a0a2cc4722868e6877bac93ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:46:38.472988 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6e0ac-911f-4141-b3d3-2d8e8562c981 service nova] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:46:38.473265 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6e0ac-911f-4141-b3d3-2d8e8562c981 service nova] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:46:38.473533 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6e0ac-911f-4141-b3d3-2d8e8562c981 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:46:38.475171 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-52e6e0ac-911f-4141-b3d3-2d8e8562c981 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:46:38.568823 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6e0ac-911f-4141-b3d3-2d8e8562c981 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:46:38.570410 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6e0ac-911f-4141-b3d3-2d8e8562c981 service nova] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:46:38.589570 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 732/1481] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:46:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 07:46:40.712724 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3001ad-25ab-4ef0-8784-97ea1bf7f0fb None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:46:40.713347 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3001ad-25ab-4ef0-8784-97ea1bf7f0fb None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:46:40.713517 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3001ad-25ab-4ef0-8784-97ea1bf7f0fb None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:46:40.714926 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 750/1482] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:46:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:46:40.720512 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13d3f7-5009-48c1-8ac5-e39e24dd0a2e None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:46:40.720948 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13d3f7-5009-48c1-8ac5-e39e24dd0a2e None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:46:40.721074 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13d3f7-5009-48c1-8ac5-e39e24dd0a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:46:40.790407 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-cd13d3f7-5009-48c1-8ac5-e39e24dd0a2e None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:46:40.792108 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-cd13d3f7-5009-48c1-8ac5-e39e24dd0a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:46:40.848761 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:46:40.899314 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 733/1483] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:46:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:46:41.189047 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3001ad-25ab-4ef0-8784-97ea1bf7f0fb None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:46:41.190580 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-5d3001ad-25ab-4ef0-8784-97ea1bf7f0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:46:41.214698 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:46:41.296400 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3001ad-25ab-4ef0-8784-97ea1bf7f0fb None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:46:41.372652 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963dfd9c-5c9d-4465-b4ad-41002bcb717b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:46:41.373396 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963dfd9c-5c9d-4465-b4ad-41002bcb717b service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:46:41.373674 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963dfd9c-5c9d-4465-b4ad-41002bcb717b service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:46:41.373943 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963dfd9c-5c9d-4465-b4ad-41002bcb717b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:46:41.375566 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-963dfd9c-5c9d-4465-b4ad-41002bcb717b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:46:41.450946 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:46:41.486541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963dfd9c-5c9d-4465-b4ad-41002bcb717b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:46:41.487996 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963dfd9c-5c9d-4465-b4ad-41002bcb717b service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:46:41.506080 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 751/1484] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:46:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:46:43.524163 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f2f05-3156-4fa8-bc31-ea4576a4cc28 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:46:43.525044 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f2f05-3156-4fa8-bc31-ea4576a4cc28 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:46:43.525044 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f2f05-3156-4fa8-bc31-ea4576a4cc28 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:46:43.527012 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 734/1485] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:46:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:46:43.532598 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba881e17-f033-427d-aef4-981a1c77ec83 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:46:43.533035 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba881e17-f033-427d-aef4-981a1c77ec83 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:46:43.533174 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba881e17-f033-427d-aef4-981a1c77ec83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:46:43.600246 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-ba881e17-f033-427d-aef4-981a1c77ec83 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:46:43.601580 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-ba881e17-f033-427d-aef4-981a1c77ec83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:46:43.698176 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 752/1486] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:46:43.985141 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f2f05-3156-4fa8-bc31-ea4576a4cc28 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:46:43.986680 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-f43f2f05-3156-4fa8-bc31-ea4576a4cc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:46:44.090357 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f2f05-3156-4fa8-bc31-ea4576a4cc28 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:46:44.162790 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:46:44.164614 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea16a4-c343-4e42-9ed2-ed430682395e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:46:44.165248 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea16a4-c343-4e42-9ed2-ed430682395e service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:46:44.165563 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea16a4-c343-4e42-9ed2-ed430682395e service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:46:44.165838 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea16a4-c343-4e42-9ed2-ed430682395e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:46:44.168322 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-43ea16a4-c343-4e42-9ed2-ed430682395e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:46:44.282168 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea16a4-c343-4e42-9ed2-ed430682395e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:46:44.283574 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea16a4-c343-4e42-9ed2-ed430682395e service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:46:44.302064 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 735/1487] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:46:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:46:46.349764 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddb142-0e83-4de4-b7f3-7e98af9f5e9c None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:46:46.350288 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddb142-0e83-4de4-b7f3-7e98af9f5e9c None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:46:46.350288 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddb142-0e83-4de4-b7f3-7e98af9f5e9c None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:46:46.351652 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 753/1488] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:46:46.357625 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003be80-a9b1-4019-b803-0f9a32e2004f None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:46:46.358033 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003be80-a9b1-4019-b803-0f9a32e2004f None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:46:46.358166 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003be80-a9b1-4019-b803-0f9a32e2004f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:46:46.423842 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-e003be80-a9b1-4019-b803-0f9a32e2004f None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:46:46.425039 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-e003be80-a9b1-4019-b803-0f9a32e2004f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:46:46.477387 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:46:46.521604 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 736/1489] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:46:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:46:46.826296 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dddb142-0e83-4de4-b7f3-7e98af9f5e9c None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:46:46.828165 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-7dddb142-0e83-4de4-b7f3-7e98af9f5e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:46:46.869115 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:46:46.936730 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dddb142-0e83-4de4-b7f3-7e98af9f5e9c None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:46:47.011616 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793dc8f-c304-4b73-9f8c-13d825e59c66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:46:47.012220 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793dc8f-c304-4b73-9f8c-13d825e59c66 service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:46:47.012497 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793dc8f-c304-4b73-9f8c-13d825e59c66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:46:47.012770 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793dc8f-c304-4b73-9f8c-13d825e59c66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:46:47.014364 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-b793dc8f-c304-4b73-9f8c-13d825e59c66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:46:47.093411 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:46:47.121134 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b793dc8f-c304-4b73-9f8c-13d825e59c66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:46:47.122553 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b793dc8f-c304-4b73-9f8c-13d825e59c66 service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:46:47.142111 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 754/1490] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:46:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:46:49.449405 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7937ed-8c48-494e-a258-3a3f0e9d4349 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:46:49.449998 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7937ed-8c48-494e-a258-3a3f0e9d4349 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:46:49.449998 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7937ed-8c48-494e-a258-3a3f0e9d4349 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:46:49.451363 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 737/1491] 10.222.0.42 () {54 vars in 927 bytes} [Fri Aug 26 07:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 07:46:49.456882 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c16357-fb18-4f2a-98a3-5470e220c434 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:46:49.457286 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c16357-fb18-4f2a-98a3-5470e220c434 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:46:49.457424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c16357-fb18-4f2a-98a3-5470e220c434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:46:49.523006 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-43c16357-fb18-4f2a-98a3-5470e220c434 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:46:49.524337 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-43c16357-fb18-4f2a-98a3-5470e220c434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:46:49.622586 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 755/1492] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Aug 26 07:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:46:49.918773 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7937ed-8c48-494e-a258-3a3f0e9d4349 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:46:49.920358 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-bc7937ed-8c48-494e-a258-3a3f0e9d4349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:46:50.024769 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7937ed-8c48-494e-a258-3a3f0e9d4349 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:46:50.099392 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d4da9-b12a-473d-aac8-3f8cd8743e12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:46:50.099777 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d4da9-b12a-473d-aac8-3f8cd8743e12 service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:46:50.100055 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d4da9-b12a-473d-aac8-3f8cd8743e12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:46:50.100320 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d4da9-b12a-473d-aac8-3f8cd8743e12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:46:50.101910 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-326d4da9-b12a-473d-aac8-3f8cd8743e12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:46:50.111198 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:46:50.210446 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d4da9-b12a-473d-aac8-3f8cd8743e12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:46:50.211986 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d4da9-b12a-473d-aac8-3f8cd8743e12 service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:46:50.230808 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 738/1493] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:46:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:46:59.620761 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=82 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:47:00.228936 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=50 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:48:13.495938 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1057fb3-d852-4aa6-9ed6-61a2bd62a660 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:48:13.496549 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1057fb3-d852-4aa6-9ed6-61a2bd62a660 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:48:13.496549 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1057fb3-d852-4aa6-9ed6-61a2bd62a660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:48:13.572860 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-e1057fb3-d852-4aa6-9ed6-61a2bd62a660 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:48:13.574081 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-e1057fb3-d852-4aa6-9ed6-61a2bd62a660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:48:13.670524 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 756/1494] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:48:13.679805 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5acd8-82c7-4cc2-b7bb-5dc572cf52dd None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:48:13.680340 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5acd8-82c7-4cc2-b7bb-5dc572cf52dd None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:48:13.680340 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5acd8-82c7-4cc2-b7bb-5dc572cf52dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:48:13.770838 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-91f5acd8-82c7-4cc2-b7bb-5dc572cf52dd None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:48:13.772410 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-91f5acd8-82c7-4cc2-b7bb-5dc572cf52dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:48:13.874434 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 739/1495] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:48:13.879298 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1057fb3-d852-4aa6-9ed6-61a2bd62a660 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:48:13.880498 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-e1057fb3-d852-4aa6-9ed6-61a2bd62a660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:48:13.892498 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1057fb3-d852-4aa6-9ed6-61a2bd62a660 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:48:13.959508 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:48:13.993867 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e40398-3f95-4696-9b99-453a51048436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:48:13.994478 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e40398-3f95-4696-9b99-453a51048436 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:48:13.994753 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e40398-3f95-4696-9b99-453a51048436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:48:13.995046 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e40398-3f95-4696-9b99-453a51048436 admin admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:48:13.995684 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e40398-3f95-4696-9b99-453a51048436 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:48:13.995983 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e40398-3f95-4696-9b99-453a51048436 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:48:13.996991 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: WARNING py.warnings [None req-19e40398-3f95-4696-9b99-453a51048436 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 26 07:48:13.996991 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: warnings.warn(msg) Aug 26 07:48:13.996991 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: Aug 26 07:48:13.997869 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e40398-3f95-4696-9b99-453a51048436 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:48:14.009698 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 757/1496] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:48:14.018687 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5acd8-82c7-4cc2-b7bb-5dc572cf52dd None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:48:14.028267 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5acd8-82c7-4cc2-b7bb-5dc572cf52dd None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:48:14.092675 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:48:14.137463 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea5a63-8787-4f1f-9b43-b4469acaa0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:48:14.138084 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea5a63-8787-4f1f-9b43-b4469acaa0c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:48:14.138361 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea5a63-8787-4f1f-9b43-b4469acaa0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:48:14.138625 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea5a63-8787-4f1f-9b43-b4469acaa0c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:48:14.139303 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea5a63-8787-4f1f-9b43-b4469acaa0c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:48:14.141056 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: WARNING py.warnings [None req-a7ea5a63-8787-4f1f-9b43-b4469acaa0c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 07:48:14.141056 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: warnings.warn(msg) Aug 26 07:48:14.141056 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: Aug 26 07:48:14.142250 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea5a63-8787-4f1f-9b43-b4469acaa0c0 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:48:14.288449 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 740/1497] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:48:14 2022] POST /identity/v3/projects => generated 375 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:48:14.292760 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e40398-3f95-4696-9b99-453a51048436 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:48:14.294284 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-19e40398-3f95-4696-9b99-453a51048436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:48:14.332647 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e40398-3f95-4696-9b99-453a51048436 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:48:14.438354 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69aacd-f16c-4ee8-9fad-a77b553fb017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:48:14.438961 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69aacd-f16c-4ee8-9fad-a77b553fb017 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:48:14.439275 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69aacd-f16c-4ee8-9fad-a77b553fb017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:48:14.439550 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69aacd-f16c-4ee8-9fad-a77b553fb017 admin admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:48:14.440186 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69aacd-f16c-4ee8-9fad-a77b553fb017 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:48:14.441209 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: WARNING py.warnings [None req-4b69aacd-f16c-4ee8-9fad-a77b553fb017 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 07:48:14.441209 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: warnings.warn(msg) Aug 26 07:48:14.441209 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: Aug 26 07:48:14.442444 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69aacd-f16c-4ee8-9fad-a77b553fb017 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:48:14.546598 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 758/1498] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:48:14 2022] POST /identity/v3/users => generated 288 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 07:48:14.556505 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea5a63-8787-4f1f-9b43-b4469acaa0c0 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:48:14.558031 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-a7ea5a63-8787-4f1f-9b43-b4469acaa0c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:48:14.621012 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea5a63-8787-4f1f-9b43-b4469acaa0c0 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:48:14.710148 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:48:14.721931 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a13bc3-d42b-43a6-8521-c2719e55e236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:48:14.722957 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a13bc3-d42b-43a6-8521-c2719e55e236 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:48:14.723469 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a13bc3-d42b-43a6-8521-c2719e55e236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:48:14.723931 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a13bc3-d42b-43a6-8521-c2719e55e236 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:48:14.724879 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a13bc3-d42b-43a6-8521-c2719e55e236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:48:14.727016 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: WARNING py.warnings [None req-21a13bc3-d42b-43a6-8521-c2719e55e236 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 26 07:48:14.727016 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: warnings.warn(msg) Aug 26 07:48:14.727016 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: Aug 26 07:48:14.728063 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a13bc3-d42b-43a6-8521-c2719e55e236 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:48:14.745554 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 741/1499] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:48:14.750211 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69aacd-f16c-4ee8-9fad-a77b553fb017 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:48:14.751763 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-4b69aacd-f16c-4ee8-9fad-a77b553fb017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:48:14.765500 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69aacd-f16c-4ee8-9fad-a77b553fb017 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:48:14.793689 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:48:14.868624 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc653d4-3ca1-4b7d-978d-de0f46dd74f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:48:14.869232 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc653d4-3ca1-4b7d-978d-de0f46dd74f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:48:14.869512 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc653d4-3ca1-4b7d-978d-de0f46dd74f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:48:14.869784 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc653d4-3ca1-4b7d-978d-de0f46dd74f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:48:14.870427 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc653d4-3ca1-4b7d-978d-de0f46dd74f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:48:14.871479 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: WARNING py.warnings [None req-1bc653d4-3ca1-4b7d-978d-de0f46dd74f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 26 07:48:14.871479 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: warnings.warn(msg) Aug 26 07:48:14.871479 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: Aug 26 07:48:14.872393 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc653d4-3ca1-4b7d-978d-de0f46dd74f3 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:48:14.884729 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 759/1500] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:48:14.889221 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a13bc3-d42b-43a6-8521-c2719e55e236 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:48:14.890754 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-21a13bc3-d42b-43a6-8521-c2719e55e236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:48:14.923608 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a13bc3-d42b-43a6-8521-c2719e55e236 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:48:15.016855 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d4668-f1b6-4ba7-9962-cd08ff34f29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:48:15.017510 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d4668-f1b6-4ba7-9962-cd08ff34f29d admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:48:15.017786 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d4668-f1b6-4ba7-9962-cd08ff34f29d admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:48:15.018056 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d4668-f1b6-4ba7-9962-cd08ff34f29d admin admin] PATH_INFO: `/v3/projects/1ae55bc9207247cba466e5dcc05238e8/users/cd6b3e98338548ffa8b33277b3136436/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:48:15.040147 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d4668-f1b6-4ba7-9962-cd08ff34f29d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ae55bc9207247cba466e5dcc05238e8, user_id=cd6b3e98338548ffa8b33277b3136436, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:48:15.041163 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: WARNING py.warnings [None req-cb1d4668-f1b6-4ba7-9962-cd08ff34f29d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 07:48:15.041163 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: warnings.warn(msg) Aug 26 07:48:15.041163 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: Aug 26 07:48:15.043109 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d4668-f1b6-4ba7-9962-cd08ff34f29d admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:48:15.131431 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 742/1501] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:48:14 2022] PUT /identity/v3/projects/1ae55bc9207247cba466e5dcc05238e8/users/cd6b3e98338548ffa8b33277b3136436/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:48:15.143993 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d5848-d584-4209-a029-819f77cdc160 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:48:15.144283 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d5848-d584-4209-a029-819f77cdc160 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:48:15.144555 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d5848-d584-4209-a029-819f77cdc160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:48:15.201395 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-028d5848-d584-4209-a029-819f77cdc160 None None] MFA Rules not processed for user `cd6b3e98338548ffa8b33277b3136436`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:48:15.202595 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-028d5848-d584-4209-a029-819f77cdc160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:48:15.280883 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 760/1502] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:48:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:48:15.294869 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18ce5c-7ee2-4d9b-8298-6ac54bae0be4 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:48:15.295183 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18ce5c-7ee2-4d9b-8298-6ac54bae0be4 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:48:15.295454 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18ce5c-7ee2-4d9b-8298-6ac54bae0be4 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:48:15.296817 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 743/1503] 10.222.0.42 () {54 vars in 964 bytes} [Fri Aug 26 07:48:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:48:15.301659 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12aad7-9510-4e92-b725-f55d8674a0df None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:48:15.301940 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12aad7-9510-4e92-b725-f55d8674a0df None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:48:15.302211 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12aad7-9510-4e92-b725-f55d8674a0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:48:15.332541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:48:15.379239 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-7b12aad7-9510-4e92-b725-f55d8674a0df None None] MFA Rules not processed for user `f23fe4069f39499c9ed8e27566eddc77`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:48:15.380448 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-7b12aad7-9510-4e92-b725-f55d8674a0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:48:15.456577 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 761/1504] 10.222.0.42 () {58 vars in 1061 bytes} [Fri Aug 26 07:48:15 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:48:15.466958 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18ce5c-7ee2-4d9b-8298-6ac54bae0be4 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:48:15.468506 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-3f18ce5c-7ee2-4d9b-8298-6ac54bae0be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:48:15.520283 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:48:15.574467 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18ce5c-7ee2-4d9b-8298-6ac54bae0be4 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:48:15.648018 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb7901c-c844-4b7c-8472-e432bf8d4c13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:48:15.648622 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7901c-c844-4b7c-8472-e432bf8d4c13 service cinder] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:48:15.648904 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7901c-c844-4b7c-8472-e432bf8d4c13 service cinder] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:48:15.649180 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7901c-c844-4b7c-8472-e432bf8d4c13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:48:15.650782 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-eeb7901c-c844-4b7c-8472-e432bf8d4c13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:48:15.750088 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb7901c-c844-4b7c-8472-e432bf8d4c13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:48:15.751504 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb7901c-c844-4b7c-8472-e432bf8d4c13 service cinder] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:48:15.755103 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:48:15.770207 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 744/1505] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:48:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 07:48:15.828226 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d897327-9506-4d26-8193-9ec594ae8a07 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:48:15.828655 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d897327-9506-4d26-8193-9ec594ae8a07 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:48:15.828779 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d897327-9506-4d26-8193-9ec594ae8a07 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:48:15.830310 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 762/1506] 10.222.0.42 () {52 vars in 830 bytes} [Fri Aug 26 07:48:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:48:15.838557 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb7901c-c844-4b7c-8472-e432bf8d4c13 service cinder] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:48:15.839849 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-eeb7901c-c844-4b7c-8472-e432bf8d4c13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:48:15.939229 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb7901c-c844-4b7c-8472-e432bf8d4c13 service cinder] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:48:16.032484 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21a3e3-ddf7-4eff-b500-dc8109d05159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:48:16.033045 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21a3e3-ddf7-4eff-b500-dc8109d05159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:48:16.033350 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21a3e3-ddf7-4eff-b500-dc8109d05159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:48:16.033628 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21a3e3-ddf7-4eff-b500-dc8109d05159 admin admin] PATH_INFO: `/v3/users/cd6b3e98338548ffa8b33277b3136436` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:48:16.045745 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de21a3e3-ddf7-4eff-b500-dc8109d05159 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd6b3e98338548ffa8b33277b3136436)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:48:16.046773 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: WARNING py.warnings [None req-de21a3e3-ddf7-4eff-b500-dc8109d05159 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 07:48:16.046773 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: warnings.warn(msg) Aug 26 07:48:16.046773 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: Aug 26 07:48:16.048021 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de21a3e3-ddf7-4eff-b500-dc8109d05159 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:48:16.058761 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:48:16.257275 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-de21a3e3-ddf7-4eff-b500-dc8109d05159 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd6b3e98338548ffa8b33277b3136436'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:48:16.257838 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-de21a3e3-ddf7-4eff-b500-dc8109d05159 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd6b3e98338548ffa8b33277b3136436'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:48:16.333827 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-de21a3e3-ddf7-4eff-b500-dc8109d05159 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd6b3e98338548ffa8b33277b3136436'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:48:16.334190 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-de21a3e3-ddf7-4eff-b500-dc8109d05159 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd6b3e98338548ffa8b33277b3136436'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:48:16.351840 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-de21a3e3-ddf7-4eff-b500-dc8109d05159 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd6b3e98338548ffa8b33277b3136436'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:48:16.382275 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 745/1507] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:48:15 2022] DELETE /identity/v3/users/cd6b3e98338548ffa8b33277b3136436 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:48:16.386727 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256110bf-0c48-442c-9e5e-6cba1eaa913c None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:48:16.387039 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256110bf-0c48-442c-9e5e-6cba1eaa913c None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:48:16.387315 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256110bf-0c48-442c-9e5e-6cba1eaa913c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:48:16.447636 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-256110bf-0c48-442c-9e5e-6cba1eaa913c None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:48:16.448846 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-256110bf-0c48-442c-9e5e-6cba1eaa913c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:48:16.527211 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:48:16.540828 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 763/1508] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:48:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:48:16.551076 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21a3e3-ddf7-4eff-b500-dc8109d05159 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:48:16.553035 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-de21a3e3-ddf7-4eff-b500-dc8109d05159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:48:16.654997 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21a3e3-ddf7-4eff-b500-dc8109d05159 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:48:16.710006 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:48:16.729029 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89859da-b9b2-4527-889f-300c328b9b93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:48:16.731095 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89859da-b9b2-4527-889f-300c328b9b93 service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:48:16.731095 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89859da-b9b2-4527-889f-300c328b9b93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:48:16.731095 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89859da-b9b2-4527-889f-300c328b9b93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:48:16.731896 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-c89859da-b9b2-4527-889f-300c328b9b93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:48:16.846375 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89859da-b9b2-4527-889f-300c328b9b93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:48:16.847855 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89859da-b9b2-4527-889f-300c328b9b93 service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:48:16.869589 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 746/1509] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:48:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:48:17.389463 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256110bf-0c48-442c-9e5e-6cba1eaa913c None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:48:17.398873 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-256110bf-0c48-442c-9e5e-6cba1eaa913c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:48:17.403723 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256110bf-0c48-442c-9e5e-6cba1eaa913c None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:48:17.526442 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bad419-aa16-40a2-b3c0-93efba4d37f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:48:17.527022 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bad419-aa16-40a2-b3c0-93efba4d37f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:48:17.527305 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bad419-aa16-40a2-b3c0-93efba4d37f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:48:17.527575 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bad419-aa16-40a2-b3c0-93efba4d37f8 admin admin] PATH_INFO: `/v3/projects/1ae55bc9207247cba466e5dcc05238e8` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:48:17.538653 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bad419-aa16-40a2-b3c0-93efba4d37f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ae55bc9207247cba466e5dcc05238e8)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:48:17.539763 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: WARNING py.warnings [None req-d3bad419-aa16-40a2-b3c0-93efba4d37f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 07:48:17.539763 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: warnings.warn(msg) Aug 26 07:48:17.539763 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: Aug 26 07:48:17.540955 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bad419-aa16-40a2-b3c0-93efba4d37f8 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:48:17.696718 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-d3bad419-aa16-40a2-b3c0-93efba4d37f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ae55bc9207247cba466e5dcc05238e8', 'request_id': 'req-d3bad419-aa16-40a2-b3c0-93efba4d37f8'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:48:17.703219 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-d3bad419-aa16-40a2-b3c0-93efba4d37f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ae55bc9207247cba466e5dcc05238e8', 'request_id': 'req-d3bad419-aa16-40a2-b3c0-93efba4d37f8'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:48:17.719868 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-d3bad419-aa16-40a2-b3c0-93efba4d37f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ae55bc9207247cba466e5dcc05238e8', 'request_id': 'req-d3bad419-aa16-40a2-b3c0-93efba4d37f8'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:48:17.841509 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-d3bad419-aa16-40a2-b3c0-93efba4d37f8 admin admin] The token cache is being invalidate because project 1ae55bc9207247cba466e5dcc05238e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:48:17.841716 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-d3bad419-aa16-40a2-b3c0-93efba4d37f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:48:17.842114 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-d3bad419-aa16-40a2-b3c0-93efba4d37f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:48:17.843884 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 764/1510] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:48:17 2022] DELETE /identity/v3/projects/1ae55bc9207247cba466e5dcc05238e8 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:48:26.865131 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=62 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:48:27.839238 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:49:48.084044 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdc7ba-14dc-488c-8f31-eb1af1a1e455 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:49:48.084741 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdc7ba-14dc-488c-8f31-eb1af1a1e455 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:49:48.084741 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdc7ba-14dc-488c-8f31-eb1af1a1e455 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:49:48.086744 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 747/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 07:49:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:49:48.092413 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3ca74-24e9-4d2c-84af-7bee037a249b None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:49:48.093001 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3ca74-24e9-4d2c-84af-7bee037a249b None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:49:48.093001 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3ca74-24e9-4d2c-84af-7bee037a249b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:49:48.216605 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-c3f3ca74-24e9-4d2c-84af-7bee037a249b None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:49:48.217917 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-c3f3ca74-24e9-4d2c-84af-7bee037a249b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:49:48.346774 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 765/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 07:49:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:49:48.526803 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cdc7ba-14dc-488c-8f31-eb1af1a1e455 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:49:48.529102 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-c4cdc7ba-14dc-488c-8f31-eb1af1a1e455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:49:48.670389 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cdc7ba-14dc-488c-8f31-eb1af1a1e455 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:49:48.677563 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94133eff-8a2f-46d6-a7bb-7a49449c2f7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc92c0a0a2cc4722868e6877bac93ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:49:48.678208 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94133eff-8a2f-46d6-a7bb-7a49449c2f7d service nova] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:49:48.678491 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94133eff-8a2f-46d6-a7bb-7a49449c2f7d service nova] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:49:48.678765 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94133eff-8a2f-46d6-a7bb-7a49449c2f7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:49:48.689398 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94133eff-8a2f-46d6-a7bb-7a49449c2f7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:49:48.691933 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94133eff-8a2f-46d6-a7bb-7a49449c2f7d service nova] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:49:48.703113 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 748/1513] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:49:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:49:49.604111 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253a8fd-197d-42b9-969b-8851b4348686 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:49:49.604697 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253a8fd-197d-42b9-969b-8851b4348686 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:49:49.604697 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253a8fd-197d-42b9-969b-8851b4348686 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:49:49.606037 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 766/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 07:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:49:49.611254 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b27420-5e79-4cbc-848c-308393eecd34 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:49:49.611923 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b27420-5e79-4cbc-848c-308393eecd34 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:49:49.611923 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b27420-5e79-4cbc-848c-308393eecd34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:49:49.633662 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-14b27420-5e79-4cbc-848c-308393eecd34 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:49:49.635134 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-14b27420-5e79-4cbc-848c-308393eecd34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:49:49.643764 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 749/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 07:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:49:49.801290 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253a8fd-197d-42b9-969b-8851b4348686 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:49:49.816521 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253a8fd-197d-42b9-969b-8851b4348686 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:49:49.825861 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fa516-ba75-4065-9c93-9667eb688c40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc92c0a0a2cc4722868e6877bac93ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:49:49.825861 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fa516-ba75-4065-9c93-9667eb688c40 service nova] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:49:49.825861 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fa516-ba75-4065-9c93-9667eb688c40 service nova] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:49:49.825861 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fa516-ba75-4065-9c93-9667eb688c40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:49:49.833858 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9fa516-ba75-4065-9c93-9667eb688c40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:49:49.835618 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9fa516-ba75-4065-9c93-9667eb688c40 service nova] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:49:49.846114 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 767/1516] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:49:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:49:51.322833 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c305a0-6d29-4c0b-944b-7098ec72fc74 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:49:51.323478 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c305a0-6d29-4c0b-944b-7098ec72fc74 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:49:51.323478 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c305a0-6d29-4c0b-944b-7098ec72fc74 None None] PATH_INFO: `/v3` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:49:51.324781 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 750/1517] 10.222.0.72 () {54 vars in 925 bytes} [Fri Aug 26 07:49:51 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:49:51.354143 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771ed89-dbb0-45e6-9b25-45caf2f6f6a7 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:49:51.354692 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771ed89-dbb0-45e6-9b25-45caf2f6f6a7 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:49:51.354692 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771ed89-dbb0-45e6-9b25-45caf2f6f6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:49:51.421844 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-9771ed89-dbb0-45e6-9b25-45caf2f6f6a7 None None] MFA Rules not processed for user `f6c2bc293f1b4daca83e8d6dff66a316`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:49:51.424039 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-9771ed89-dbb0-45e6-9b25-45caf2f6f6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:49:51.441984 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:49:51.504824 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 768/1518] 10.222.0.72 () {58 vars in 1015 bytes} [Fri Aug 26 07:49:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:49:55.768616 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173433de-b0a4-4771-a810-8e30df07ef1a None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:49:55.769100 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173433de-b0a4-4771-a810-8e30df07ef1a None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:49:55.769201 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173433de-b0a4-4771-a810-8e30df07ef1a None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:49:55.770819 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 751/1519] 10.222.0.42 () {54 vars in 961 bytes} [Fri Aug 26 07:49:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:49:55.775773 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07585f0-79aa-4696-a0bc-bef1808bad72 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:49:55.776238 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07585f0-79aa-4696-a0bc-bef1808bad72 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:49:55.776377 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07585f0-79aa-4696-a0bc-bef1808bad72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:49:55.797904 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-a07585f0-79aa-4696-a0bc-bef1808bad72 None None] MFA Rules not processed for user `f6c2bc293f1b4daca83e8d6dff66a316`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:49:55.799249 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-a07585f0-79aa-4696-a0bc-bef1808bad72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:49:55.808186 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 769/1520] 10.222.0.42 () {58 vars in 1058 bytes} [Fri Aug 26 07:49:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:49:55.817148 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173433de-b0a4-4771-a810-8e30df07ef1a None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:49:55.834640 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173433de-b0a4-4771-a810-8e30df07ef1a None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:49:55.839928 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e2965-d9ec-481b-80b2-8488f1f2604e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c2bc293f1b4daca83e8d6dff66a316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:49:55.840545 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e2965-d9ec-481b-80b2-8488f1f2604e service placement] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:49:55.840820 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e2965-d9ec-481b-80b2-8488f1f2604e service placement] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:49:55.841088 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e2965-d9ec-481b-80b2-8488f1f2604e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:49:55.850672 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8e2965-d9ec-481b-80b2-8488f1f2604e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:49:55.852304 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8e2965-d9ec-481b-80b2-8488f1f2604e service placement] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:49:55.861939 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 752/1521] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:49:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:50:01.119743 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1badd-3833-4a5b-b984-bfd026439ac3 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:50:01.126822 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1badd-3833-4a5b-b984-bfd026439ac3 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:50:01.126822 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1badd-3833-4a5b-b984-bfd026439ac3 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:50:01.126822 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 770/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 07:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:50:01.127153 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef20dd-aab7-433a-bdc7-633425b2160b None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:50:01.127153 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef20dd-aab7-433a-bdc7-633425b2160b None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:50:01.127622 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef20dd-aab7-433a-bdc7-633425b2160b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:50:01.147290 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-6cef20dd-aab7-433a-bdc7-633425b2160b None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:50:01.148579 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-6cef20dd-aab7-433a-bdc7-633425b2160b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:50:01.156643 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 753/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 07:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:50:01.322514 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1badd-3833-4a5b-b984-bfd026439ac3 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:50:01.340692 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1badd-3833-4a5b-b984-bfd026439ac3 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:50:01.346529 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78548250-bf60-4728-b767-6575bd6ddfa8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc92c0a0a2cc4722868e6877bac93ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:50:01.347167 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78548250-bf60-4728-b767-6575bd6ddfa8 service nova] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:50:01.347447 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78548250-bf60-4728-b767-6575bd6ddfa8 service nova] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:50:01.347718 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78548250-bf60-4728-b767-6575bd6ddfa8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:50:01.356332 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78548250-bf60-4728-b767-6575bd6ddfa8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:50:01.357948 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78548250-bf60-4728-b767-6575bd6ddfa8 service nova] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:50:01.368462 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 771/1524] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:50:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:50:02.288989 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb75b8-624a-40d5-967e-6dcd491d6199 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:50:02.289599 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb75b8-624a-40d5-967e-6dcd491d6199 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:50:02.289814 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb75b8-624a-40d5-967e-6dcd491d6199 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:50:02.291410 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 754/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 07:50:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:50:02.296998 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abc93b-d0ce-49ec-86db-dca88e285837 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:50:02.297764 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abc93b-d0ce-49ec-86db-dca88e285837 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:50:02.297954 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abc93b-d0ce-49ec-86db-dca88e285837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:50:02.319181 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-a5abc93b-d0ce-49ec-86db-dca88e285837 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:50:02.320408 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-a5abc93b-d0ce-49ec-86db-dca88e285837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:50:02.328390 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 772/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 07:50:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:50:02.489146 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb75b8-624a-40d5-967e-6dcd491d6199 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:50:02.506596 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb75b8-624a-40d5-967e-6dcd491d6199 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:50:02.514863 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494b9ea-3c90-4900-974b-4297b626f73c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc92c0a0a2cc4722868e6877bac93ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:50:02.515550 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494b9ea-3c90-4900-974b-4297b626f73c service nova] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:50:02.515942 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494b9ea-3c90-4900-974b-4297b626f73c service nova] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:50:02.516231 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494b9ea-3c90-4900-974b-4297b626f73c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:50:02.525971 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a494b9ea-3c90-4900-974b-4297b626f73c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:50:02.527593 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a494b9ea-3c90-4900-974b-4297b626f73c service nova] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:50:02.537946 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 755/1527] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:50:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:50:06.673040 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fda06-a6af-4990-aeae-4ce5cff0eae3 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:50:06.673813 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fda06-a6af-4990-aeae-4ce5cff0eae3 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:50:06.673813 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fda06-a6af-4990-aeae-4ce5cff0eae3 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:50:06.675148 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 773/1528] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 07:50:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:50:06.680839 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8c10b-e7f4-4145-b635-24cc9e819854 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:50:06.681238 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8c10b-e7f4-4145-b635-24cc9e819854 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:50:06.681373 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8c10b-e7f4-4145-b635-24cc9e819854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:50:06.701224 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-dcb8c10b-e7f4-4145-b635-24cc9e819854 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:50:06.702449 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-dcb8c10b-e7f4-4145-b635-24cc9e819854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:50:06.710706 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 756/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 07:50:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:50:07.004388 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0fda06-a6af-4990-aeae-4ce5cff0eae3 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:50:07.009250 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-1d0fda06-a6af-4990-aeae-4ce5cff0eae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:50:07.090358 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0fda06-a6af-4990-aeae-4ce5cff0eae3 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:50:07.093966 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561abbd4-3494-4d17-ac5c-a4810077e01c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:50:07.095514 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561abbd4-3494-4d17-ac5c-a4810077e01c service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:50:07.095789 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561abbd4-3494-4d17-ac5c-a4810077e01c service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:50:07.096058 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561abbd4-3494-4d17-ac5c-a4810077e01c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:50:07.105081 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561abbd4-3494-4d17-ac5c-a4810077e01c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:50:07.106496 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561abbd4-3494-4d17-ac5c-a4810077e01c service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:50:07.116214 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 774/1530] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:50:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 07:50:09.058294 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab92c7-1ad0-4a01-a210-11d3789efd8c None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:50:09.058845 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab92c7-1ad0-4a01-a210-11d3789efd8c None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:50:09.058845 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab92c7-1ad0-4a01-a210-11d3789efd8c None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:50:09.060317 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 757/1531] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 07:50:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:50:09.066360 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfb9f6-beb4-4007-9253-699124131750 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:50:09.066814 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfb9f6-beb4-4007-9253-699124131750 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:50:09.066914 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfb9f6-beb4-4007-9253-699124131750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:50:09.086998 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-e9bfb9f6-beb4-4007-9253-699124131750 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:50:09.088223 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-e9bfb9f6-beb4-4007-9253-699124131750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:50:09.096209 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 775/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 07:50:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:50:09.382630 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab92c7-1ad0-4a01-a210-11d3789efd8c None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:50:09.393751 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab92c7-1ad0-4a01-a210-11d3789efd8c None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:50:09.397333 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a015b9e-fe65-4260-ba39-a83b0ac61fa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:50:09.397942 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a015b9e-fe65-4260-ba39-a83b0ac61fa5 service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:50:09.398223 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a015b9e-fe65-4260-ba39-a83b0ac61fa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:50:09.398498 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a015b9e-fe65-4260-ba39-a83b0ac61fa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:50:09.408505 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a015b9e-fe65-4260-ba39-a83b0ac61fa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:50:09.410261 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a015b9e-fe65-4260-ba39-a83b0ac61fa5 service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:50:09.420350 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 758/1533] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:50:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:50:13.402275 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c72919-597c-450c-9c1c-eb55d6d79f40 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:50:13.402925 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c72919-597c-450c-9c1c-eb55d6d79f40 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:50:13.402925 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c72919-597c-450c-9c1c-eb55d6d79f40 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:50:13.404247 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 776/1534] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 07:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:50:13.410612 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ac893-c401-4d56-a398-50fb76237731 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:50:13.411362 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ac893-c401-4d56-a398-50fb76237731 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:50:13.411362 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ac893-c401-4d56-a398-50fb76237731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:50:13.437465 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-e22ac893-c401-4d56-a398-50fb76237731 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:50:13.439546 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-e22ac893-c401-4d56-a398-50fb76237731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:50:13.447615 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 759/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 07:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:50:14.029101 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c72919-597c-450c-9c1c-eb55d6d79f40 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:50:14.031111 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-45c72919-597c-450c-9c1c-eb55d6d79f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:50:14.099632 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:50:14.113641 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c72919-597c-450c-9c1c-eb55d6d79f40 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:50:14.117216 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff8d414-5587-4198-98a4-f350b7042905 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:50:14.117820 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8d414-5587-4198-98a4-f350b7042905 service cinder] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:50:14.118120 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8d414-5587-4198-98a4-f350b7042905 service cinder] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:50:14.118392 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8d414-5587-4198-98a4-f350b7042905 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:50:14.127829 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff8d414-5587-4198-98a4-f350b7042905 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:50:14.129263 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff8d414-5587-4198-98a4-f350b7042905 service cinder] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:50:14.139591 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 777/1536] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:50:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:50:16.122858 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb848d9-2826-411e-9ff4-ef66d54b7aa9 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:50:16.123456 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb848d9-2826-411e-9ff4-ef66d54b7aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:50:16.123456 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb848d9-2826-411e-9ff4-ef66d54b7aa9 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:50:16.124767 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 760/1537] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 07:50:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:50:16.130322 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a329c-f1c8-4c9e-b821-b29486b1d9bf None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:50:16.130781 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a329c-f1c8-4c9e-b821-b29486b1d9bf None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:50:16.130899 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a329c-f1c8-4c9e-b821-b29486b1d9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:50:16.153825 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-e15a329c-f1c8-4c9e-b821-b29486b1d9bf None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:50:16.155098 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-e15a329c-f1c8-4c9e-b821-b29486b1d9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:50:16.165587 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 778/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 07:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:50:16.739822 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb848d9-2826-411e-9ff4-ef66d54b7aa9 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:50:16.741529 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-8fb848d9-2826-411e-9ff4-ef66d54b7aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:50:16.754532 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb848d9-2826-411e-9ff4-ef66d54b7aa9 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:50:16.758146 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ffeea-cf33-485c-b345-9a172b07cfd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:50:16.758749 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ffeea-cf33-485c-b345-9a172b07cfd4 service cinder] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:50:16.759062 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ffeea-cf33-485c-b345-9a172b07cfd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:50:16.759338 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ffeea-cf33-485c-b345-9a172b07cfd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:50:16.769486 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470ffeea-cf33-485c-b345-9a172b07cfd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:50:16.770872 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470ffeea-cf33-485c-b345-9a172b07cfd4 service cinder] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:50:16.780364 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 761/1539] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:50:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:50:26.148642 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=11 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:50:26.776204 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=89 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:51:45.960062 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c78f1-7b6a-4817-bdcf-f648d2ff3c8e None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:45.960754 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c78f1-7b6a-4817-bdcf-f648d2ff3c8e None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:45.960754 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c78f1-7b6a-4817-bdcf-f648d2ff3c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:45.992973 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-488c78f1-7b6a-4817-bdcf-f648d2ff3c8e None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:51:45.994205 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-488c78f1-7b6a-4817-bdcf-f648d2ff3c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:46.006646 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 779/1540] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:51:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:51:46.018024 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a4eb5-59d1-482a-9382-20feab0a23f1 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:46.019149 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a4eb5-59d1-482a-9382-20feab0a23f1 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:46.019659 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a4eb5-59d1-482a-9382-20feab0a23f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:46.060766 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-339a4eb5-59d1-482a-9382-20feab0a23f1 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:51:46.063899 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-339a4eb5-59d1-482a-9382-20feab0a23f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:46.081407 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 762/1541] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:51:46.086872 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c78f1-7b6a-4817-bdcf-f648d2ff3c8e None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:46.103927 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c78f1-7b6a-4817-bdcf-f648d2ff3c8e None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:46.111715 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eef588-67d3-4d8c-86cc-810bd0a807f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:46.114706 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eef588-67d3-4d8c-86cc-810bd0a807f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:46.114706 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eef588-67d3-4d8c-86cc-810bd0a807f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:46.114706 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eef588-67d3-4d8c-86cc-810bd0a807f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:46.114706 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eef588-67d3-4d8c-86cc-810bd0a807f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:51:46.114706 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eef588-67d3-4d8c-86cc-810bd0a807f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:46.116993 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eef588-67d3-4d8c-86cc-810bd0a807f4 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:46.137925 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 780/1542] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:51:46.147279 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a4eb5-59d1-482a-9382-20feab0a23f1 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:46.165018 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a4eb5-59d1-482a-9382-20feab0a23f1 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:46.174199 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd31f2-5b8e-4b40-a2bd-67e6cf13d33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:46.175195 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd31f2-5b8e-4b40-a2bd-67e6cf13d33b admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:46.175656 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd31f2-5b8e-4b40-a2bd-67e6cf13d33b admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:46.176157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd31f2-5b8e-4b40-a2bd-67e6cf13d33b admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:46.176993 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd31f2-5b8e-4b40-a2bd-67e6cf13d33b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:46.179199 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd31f2-5b8e-4b40-a2bd-67e6cf13d33b admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:46.351570 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 763/1543] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:51:46 2022] POST /identity/v3/projects => generated 405 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:51:46.355675 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eef588-67d3-4d8c-86cc-810bd0a807f4 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:46.372732 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eef588-67d3-4d8c-86cc-810bd0a807f4 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:46.471519 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53e904-ad43-4ba0-91ef-cd1a2f3cb3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:46.472146 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53e904-ad43-4ba0-91ef-cd1a2f3cb3c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:46.472436 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53e904-ad43-4ba0-91ef-cd1a2f3cb3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:46.472710 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53e904-ad43-4ba0-91ef-cd1a2f3cb3c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:46.473358 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a53e904-ad43-4ba0-91ef-cd1a2f3cb3c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:46.475952 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34d6df-c2aa-45d0-94f8-4f0918fc5624 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:46.476480 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34d6df-c2aa-45d0-94f8-4f0918fc5624 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:46.476982 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34d6df-c2aa-45d0-94f8-4f0918fc5624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:46.487028 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a53e904-ad43-4ba0-91ef-cd1a2f3cb3c3 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:46.515079 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-6e34d6df-c2aa-45d0-94f8-4f0918fc5624 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:51:46.517088 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-6e34d6df-c2aa-45d0-94f8-4f0918fc5624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:46.535542 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 764/1544] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:51:46.536665 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effaefbf-7ab6-43fd-b70f-55e0f38e0b4d None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:46.536952 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effaefbf-7ab6-43fd-b70f-55e0f38e0b4d None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:46.537222 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effaefbf-7ab6-43fd-b70f-55e0f38e0b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:46.572416 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-effaefbf-7ab6-43fd-b70f-55e0f38e0b4d None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:51:46.578608 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-effaefbf-7ab6-43fd-b70f-55e0f38e0b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:46.578934 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 781/1545] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:51:46 2022] POST /identity/v3/users => generated 303 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:51:46.583903 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad782cff-807e-4e10-8aa9-67b51c8d9d3c None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:46.583903 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad782cff-807e-4e10-8aa9-67b51c8d9d3c None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:46.583903 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad782cff-807e-4e10-8aa9-67b51c8d9d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:46.589119 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 765/1546] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:51:46.590370 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f20fdc-e095-48d1-ae85-db9e19453523 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:46.590649 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f20fdc-e095-48d1-ae85-db9e19453523 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:46.590977 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f20fdc-e095-48d1-ae85-db9e19453523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:46.627116 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-13f20fdc-e095-48d1-ae85-db9e19453523 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:51:46.628655 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-ad782cff-807e-4e10-8aa9-67b51c8d9d3c None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:51:46.629968 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-ad782cff-807e-4e10-8aa9-67b51c8d9d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:46.630457 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-13f20fdc-e095-48d1-ae85-db9e19453523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:46.646877 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 766/1547] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:51:46.648198 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dec669-d9db-4e80-a920-e503912e5f01 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:46.648479 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dec669-d9db-4e80-a920-e503912e5f01 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:46.648749 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dec669-d9db-4e80-a920-e503912e5f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:46.650674 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 782/1548] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:51:46.651774 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad782cff-807e-4e10-8aa9-67b51c8d9d3c None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:46.664696 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad782cff-807e-4e10-8aa9-67b51c8d9d3c None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:46.670167 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb3b53-0907-46e9-907c-af24db0223ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:46.670833 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb3b53-0907-46e9-907c-af24db0223ea admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:46.671186 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb3b53-0907-46e9-907c-af24db0223ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:46.671607 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb3b53-0907-46e9-907c-af24db0223ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:46.672514 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb3b53-0907-46e9-907c-af24db0223ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:46.674138 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb3b53-0907-46e9-907c-af24db0223ea admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:46.679916 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-65dec669-d9db-4e80-a920-e503912e5f01 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:51:46.681842 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-65dec669-d9db-4e80-a920-e503912e5f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:46.689244 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 783/1549] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:51:46.690781 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69233fc5-4783-4183-bfad-e9c4bf058bd1 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:46.691172 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69233fc5-4783-4183-bfad-e9c4bf058bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:46.691495 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69233fc5-4783-4183-bfad-e9c4bf058bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:46.695286 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 767/1550] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:51:46.697619 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f825c64-74ef-4c11-a087-a2fad3c19b61 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:46.698387 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f825c64-74ef-4c11-a087-a2fad3c19b61 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:46.699128 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f825c64-74ef-4c11-a087-a2fad3c19b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:46.722260 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-69233fc5-4783-4183-bfad-e9c4bf058bd1 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:51:46.723514 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-69233fc5-4783-4183-bfad-e9c4bf058bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:46.723642 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-9f825c64-74ef-4c11-a087-a2fad3c19b61 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:51:46.724815 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-9f825c64-74ef-4c11-a087-a2fad3c19b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:46.731654 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 784/1551] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:51:46.733213 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69233fc5-4783-4183-bfad-e9c4bf058bd1 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:46.733358 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 768/1552] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:51:46.733883 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca14210-c6cb-4959-a4fa-9614fb1fbf61 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:46.734200 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca14210-c6cb-4959-a4fa-9614fb1fbf61 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:46.734474 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca14210-c6cb-4959-a4fa-9614fb1fbf61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:46.744701 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69233fc5-4783-4183-bfad-e9c4bf058bd1 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:46.749462 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0414999-8e35-4fe1-80c1-23cd7e9d7515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:46.750636 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0414999-8e35-4fe1-80c1-23cd7e9d7515 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:46.751216 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0414999-8e35-4fe1-80c1-23cd7e9d7515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:46.751216 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0414999-8e35-4fe1-80c1-23cd7e9d7515 admin admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:46.751802 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0414999-8e35-4fe1-80c1-23cd7e9d7515 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:51:46.752104 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0414999-8e35-4fe1-80c1-23cd7e9d7515 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:46.753703 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0414999-8e35-4fe1-80c1-23cd7e9d7515 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:46.755325 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-fca14210-c6cb-4959-a4fa-9614fb1fbf61 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:51:46.756539 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-fca14210-c6cb-4959-a4fa-9614fb1fbf61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:46.764695 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 769/1553] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:51:46.768996 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb36d7f-934e-48a0-bbab-9b87081faac2 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:46.768996 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb36d7f-934e-48a0-bbab-9b87081faac2 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:46.769262 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb36d7f-934e-48a0-bbab-9b87081faac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:46.772707 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 785/1554] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:51:46.773926 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0414999-8e35-4fe1-80c1-23cd7e9d7515 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:46.784337 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0414999-8e35-4fe1-80c1-23cd7e9d7515 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:46.790047 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34f56f-d268-4737-b681-e76f8d7e4b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:46.790649 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34f56f-d268-4737-b681-e76f8d7e4b9c admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:46.790928 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34f56f-d268-4737-b681-e76f8d7e4b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:46.791247 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34f56f-d268-4737-b681-e76f8d7e4b9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:46.791920 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34f56f-d268-4737-b681-e76f8d7e4b9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:46.792253 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-6cb36d7f-934e-48a0-bbab-9b87081faac2 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:51:46.793462 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-6cb36d7f-934e-48a0-bbab-9b87081faac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:46.793582 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34f56f-d268-4737-b681-e76f8d7e4b9c admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:46.802163 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 770/1555] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:51:46.803310 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc006ca7-c28d-4c39-ad75-c695c5b3b359 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:46.803592 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc006ca7-c28d-4c39-ad75-c695c5b3b359 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:46.803917 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc006ca7-c28d-4c39-ad75-c695c5b3b359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:46.807433 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 786/1556] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:51:46.807433 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bdc2d2-d324-4930-af43-f0bec6ccd7e7 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:46.807433 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bdc2d2-d324-4930-af43-f0bec6ccd7e7 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:46.807433 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bdc2d2-d324-4930-af43-f0bec6ccd7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:46.826519 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-82bdc2d2-d324-4930-af43-f0bec6ccd7e7 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:51:46.826750 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-fc006ca7-c28d-4c39-ad75-c695c5b3b359 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:51:46.827761 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-fc006ca7-c28d-4c39-ad75-c695c5b3b359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:46.827885 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-82bdc2d2-d324-4930-af43-f0bec6ccd7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:46.836356 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 771/1557] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:51:46.839160 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc006ca7-c28d-4c39-ad75-c695c5b3b359 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:46.839308 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 787/1558] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:51:46.839308 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bdc2d2-d324-4930-af43-f0bec6ccd7e7 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:46.849731 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bdc2d2-d324-4930-af43-f0bec6ccd7e7 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:46.850245 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc006ca7-c28d-4c39-ad75-c695c5b3b359 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:46.854428 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbae73-d32b-4ba4-97b0-7c995ff3cffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:46.855054 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbae73-d32b-4ba4-97b0-7c995ff3cffb admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:46.855199 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8c188-c4c2-4205-ac43-dde02255cd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:46.855319 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbae73-d32b-4ba4-97b0-7c995ff3cffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:46.855586 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbae73-d32b-4ba4-97b0-7c995ff3cffb admin admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:46.855727 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8c188-c4c2-4205-ac43-dde02255cd1e admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:46.856006 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8c188-c4c2-4205-ac43-dde02255cd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:46.856233 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fbae73-d32b-4ba4-97b0-7c995ff3cffb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:51:46.856394 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8c188-c4c2-4205-ac43-dde02255cd1e admin admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:46.856531 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fbae73-d32b-4ba4-97b0-7c995ff3cffb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:46.857072 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d8c188-c4c2-4205-ac43-dde02255cd1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:51:46.857420 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d8c188-c4c2-4205-ac43-dde02255cd1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:46.858132 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fbae73-d32b-4ba4-97b0-7c995ff3cffb admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:46.858436 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: WARNING py.warnings [None req-95d8c188-c4c2-4205-ac43-dde02255cd1e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 26 07:51:46.858436 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: warnings.warn(msg) Aug 26 07:51:46.858436 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: Aug 26 07:51:46.859349 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d8c188-c4c2-4205-ac43-dde02255cd1e admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:46.870312 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 788/1559] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:51:46.871837 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428bc720-df5d-4cd1-9852-c0cbb88756fa None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:46.872325 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428bc720-df5d-4cd1-9852-c0cbb88756fa None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:46.872450 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 772/1560] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:51:46.873084 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8c188-c4c2-4205-ac43-dde02255cd1e admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:46.879136 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428bc720-df5d-4cd1-9852-c0cbb88756fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:46.889789 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8c188-c4c2-4205-ac43-dde02255cd1e admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:46.895313 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e3076-1523-4ed4-aa4c-467b34fcd85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:46.895815 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e3076-1523-4ed4-aa4c-467b34fcd85a admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:46.896095 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e3076-1523-4ed4-aa4c-467b34fcd85a admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:46.896418 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e3076-1523-4ed4-aa4c-467b34fcd85a admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:46.897023 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e3076-1523-4ed4-aa4c-467b34fcd85a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:46.898917 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e3076-1523-4ed4-aa4c-467b34fcd85a admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:46.900380 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-428bc720-df5d-4cd1-9852-c0cbb88756fa None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:51:46.901597 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-428bc720-df5d-4cd1-9852-c0cbb88756fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:46.910101 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 789/1561] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:51:46.914001 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428bc720-df5d-4cd1-9852-c0cbb88756fa None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:46.920651 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428bc720-df5d-4cd1-9852-c0cbb88756fa None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:46.925623 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b74fb-6a79-470b-a423-24ea8906263e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:46.926291 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b74fb-6a79-470b-a423-24ea8906263e admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:46.926560 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b74fb-6a79-470b-a423-24ea8906263e admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:46.926829 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b74fb-6a79-470b-a423-24ea8906263e admin admin] PATH_INFO: `/v3/projects/6a154190ea0646a0ad61257b79c81748/users/d028d38de3af4ac3b8aae463dab108f9/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:46.942953 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b74fb-6a79-470b-a423-24ea8906263e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a154190ea0646a0ad61257b79c81748, user_id=d028d38de3af4ac3b8aae463dab108f9, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:46.944062 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: WARNING py.warnings [None req-107b74fb-6a79-470b-a423-24ea8906263e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 07:51:46.944062 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: warnings.warn(msg) Aug 26 07:51:46.944062 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: Aug 26 07:51:46.946028 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b74fb-6a79-470b-a423-24ea8906263e admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:46.990460 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 773/1562] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:51:46 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:51:46.991870 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc667f4a-0a9c-413e-85c2-96c95268a3f4 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:46.992150 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc667f4a-0a9c-413e-85c2-96c95268a3f4 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:46.992419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc667f4a-0a9c-413e-85c2-96c95268a3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:47.013379 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-dc667f4a-0a9c-413e-85c2-96c95268a3f4 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:51:47.014642 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-dc667f4a-0a9c-413e-85c2-96c95268a3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:47.046445 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 790/1563] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:51:46 2022] PUT /identity/v3/projects/6a154190ea0646a0ad61257b79c81748/users/d028d38de3af4ac3b8aae463dab108f9/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:51:47.059438 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b74fb-6a79-470b-a423-24ea8906263e admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:47.083791 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 774/1564] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:51:47.085040 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1a3f3-59e3-4197-ba01-6b2452549ef1 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:47.085338 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1a3f3-59e3-4197-ba01-6b2452549ef1 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:47.085612 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1a3f3-59e3-4197-ba01-6b2452549ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:47.093260 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:51:47.104851 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-4dc1a3f3-59e3-4197-ba01-6b2452549ef1 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:51:47.106062 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-4dc1a3f3-59e3-4197-ba01-6b2452549ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:47.123528 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b74fb-6a79-470b-a423-24ea8906263e admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:47.130630 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4881a-11aa-44aa-a737-4f01649b0924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:47.131505 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4881a-11aa-44aa-a737-4f01649b0924 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:47.131949 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4881a-11aa-44aa-a737-4f01649b0924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:47.132406 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4881a-11aa-44aa-a737-4f01649b0924 admin admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:47.133480 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af4881a-11aa-44aa-a737-4f01649b0924 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:51:47.133981 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af4881a-11aa-44aa-a737-4f01649b0924 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:47.136908 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af4881a-11aa-44aa-a737-4f01649b0924 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:47.143977 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:51:47.150533 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 791/1565] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:51:47.151378 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4881a-11aa-44aa-a737-4f01649b0924 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:47.167930 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4881a-11aa-44aa-a737-4f01649b0924 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:47.173872 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeff63f-7cc7-4d5a-ad72-655f0eb1d004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:47.174480 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeff63f-7cc7-4d5a-ad72-655f0eb1d004 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:47.174755 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeff63f-7cc7-4d5a-ad72-655f0eb1d004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:47.178562 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 775/1566] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:51:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:51:47.178702 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeff63f-7cc7-4d5a-ad72-655f0eb1d004 admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:47.178801 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1a3f3-59e3-4197-ba01-6b2452549ef1 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:47.178912 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeff63f-7cc7-4d5a-ad72-655f0eb1d004 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:47.178912 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: WARNING py.warnings [None req-bbeff63f-7cc7-4d5a-ad72-655f0eb1d004 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 07:51:47.178912 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: warnings.warn(msg) Aug 26 07:51:47.178912 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: Aug 26 07:51:47.178912 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeff63f-7cc7-4d5a-ad72-655f0eb1d004 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:47.188630 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1a3f3-59e3-4197-ba01-6b2452549ef1 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:47.193416 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d43aa53-d869-42e5-93ee-8e497f2706f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:47.194026 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43aa53-d869-42e5-93ee-8e497f2706f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:47.194309 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43aa53-d869-42e5-93ee-8e497f2706f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:47.194583 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43aa53-d869-42e5-93ee-8e497f2706f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:47.195256 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d43aa53-d869-42e5-93ee-8e497f2706f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:47.197159 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d43aa53-d869-42e5-93ee-8e497f2706f4 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:47.280654 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 792/1567] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:51:47 2022] POST /identity/v3/projects => generated 357 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:51:47.281760 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeff63f-7cc7-4d5a-ad72-655f0eb1d004 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:47.346585 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeff63f-7cc7-4d5a-ad72-655f0eb1d004 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:47.354046 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0a5ce-2e69-410c-8e77-0f27a12cd497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:47.355036 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0a5ce-2e69-410c-8e77-0f27a12cd497 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:47.355695 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0a5ce-2e69-410c-8e77-0f27a12cd497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:47.355904 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0a5ce-2e69-410c-8e77-0f27a12cd497 admin admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:47.357035 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0a5ce-2e69-410c-8e77-0f27a12cd497 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:51:47.357523 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0a5ce-2e69-410c-8e77-0f27a12cd497 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:47.361250 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0a5ce-2e69-410c-8e77-0f27a12cd497 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:47.366732 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 776/1568] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:51:47 2022] POST /identity/v3/projects => generated 393 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:51:47.367868 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d43aa53-d869-42e5-93ee-8e497f2706f4 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:47.379597 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 793/1569] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:51:47.381983 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128f659-8fe8-45cc-bc47-bdc2d555ebdd None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:47.382719 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128f659-8fe8-45cc-bc47-bdc2d555ebdd None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:47.383202 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128f659-8fe8-45cc-bc47-bdc2d555ebdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:47.422325 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-c128f659-8fe8-45cc-bc47-bdc2d555ebdd None None] MFA Rules not processed for user `d028d38de3af4ac3b8aae463dab108f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:51:47.423972 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-c128f659-8fe8-45cc-bc47-bdc2d555ebdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:47.455705 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d43aa53-d869-42e5-93ee-8e497f2706f4 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:47.461113 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72673b-0c47-4661-9b23-d77a1ae97eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:47.467091 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72673b-0c47-4661-9b23-d77a1ae97eaf admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:47.467091 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72673b-0c47-4661-9b23-d77a1ae97eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:47.467091 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72673b-0c47-4661-9b23-d77a1ae97eaf admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:47.467091 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72673b-0c47-4661-9b23-d77a1ae97eaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:47.467091 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: WARNING py.warnings [None req-0c72673b-0c47-4661-9b23-d77a1ae97eaf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 07:51:47.467091 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: warnings.warn(msg) Aug 26 07:51:47.467091 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: Aug 26 07:51:47.467786 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72673b-0c47-4661-9b23-d77a1ae97eaf admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:47.493976 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 794/1570] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:51:47 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:51:47.494836 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c128f659-8fe8-45cc-bc47-bdc2d555ebdd None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:47.505295 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c128f659-8fe8-45cc-bc47-bdc2d555ebdd None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:47.510046 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81caad9-1a6b-4d43-b5db-b43026916966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:47.510634 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81caad9-1a6b-4d43-b5db-b43026916966 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:47.518652 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81caad9-1a6b-4d43-b5db-b43026916966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:47.518652 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81caad9-1a6b-4d43-b5db-b43026916966 admin admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:47.518652 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81caad9-1a6b-4d43-b5db-b43026916966 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:51:47.518652 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81caad9-1a6b-4d43-b5db-b43026916966 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:47.518652 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81caad9-1a6b-4d43-b5db-b43026916966 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:47.525428 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 795/1571] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:51:47.526181 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81caad9-1a6b-4d43-b5db-b43026916966 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:47.536442 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81caad9-1a6b-4d43-b5db-b43026916966 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:47.541035 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7aa96-f353-4cbd-a108-3e162ef9a23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:47.541612 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7aa96-f353-4cbd-a108-3e162ef9a23a admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:47.541890 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7aa96-f353-4cbd-a108-3e162ef9a23a admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:47.542177 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7aa96-f353-4cbd-a108-3e162ef9a23a admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:47.542768 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e7aa96-f353-4cbd-a108-3e162ef9a23a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:47.544665 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e7aa96-f353-4cbd-a108-3e162ef9a23a admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:47.557510 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:51:47.600588 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 777/1572] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:51:47 2022] POST /identity/v3/users => generated 287 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:51:47.601774 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72673b-0c47-4661-9b23-d77a1ae97eaf admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:47.612901 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72673b-0c47-4661-9b23-d77a1ae97eaf admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:47.617828 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc0344a-4c25-4511-abf7-67af8df18dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:47.618429 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0344a-4c25-4511-abf7-67af8df18dec admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:47.618701 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0344a-4c25-4511-abf7-67af8df18dec admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:47.618974 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0344a-4c25-4511-abf7-67af8df18dec admin admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:47.619650 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc0344a-4c25-4511-abf7-67af8df18dec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:51:47.619952 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc0344a-4c25-4511-abf7-67af8df18dec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:47.621626 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc0344a-4c25-4511-abf7-67af8df18dec admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:47.634585 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 778/1573] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:51:47.635352 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc0344a-4c25-4511-abf7-67af8df18dec admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:47.647206 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc0344a-4c25-4511-abf7-67af8df18dec admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:47.652168 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee0309-ac04-4367-9bb2-3caa845fd3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:47.652774 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee0309-ac04-4367-9bb2-3caa845fd3f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:47.653074 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee0309-ac04-4367-9bb2-3caa845fd3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:47.653343 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee0309-ac04-4367-9bb2-3caa845fd3f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:47.653962 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ee0309-ac04-4367-9bb2-3caa845fd3f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:47.656416 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ee0309-ac04-4367-9bb2-3caa845fd3f7 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:47.686837 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 796/1574] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:51:47 2022] POST /identity/v3/projects => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:51:47.687912 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7aa96-f353-4cbd-a108-3e162ef9a23a admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:47.754252 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7aa96-f353-4cbd-a108-3e162ef9a23a admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:47.758920 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5811f85-2e0d-4326-9680-41fab9b630b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:47.760046 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5811f85-2e0d-4326-9680-41fab9b630b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:47.760314 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5811f85-2e0d-4326-9680-41fab9b630b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:47.760581 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5811f85-2e0d-4326-9680-41fab9b630b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:47.761205 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5811f85-2e0d-4326-9680-41fab9b630b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:47.763167 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5811f85-2e0d-4326-9680-41fab9b630b3 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:47.789386 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 779/1575] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:51:47 2022] POST /identity/v3/users => generated 279 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:51:47.790278 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee0309-ac04-4367-9bb2-3caa845fd3f7 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:47.800871 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee0309-ac04-4367-9bb2-3caa845fd3f7 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:47.805752 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c267b6db-3588-4cba-b39b-dcb6891b06e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:47.806341 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267b6db-3588-4cba-b39b-dcb6891b06e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:47.806616 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267b6db-3588-4cba-b39b-dcb6891b06e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:47.806883 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267b6db-3588-4cba-b39b-dcb6891b06e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:47.807566 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c267b6db-3588-4cba-b39b-dcb6891b06e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:47.809465 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c267b6db-3588-4cba-b39b-dcb6891b06e4 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:47.892619 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 797/1576] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:51:47 2022] POST /identity/v3/users => generated 297 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:51:47.893545 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5811f85-2e0d-4326-9680-41fab9b630b3 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:47.903468 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5811f85-2e0d-4326-9680-41fab9b630b3 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:47.908994 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb9f0af-dad7-44a0-a1fe-5d77130cd71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:47.909592 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9f0af-dad7-44a0-a1fe-5d77130cd71b admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:47.909868 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9f0af-dad7-44a0-a1fe-5d77130cd71b admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:47.910141 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9f0af-dad7-44a0-a1fe-5d77130cd71b admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:47.910759 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb9f0af-dad7-44a0-a1fe-5d77130cd71b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:47.912670 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb9f0af-dad7-44a0-a1fe-5d77130cd71b admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:47.929328 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 780/1577] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:51:47 2022] POST /identity/v3/projects => generated 389 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:51:47.929328 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c267b6db-3588-4cba-b39b-dcb6891b06e4 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:47.980448 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:51:47.992128 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c267b6db-3588-4cba-b39b-dcb6891b06e4 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:47.996800 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ad272-5546-4470-97bd-65ea12d2794f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:47.997411 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ad272-5546-4470-97bd-65ea12d2794f admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:47.997690 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ad272-5546-4470-97bd-65ea12d2794f admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:47.997961 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ad272-5546-4470-97bd-65ea12d2794f admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:47.998601 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ad272-5546-4470-97bd-65ea12d2794f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:48.000874 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ad272-5546-4470-97bd-65ea12d2794f admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:48.042046 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 798/1578] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:51:47 2022] POST /identity/v3/projects => generated 403 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:51:48.042884 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb9f0af-dad7-44a0-a1fe-5d77130cd71b admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:48.109047 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb9f0af-dad7-44a0-a1fe-5d77130cd71b admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:48.114027 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df841742-1cad-417d-8fe5-a36aee4bc3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:48.114643 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df841742-1cad-417d-8fe5-a36aee4bc3f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:48.114919 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df841742-1cad-417d-8fe5-a36aee4bc3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:48.115222 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df841742-1cad-417d-8fe5-a36aee4bc3f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:48.115899 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df841742-1cad-417d-8fe5-a36aee4bc3f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:48.117520 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df841742-1cad-417d-8fe5-a36aee4bc3f8 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:48.128578 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 799/1579] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:51:48.129448 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df841742-1cad-417d-8fe5-a36aee4bc3f8 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:48.142113 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df841742-1cad-417d-8fe5-a36aee4bc3f8 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:48.148431 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 781/1580] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:51:47 2022] POST /identity/v3/projects => generated 379 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:51:48.148431 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ad272-5546-4470-97bd-65ea12d2794f admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:48.149333 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5e95e-cce0-4ad6-9311-052d6f1a4db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:48.149333 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5e95e-cce0-4ad6-9311-052d6f1a4db0 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:48.149333 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5e95e-cce0-4ad6-9311-052d6f1a4db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:48.149333 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5e95e-cce0-4ad6-9311-052d6f1a4db0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:48.149704 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e5e95e-cce0-4ad6-9311-052d6f1a4db0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:48.151542 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e5e95e-cce0-4ad6-9311-052d6f1a4db0 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:48.217058 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ad272-5546-4470-97bd-65ea12d2794f admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:48.221895 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2597fc8-a7ae-4dea-ac9f-32b6b2cb3659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:48.222503 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2597fc8-a7ae-4dea-ac9f-32b6b2cb3659 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:48.222784 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2597fc8-a7ae-4dea-ac9f-32b6b2cb3659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:48.223083 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2597fc8-a7ae-4dea-ac9f-32b6b2cb3659 admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:48.223734 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2597fc8-a7ae-4dea-ac9f-32b6b2cb3659 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:48.225646 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2597fc8-a7ae-4dea-ac9f-32b6b2cb3659 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:48.260472 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 800/1581] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:51:48 2022] POST /identity/v3/projects => generated 405 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:51:48.261328 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5e95e-cce0-4ad6-9311-052d6f1a4db0 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:48.296632 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:51:48.324843 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5e95e-cce0-4ad6-9311-052d6f1a4db0 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:48.330825 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d85e1-eed4-4a67-9bb6-9b76c2f714a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:48.331734 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d85e1-eed4-4a67-9bb6-9b76c2f714a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:48.332013 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d85e1-eed4-4a67-9bb6-9b76c2f714a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:48.332287 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d85e1-eed4-4a67-9bb6-9b76c2f714a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:48.332936 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8d85e1-eed4-4a67-9bb6-9b76c2f714a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:48.334522 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8d85e1-eed4-4a67-9bb6-9b76c2f714a7 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:48.345106 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 801/1582] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:51:48.345921 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d85e1-eed4-4a67-9bb6-9b76c2f714a7 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:48.355537 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d85e1-eed4-4a67-9bb6-9b76c2f714a7 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:48.361574 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910a9dc-131c-49bf-97df-788831522c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:48.362176 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910a9dc-131c-49bf-97df-788831522c20 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:48.362456 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910a9dc-131c-49bf-97df-788831522c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:48.362751 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910a9dc-131c-49bf-97df-788831522c20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:48.363435 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910a9dc-131c-49bf-97df-788831522c20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:48.365047 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910a9dc-131c-49bf-97df-788831522c20 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:48.366005 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 782/1583] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:51:48 2022] POST /identity/v3/users => generated 292 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:51:48.366827 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2597fc8-a7ae-4dea-ac9f-32b6b2cb3659 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:48.379048 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 802/1584] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:51:48.379917 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2597fc8-a7ae-4dea-ac9f-32b6b2cb3659 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:48.380034 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910a9dc-131c-49bf-97df-788831522c20 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:48.385974 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee71041-afa3-4886-9ef6-d3f8caf9ebf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:48.386601 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee71041-afa3-4886-9ef6-d3f8caf9ebf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:48.386875 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee71041-afa3-4886-9ef6-d3f8caf9ebf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:48.387178 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee71041-afa3-4886-9ef6-d3f8caf9ebf1 admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:48.387815 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee71041-afa3-4886-9ef6-d3f8caf9ebf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:48.390031 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee71041-afa3-4886-9ef6-d3f8caf9ebf1 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:48.395079 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910a9dc-131c-49bf-97df-788831522c20 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:48.403765 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac8daf-bdf3-41c5-bc03-f7507969e874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:48.403765 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac8daf-bdf3-41c5-bc03-f7507969e874 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:48.403765 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac8daf-bdf3-41c5-bc03-f7507969e874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:48.403765 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac8daf-bdf3-41c5-bc03-f7507969e874 admin admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:48.404198 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac8daf-bdf3-41c5-bc03-f7507969e874 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:48.404198 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac8daf-bdf3-41c5-bc03-f7507969e874 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:48.520195 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 783/1585] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:51:48 2022] POST /identity/v3/users => generated 295 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:51:48.521188 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee71041-afa3-4886-9ef6-d3f8caf9ebf1 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:48.532005 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee71041-afa3-4886-9ef6-d3f8caf9ebf1 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:48.536752 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16054a-a69f-447c-ac9d-9e890bfa5dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:48.537346 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16054a-a69f-447c-ac9d-9e890bfa5dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:48.537626 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16054a-a69f-447c-ac9d-9e890bfa5dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:48.537902 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16054a-a69f-447c-ac9d-9e890bfa5dd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:48.538558 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be16054a-a69f-447c-ac9d-9e890bfa5dd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:48.540190 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be16054a-a69f-447c-ac9d-9e890bfa5dd2 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:48.551468 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 784/1586] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:51:48.552407 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16054a-a69f-447c-ac9d-9e890bfa5dd2 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:48.563885 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16054a-a69f-447c-ac9d-9e890bfa5dd2 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:48.569503 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba802400-8779-44c1-9095-904ea2b7a966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:48.571143 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 803/1587] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:51:48 2022] POST /identity/v3/users => generated 308 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:51:48.571382 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba802400-8779-44c1-9095-904ea2b7a966 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:48.571382 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba802400-8779-44c1-9095-904ea2b7a966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:48.571549 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac8daf-bdf3-41c5-bc03-f7507969e874 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:48.571647 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba802400-8779-44c1-9095-904ea2b7a966 admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:48.571647 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba802400-8779-44c1-9095-904ea2b7a966 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:48.573982 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba802400-8779-44c1-9095-904ea2b7a966 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:48.582014 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac8daf-bdf3-41c5-bc03-f7507969e874 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:48.588164 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e49dc-036d-4c1f-9f18-d4f15e193c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:48.588772 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e49dc-036d-4c1f-9f18-d4f15e193c0e admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:48.589053 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e49dc-036d-4c1f-9f18-d4f15e193c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:48.589327 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e49dc-036d-4c1f-9f18-d4f15e193c0e admin admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:48.589950 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e49dc-036d-4c1f-9f18-d4f15e193c0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:48.591906 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e49dc-036d-4c1f-9f18-d4f15e193c0e admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:48.680904 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 804/1588] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:51:48 2022] POST /identity/v3/users => generated 303 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:51:48.681219 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 785/1589] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:51:48 2022] POST /identity/v3/users => generated 290 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:51:48.681669 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e49dc-036d-4c1f-9f18-d4f15e193c0e admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:48.682540 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba802400-8779-44c1-9095-904ea2b7a966 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:48.693424 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba802400-8779-44c1-9095-904ea2b7a966 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:48.694284 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e49dc-036d-4c1f-9f18-d4f15e193c0e admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:48.698309 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05110c5-336e-4e85-a1af-59c7a3cffadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:48.698808 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d82472-e6f8-4083-bd58-76f9056b6c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:48.698925 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05110c5-336e-4e85-a1af-59c7a3cffadd admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:48.699213 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05110c5-336e-4e85-a1af-59c7a3cffadd admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:48.699434 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d82472-e6f8-4083-bd58-76f9056b6c7d admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:48.699540 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05110c5-336e-4e85-a1af-59c7a3cffadd admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:48.699913 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d82472-e6f8-4083-bd58-76f9056b6c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:48.700120 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05110c5-336e-4e85-a1af-59c7a3cffadd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:48.700257 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d82472-e6f8-4083-bd58-76f9056b6c7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:48.700888 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d82472-e6f8-4083-bd58-76f9056b6c7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:48.701728 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05110c5-336e-4e85-a1af-59c7a3cffadd admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:48.702416 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d82472-e6f8-4083-bd58-76f9056b6c7d admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:48.718906 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 805/1590] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:51:48.719133 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 786/1591] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:51:48.719224 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d82472-e6f8-4083-bd58-76f9056b6c7d admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:48.719322 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05110c5-336e-4e85-a1af-59c7a3cffadd admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:48.726086 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05110c5-336e-4e85-a1af-59c7a3cffadd admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:48.727410 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d82472-e6f8-4083-bd58-76f9056b6c7d admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:48.730952 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e904d-6782-43d6-835c-8d0a1fe27691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:48.731660 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e904d-6782-43d6-835c-8d0a1fe27691 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:48.731955 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf159f8-b895-4f87-b85d-f316e3f46d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:48.732084 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e904d-6782-43d6-835c-8d0a1fe27691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:48.732546 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e904d-6782-43d6-835c-8d0a1fe27691 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:48.732680 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf159f8-b895-4f87-b85d-f316e3f46d20 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:48.732817 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf159f8-b895-4f87-b85d-f316e3f46d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:48.733088 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf159f8-b895-4f87-b85d-f316e3f46d20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:48.733720 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e904d-6782-43d6-835c-8d0a1fe27691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:48.733861 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf159f8-b895-4f87-b85d-f316e3f46d20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:48.736045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf159f8-b895-4f87-b85d-f316e3f46d20 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:48.736338 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e904d-6782-43d6-835c-8d0a1fe27691 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:48.747683 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 787/1592] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:51:48.748702 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e904d-6782-43d6-835c-8d0a1fe27691 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:48.754472 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 806/1593] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:51:48.754472 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf159f8-b895-4f87-b85d-f316e3f46d20 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:48.760600 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e904d-6782-43d6-835c-8d0a1fe27691 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:48.764788 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf159f8-b895-4f87-b85d-f316e3f46d20 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:48.766011 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d5742-ab5e-4673-9877-f56f5fce2884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:48.766692 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d5742-ab5e-4673-9877-f56f5fce2884 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:48.766975 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d5742-ab5e-4673-9877-f56f5fce2884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:48.767285 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d5742-ab5e-4673-9877-f56f5fce2884 admin admin] PATH_INFO: `/v3/projects/99aa4a2a73f441aa8a1bc9b7e4f6f48b/users/1fb4b55ed2264253ab8b587e369f8949/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:48.770186 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92932ce9-dd75-43e8-8057-afa961cae51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:48.770788 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92932ce9-dd75-43e8-8057-afa961cae51a admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:48.771096 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92932ce9-dd75-43e8-8057-afa961cae51a admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:48.771358 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92932ce9-dd75-43e8-8057-afa961cae51a admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:48.772187 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92932ce9-dd75-43e8-8057-afa961cae51a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:48.773791 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92932ce9-dd75-43e8-8057-afa961cae51a admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:48.784236 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d5742-ab5e-4673-9877-f56f5fce2884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99aa4a2a73f441aa8a1bc9b7e4f6f48b, user_id=1fb4b55ed2264253ab8b587e369f8949, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:48.785816 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 807/1594] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:51:48.787186 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92932ce9-dd75-43e8-8057-afa961cae51a admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:48.787336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d5742-ab5e-4673-9877-f56f5fce2884 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:48.797442 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92932ce9-dd75-43e8-8057-afa961cae51a admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:48.803462 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097bd1b-f015-480b-803e-327eb165bbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:48.804226 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097bd1b-f015-480b-803e-327eb165bbfa admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:48.804505 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097bd1b-f015-480b-803e-327eb165bbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:48.804777 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097bd1b-f015-480b-803e-327eb165bbfa admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:48.805417 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0097bd1b-f015-480b-803e-327eb165bbfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:48.807056 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0097bd1b-f015-480b-803e-327eb165bbfa admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:48.820069 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 808/1595] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:51:48.823347 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097bd1b-f015-480b-803e-327eb165bbfa admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:48.831696 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097bd1b-f015-480b-803e-327eb165bbfa admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:48.836462 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888ddb5-2368-44bf-955c-33e7b482a316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:48.837046 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888ddb5-2368-44bf-955c-33e7b482a316 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:48.837324 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888ddb5-2368-44bf-955c-33e7b482a316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:48.837595 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888ddb5-2368-44bf-955c-33e7b482a316 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:48.838306 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f888ddb5-2368-44bf-955c-33e7b482a316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:48.839893 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f888ddb5-2368-44bf-955c-33e7b482a316 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:48.850373 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 809/1596] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:51:48.853446 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888ddb5-2368-44bf-955c-33e7b482a316 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:48.861686 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888ddb5-2368-44bf-955c-33e7b482a316 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:48.866331 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e3d35-1490-42a2-b6fc-951904169dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:48.866968 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e3d35-1490-42a2-b6fc-951904169dd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:48.867271 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e3d35-1490-42a2-b6fc-951904169dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:48.867544 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e3d35-1490-42a2-b6fc-951904169dd4 admin admin] PATH_INFO: `/v3/projects/21cbb287c90c46b2aaa103ab09ff7524/users/ed91f8665bdb471e99ae6d2625b3a1be/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:48.882702 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4e3d35-1490-42a2-b6fc-951904169dd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21cbb287c90c46b2aaa103ab09ff7524, user_id=ed91f8665bdb471e99ae6d2625b3a1be, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:48.885366 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4e3d35-1490-42a2-b6fc-951904169dd4 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:48.971989 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 788/1597] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:51:48 2022] PUT /identity/v3/projects/99aa4a2a73f441aa8a1bc9b7e4f6f48b/users/1fb4b55ed2264253ab8b587e369f8949/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:51:48.972896 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d5742-ab5e-4673-9877-f56f5fce2884 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:49.007516 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:51:49.034907 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d5742-ab5e-4673-9877-f56f5fce2884 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:49.039650 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8096ed-874f-416e-bff1-31570a395411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:49.040257 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8096ed-874f-416e-bff1-31570a395411 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:49.040539 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8096ed-874f-416e-bff1-31570a395411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:49.040813 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8096ed-874f-416e-bff1-31570a395411 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:49.041449 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8096ed-874f-416e-bff1-31570a395411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:49.043119 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8096ed-874f-416e-bff1-31570a395411 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:49.053522 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 789/1598] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:51:49.054341 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8096ed-874f-416e-bff1-31570a395411 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:49.057195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 810/1599] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:51:48 2022] PUT /identity/v3/projects/21cbb287c90c46b2aaa103ab09ff7524/users/ed91f8665bdb471e99ae6d2625b3a1be/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:51:49.063991 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e3d35-1490-42a2-b6fc-951904169dd4 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:49.067921 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8096ed-874f-416e-bff1-31570a395411 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:49.125179 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e3d35-1490-42a2-b6fc-951904169dd4 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:49.129195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e14ea-18d2-404e-aa37-da3ca346f794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:49.129860 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e14ea-18d2-404e-aa37-da3ca346f794 admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:49.130165 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e14ea-18d2-404e-aa37-da3ca346f794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:49.130437 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e14ea-18d2-404e-aa37-da3ca346f794 admin admin] PATH_INFO: `/v3/projects/d8dbe1196024439d8d5b0a510c514546/users/c9de80eade38407c99f00c5acf45e2bb/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:49.130547 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65812d-0434-409a-8214-5db8b770884a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:49.131190 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65812d-0434-409a-8214-5db8b770884a admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:49.131484 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65812d-0434-409a-8214-5db8b770884a admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:49.131937 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65812d-0434-409a-8214-5db8b770884a admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:49.133112 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d65812d-0434-409a-8214-5db8b770884a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:49.134842 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d65812d-0434-409a-8214-5db8b770884a admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:49.139936 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:51:49.145956 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 790/1600] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:51:49.147044 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65812d-0434-409a-8214-5db8b770884a admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:49.151787 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e14ea-18d2-404e-aa37-da3ca346f794 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8dbe1196024439d8d5b0a510c514546, user_id=c9de80eade38407c99f00c5acf45e2bb, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:49.154682 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e14ea-18d2-404e-aa37-da3ca346f794 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:49.158716 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65812d-0434-409a-8214-5db8b770884a admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:49.163758 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97518895-a6c2-43ec-9788-37b0d06d0584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:49.164304 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97518895-a6c2-43ec-9788-37b0d06d0584 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:49.164585 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97518895-a6c2-43ec-9788-37b0d06d0584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:49.164861 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97518895-a6c2-43ec-9788-37b0d06d0584 admin admin] PATH_INFO: `/v3/projects/df44d6308e944b63b5fb83c41ce5dc41/users/66cb98dc9e98497a97ea481f5e5d0249/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:49.182854 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97518895-a6c2-43ec-9788-37b0d06d0584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df44d6308e944b63b5fb83c41ce5dc41, user_id=66cb98dc9e98497a97ea481f5e5d0249, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:49.186425 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97518895-a6c2-43ec-9788-37b0d06d0584 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:49.280187 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 811/1601] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:51:49 2022] PUT /identity/v3/projects/d8dbe1196024439d8d5b0a510c514546/users/c9de80eade38407c99f00c5acf45e2bb/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:51:49.281524 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e14ea-18d2-404e-aa37-da3ca346f794 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:49.320479 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 791/1602] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:51:49 2022] PUT /identity/v3/projects/df44d6308e944b63b5fb83c41ce5dc41/users/66cb98dc9e98497a97ea481f5e5d0249/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:51:49.323446 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97518895-a6c2-43ec-9788-37b0d06d0584 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:49.347841 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e14ea-18d2-404e-aa37-da3ca346f794 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:49.385829 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97518895-a6c2-43ec-9788-37b0d06d0584 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:49.391612 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65ad2b-2b3f-40ec-9098-b24f30f2d26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:49.392231 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65ad2b-2b3f-40ec-9098-b24f30f2d26e admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:49.392516 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65ad2b-2b3f-40ec-9098-b24f30f2d26e admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:49.392788 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65ad2b-2b3f-40ec-9098-b24f30f2d26e admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:49.393431 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65ad2b-2b3f-40ec-9098-b24f30f2d26e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:49.395046 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65ad2b-2b3f-40ec-9098-b24f30f2d26e admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:49.409023 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 792/1603] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:51:49.409023 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7b21b-f531-495e-b1dc-e55b05321293 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:49.409023 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7b21b-f531-495e-b1dc-e55b05321293 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:49.409023 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7b21b-f531-495e-b1dc-e55b05321293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:49.409482 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1348f7a1-dae1-4217-9f4a-273b6b321123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:49.409482 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1348f7a1-dae1-4217-9f4a-273b6b321123 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:49.409482 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1348f7a1-dae1-4217-9f4a-273b6b321123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:49.409482 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1348f7a1-dae1-4217-9f4a-273b6b321123 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:49.409827 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1348f7a1-dae1-4217-9f4a-273b6b321123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:49.411272 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1348f7a1-dae1-4217-9f4a-273b6b321123 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:49.424632 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 812/1604] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:51:49.424632 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1348f7a1-dae1-4217-9f4a-273b6b321123 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:49.433961 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1348f7a1-dae1-4217-9f4a-273b6b321123 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:49.435008 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-b5a7b21b-f531-495e-b1dc-e55b05321293 None None] MFA Rules not processed for user `1fb4b55ed2264253ab8b587e369f8949`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:51:49.436243 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-b5a7b21b-f531-495e-b1dc-e55b05321293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:49.439718 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca226054-29f9-4c23-8847-00b4969f97ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:49.440372 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca226054-29f9-4c23-8847-00b4969f97ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:49.440650 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca226054-29f9-4c23-8847-00b4969f97ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:49.440921 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca226054-29f9-4c23-8847-00b4969f97ac admin admin] PATH_INFO: `/v3/projects/a187eaa1bbe44bfbae3640994b76e5dc/users/33cfe206c9ab4e4ab58b9989d7be1998/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:49.456809 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca226054-29f9-4c23-8847-00b4969f97ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=a187eaa1bbe44bfbae3640994b76e5dc, user_id=33cfe206c9ab4e4ab58b9989d7be1998, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:49.459594 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca226054-29f9-4c23-8847-00b4969f97ac admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:49.463519 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:51:49.502182 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 793/1605] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:51:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:51:49.503490 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3920c-5e57-4a8e-afe4-1a1902360072 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:49.503773 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3920c-5e57-4a8e-afe4-1a1902360072 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:49.504046 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3920c-5e57-4a8e-afe4-1a1902360072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:49.534678 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-8ba3920c-5e57-4a8e-afe4-1a1902360072 None None] MFA Rules not processed for user `ed91f8665bdb471e99ae6d2625b3a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:51:49.535942 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-8ba3920c-5e57-4a8e-afe4-1a1902360072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:49.578834 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 813/1606] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:51:49 2022] PUT /identity/v3/projects/a187eaa1bbe44bfbae3640994b76e5dc/users/33cfe206c9ab4e4ab58b9989d7be1998/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:51:49.579589 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca226054-29f9-4c23-8847-00b4969f97ac admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:49.607271 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 794/1607] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:51:49 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:51:49.608608 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c02d02-b5d5-4dbb-b193-f5c3c7e131f6 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:49.608892 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c02d02-b5d5-4dbb-b193-f5c3c7e131f6 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:49.609164 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c02d02-b5d5-4dbb-b193-f5c3c7e131f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:49.630029 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-a2c02d02-b5d5-4dbb-b193-f5c3c7e131f6 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:51:49.631339 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-a2c02d02-b5d5-4dbb-b193-f5c3c7e131f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:49.652603 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca226054-29f9-4c23-8847-00b4969f97ac admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:49.657548 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37957015-6f54-4a7a-8e9b-829e20083f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:49.658213 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37957015-6f54-4a7a-8e9b-829e20083f7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:49.658493 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37957015-6f54-4a7a-8e9b-829e20083f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:49.658767 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37957015-6f54-4a7a-8e9b-829e20083f7a admin admin] PATH_INFO: `/v3/projects/5a9014c6a95949ff917046133886ed98/users/cc96be5baacf490bad43962fa4a24e4a/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:49.670225 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:51:49.674582 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37957015-6f54-4a7a-8e9b-829e20083f7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a9014c6a95949ff917046133886ed98, user_id=cc96be5baacf490bad43962fa4a24e4a, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:49.677266 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37957015-6f54-4a7a-8e9b-829e20083f7a admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:49.690866 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 795/1608] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:51:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:51:49.691739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c02d02-b5d5-4dbb-b193-f5c3c7e131f6 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:49.701771 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c02d02-b5d5-4dbb-b193-f5c3c7e131f6 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:49.707277 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a150b0-63df-4649-8862-07ddd2fdb320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:49.707887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a150b0-63df-4649-8862-07ddd2fdb320 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:49.708152 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a150b0-63df-4649-8862-07ddd2fdb320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:49.708478 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a150b0-63df-4649-8862-07ddd2fdb320 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:49.709116 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a150b0-63df-4649-8862-07ddd2fdb320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:49.710735 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a150b0-63df-4649-8862-07ddd2fdb320 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:49.721149 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 796/1609] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:51:49.722237 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a150b0-63df-4649-8862-07ddd2fdb320 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:49.732077 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a150b0-63df-4649-8862-07ddd2fdb320 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:49.741842 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc0340-cfa8-4c29-96ed-1496590a624b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:49.741842 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc0340-cfa8-4c29-96ed-1496590a624b admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:49.741842 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc0340-cfa8-4c29-96ed-1496590a624b admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:49.741842 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc0340-cfa8-4c29-96ed-1496590a624b admin admin] PATH_INFO: `/v3/projects/fb39143bfa9845ee9dce4ca51c82e751/users/9b91e6d68e3e40388fe50436ddb22847/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:49.752804 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc0340-cfa8-4c29-96ed-1496590a624b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb39143bfa9845ee9dce4ca51c82e751, user_id=9b91e6d68e3e40388fe50436ddb22847, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:49.755473 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc0340-cfa8-4c29-96ed-1496590a624b admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:49.766065 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 814/1610] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:51:49 2022] PUT /identity/v3/projects/5a9014c6a95949ff917046133886ed98/users/cc96be5baacf490bad43962fa4a24e4a/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:51:49.766910 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37957015-6f54-4a7a-8e9b-829e20083f7a admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:49.825698 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37957015-6f54-4a7a-8e9b-829e20083f7a admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:49.831215 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82ca08-582c-4668-9a82-900f07df5f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:49.831869 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82ca08-582c-4668-9a82-900f07df5f0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:49.832146 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82ca08-582c-4668-9a82-900f07df5f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:49.832416 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82ca08-582c-4668-9a82-900f07df5f0d admin admin] PATH_INFO: `/v3/projects/da27193d2e5f468b9698b74988b37481/users/c28994b4c95d49718fbd048baa67fe3c/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:49.847216 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b82ca08-582c-4668-9a82-900f07df5f0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=da27193d2e5f468b9698b74988b37481, user_id=c28994b4c95d49718fbd048baa67fe3c, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:49.849823 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b82ca08-582c-4668-9a82-900f07df5f0d admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:49.856877 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 797/1611] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:51:49 2022] PUT /identity/v3/projects/fb39143bfa9845ee9dce4ca51c82e751/users/9b91e6d68e3e40388fe50436ddb22847/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:51:49.869500 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab8edd-500f-4947-a1bf-7c2e77460977 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:49.869500 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab8edd-500f-4947-a1bf-7c2e77460977 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:49.869500 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab8edd-500f-4947-a1bf-7c2e77460977 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:49.869500 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 798/1612] 10.222.0.42 () {54 vars in 962 bytes} [Fri Aug 26 07:51:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:51:49.869500 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b9e0b-a2a6-47e8-90c8-383fa0de4bbb None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:49.869500 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b9e0b-a2a6-47e8-90c8-383fa0de4bbb None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:49.870065 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b9e0b-a2a6-47e8-90c8-383fa0de4bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:49.890878 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-405b9e0b-a2a6-47e8-90c8-383fa0de4bbb None None] MFA Rules not processed for user `33cfe206c9ab4e4ab58b9989d7be1998`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:51:49.892691 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-405b9e0b-a2a6-47e8-90c8-383fa0de4bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:49.904025 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:51:49.943008 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 815/1613] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:51:49 2022] PUT /identity/v3/projects/da27193d2e5f468b9698b74988b37481/users/c28994b4c95d49718fbd048baa67fe3c/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:51:49.943865 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82ca08-582c-4668-9a82-900f07df5f0d admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:49.961071 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 799/1614] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:51:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:51:49.961918 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b9e0b-a2a6-47e8-90c8-383fa0de4bbb None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:50.018195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82ca08-582c-4668-9a82-900f07df5f0d admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:50.019544 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b9e0b-a2a6-47e8-90c8-383fa0de4bbb None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:50.022661 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5ba78-aba3-4b28-975e-7f1205a561e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:50.023328 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5ba78-aba3-4b28-975e-7f1205a561e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:50.023601 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5ba78-aba3-4b28-975e-7f1205a561e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:50.023867 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5ba78-aba3-4b28-975e-7f1205a561e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:50.024482 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b5ba78-aba3-4b28-975e-7f1205a561e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:50.026370 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b5ba78-aba3-4b28-975e-7f1205a561e5 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:50.071210 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c63185-900b-458d-907b-925faa6a4be1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:50.071818 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c63185-900b-458d-907b-925faa6a4be1 service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:50.072093 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c63185-900b-458d-907b-925faa6a4be1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:50.072360 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c63185-900b-458d-907b-925faa6a4be1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:50.081541 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c63185-900b-458d-907b-925faa6a4be1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:50.082918 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c63185-900b-458d-907b-925faa6a4be1 service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:50.092375 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 800/1615] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:51:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:51:50.098114 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c63185-900b-458d-907b-925faa6a4be1 service neutron] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:50.103670 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c63185-900b-458d-907b-925faa6a4be1 service neutron] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:50.108458 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b1af5-aab5-42c5-968e-06cbd09a4f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:50.109675 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b1af5-aab5-42c5-968e-06cbd09a4f14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:50.110568 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b1af5-aab5-42c5-968e-06cbd09a4f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:50.110848 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b1af5-aab5-42c5-968e-06cbd09a4f14 admin admin] PATH_INFO: `/v3/projects/df44d6308e944b63b5fb83c41ce5dc41/users/66cb98dc9e98497a97ea481f5e5d0249/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:50.113272 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7b1af5-aab5-42c5-968e-06cbd09a4f14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df44d6308e944b63b5fb83c41ce5dc41, user_id=66cb98dc9e98497a97ea481f5e5d0249, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:50.117269 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7b1af5-aab5-42c5-968e-06cbd09a4f14 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:50.131192 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 816/1616] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:51:49 2022] POST /identity/v3/projects => generated 357 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:51:50.131192 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a61d4b-c764-4b65-aae7-83adb4db360b None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:50.131192 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a61d4b-c764-4b65-aae7-83adb4db360b None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:50.131904 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 801/1617] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:51:50 2022] PUT /identity/v3/projects/df44d6308e944b63b5fb83c41ce5dc41/users/66cb98dc9e98497a97ea481f5e5d0249/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:51:50.131991 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a61d4b-c764-4b65-aae7-83adb4db360b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:50.132075 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c31db2-1c1b-45f3-a0cb-adad9acbed95 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:50.132075 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c31db2-1c1b-45f3-a0cb-adad9acbed95 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:50.132075 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c31db2-1c1b-45f3-a0cb-adad9acbed95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:50.150561 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-41a61d4b-c764-4b65-aae7-83adb4db360b None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:51:50.151800 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-41a61d4b-c764-4b65-aae7-83adb4db360b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:50.153641 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-b3c31db2-1c1b-45f3-a0cb-adad9acbed95 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:51:50.154788 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-b3c31db2-1c1b-45f3-a0cb-adad9acbed95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:50.204963 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:51:50.215580 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:51:50.219517 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 817/1618] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:51:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:51:50.220813 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c29792-30d3-45e2-a28a-f2615e43270d None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:50.221102 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c29792-30d3-45e2-a28a-f2615e43270d None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:50.221372 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c29792-30d3-45e2-a28a-f2615e43270d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:50.233399 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 802/1619] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:51:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:51:50.235694 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b07bcf-a0ca-40e3-abd3-79b943411fca None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:50.236111 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b07bcf-a0ca-40e3-abd3-79b943411fca None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:50.236457 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b07bcf-a0ca-40e3-abd3-79b943411fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:50.257139 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-f3b07bcf-a0ca-40e3-abd3-79b943411fca None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:51:50.259268 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-f3b07bcf-a0ca-40e3-abd3-79b943411fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:50.267433 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-f6c29792-30d3-45e2-a28a-f2615e43270d None None] MFA Rules not processed for user `bc92c0a0a2cc4722868e6877bac93ada`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:51:50.268694 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-f6c29792-30d3-45e2-a28a-f2615e43270d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:50.273651 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 803/1620] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:51:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:51:50.273651 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15507f9a-8dbb-47b2-90da-fe263331946f None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:50.273651 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15507f9a-8dbb-47b2-90da-fe263331946f None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:50.276244 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15507f9a-8dbb-47b2-90da-fe263331946f None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:50.276244 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 804/1621] 10.222.0.42 () {54 vars in 962 bytes} [Fri Aug 26 07:51:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:51:50.276821 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15507f9a-8dbb-47b2-90da-fe263331946f None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:50.292469 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15507f9a-8dbb-47b2-90da-fe263331946f None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:50.299171 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8250f9d-f5e7-4bf2-af0e-e44cb45a5655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:50.299864 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8250f9d-f5e7-4bf2-af0e-e44cb45a5655 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:50.300202 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8250f9d-f5e7-4bf2-af0e-e44cb45a5655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:50.300476 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8250f9d-f5e7-4bf2-af0e-e44cb45a5655 admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:50.301316 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8250f9d-f5e7-4bf2-af0e-e44cb45a5655 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:50.303252 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8250f9d-f5e7-4bf2-af0e-e44cb45a5655 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:50.356105 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 818/1622] 10.222.0.42 () {58 vars in 1059 bytes} [Fri Aug 26 07:51:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:51:50.357269 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf5fea-5d18-4987-93bc-b59ae820ef50 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:50.357548 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf5fea-5d18-4987-93bc-b59ae820ef50 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:50.357818 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf5fea-5d18-4987-93bc-b59ae820ef50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:50.385984 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-9ddf5fea-5d18-4987-93bc-b59ae820ef50 None None] MFA Rules not processed for user `66cb98dc9e98497a97ea481f5e5d0249`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:51:50.387260 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-9ddf5fea-5d18-4987-93bc-b59ae820ef50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:50.407752 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 805/1623] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:51:50 2022] POST /identity/v3/users => generated 285 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:51:50.408887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8250f9d-f5e7-4bf2-af0e-e44cb45a5655 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:50.411465 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-f8250f9d-f5e7-4bf2-af0e-e44cb45a5655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:50.479383 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 819/1624] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:51:50 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:51:50.481430 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf5fea-5d18-4987-93bc-b59ae820ef50 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:50.486708 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8250f9d-f5e7-4bf2-af0e-e44cb45a5655 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:50.491120 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9782eadb-8b63-4234-bf93-e72e47b66124 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:50.491755 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782eadb-8b63-4234-bf93-e72e47b66124 service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:50.492036 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782eadb-8b63-4234-bf93-e72e47b66124 service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:50.492312 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782eadb-8b63-4234-bf93-e72e47b66124 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:50.497127 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf5fea-5d18-4987-93bc-b59ae820ef50 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:50.503276 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a89690-d6b4-4fad-9265-88c58b9ee5ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:50.507892 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a89690-d6b4-4fad-9265-88c58b9ee5ca service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:50.507892 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a89690-d6b4-4fad-9265-88c58b9ee5ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:50.507892 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a89690-d6b4-4fad-9265-88c58b9ee5ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:50.508208 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9782eadb-8b63-4234-bf93-e72e47b66124 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:50.508208 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9782eadb-8b63-4234-bf93-e72e47b66124 service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:50.514838 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a89690-d6b4-4fad-9265-88c58b9ee5ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:50.517189 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a89690-d6b4-4fad-9265-88c58b9ee5ca service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:50.517342 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 806/1625] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:51:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:51:50.518156 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9782eadb-8b63-4234-bf93-e72e47b66124 service neutron] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:50.527763 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9782eadb-8b63-4234-bf93-e72e47b66124 service neutron] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:50.531193 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 820/1626] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:51:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:51:50.536566 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4866edfb-981d-45e3-aaf7-02b8b41ad024 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:50.536738 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ed85f-f988-478c-b1b3-369be77eec71 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:50.536738 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ed85f-f988-478c-b1b3-369be77eec71 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:50.536738 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ed85f-f988-478c-b1b3-369be77eec71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:50.536988 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866edfb-981d-45e3-aaf7-02b8b41ad024 service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:50.536988 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866edfb-981d-45e3-aaf7-02b8b41ad024 service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:50.536988 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866edfb-981d-45e3-aaf7-02b8b41ad024 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:50.545638 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4866edfb-981d-45e3-aaf7-02b8b41ad024 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:50.547774 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4866edfb-981d-45e3-aaf7-02b8b41ad024 service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:50.559583 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-e32ed85f-f988-478c-b1b3-369be77eec71 None None] MFA Rules not processed for user `bc92c0a0a2cc4722868e6877bac93ada`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:51:50.565474 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 807/1627] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:51:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:51:50.565636 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-e32ed85f-f988-478c-b1b3-369be77eec71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:50.565736 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4866edfb-981d-45e3-aaf7-02b8b41ad024 service neutron] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:50.573846 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 821/1628] 10.222.0.42 () {58 vars in 1059 bytes} [Fri Aug 26 07:51:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:51:50.574706 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ed85f-f988-478c-b1b3-369be77eec71 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:50.587432 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ed85f-f988-478c-b1b3-369be77eec71 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:50.589849 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4866edfb-981d-45e3-aaf7-02b8b41ad024 service neutron] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:50.593083 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529d271-f39b-416e-956a-3002d8d315ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:50.594596 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529d271-f39b-416e-956a-3002d8d315ed admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:50.594726 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529d271-f39b-416e-956a-3002d8d315ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:50.595177 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529d271-f39b-416e-956a-3002d8d315ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:50.595900 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529d271-f39b-416e-956a-3002d8d315ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:50.598300 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c1f0a-6ff4-46f0-8e7c-ee55d34ac166 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc92c0a0a2cc4722868e6877bac93ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:50.598682 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529d271-f39b-416e-956a-3002d8d315ed admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:50.599456 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c1f0a-6ff4-46f0-8e7c-ee55d34ac166 service nova] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:50.611353 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c1f0a-6ff4-46f0-8e7c-ee55d34ac166 service nova] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:50.611353 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c1f0a-6ff4-46f0-8e7c-ee55d34ac166 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:50.611607 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 822/1629] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:51:50.612342 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529d271-f39b-416e-956a-3002d8d315ed admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:50.647459 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:51:50.665347 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c1f0a-6ff4-46f0-8e7c-ee55d34ac166 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:50.667011 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c1f0a-6ff4-46f0-8e7c-ee55d34ac166 service nova] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:50.670158 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529d271-f39b-416e-956a-3002d8d315ed admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:50.674839 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58425a-0433-47bb-9a8d-88314cba8455 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:50.675490 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58425a-0433-47bb-9a8d-88314cba8455 service cinder] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:50.675769 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58425a-0433-47bb-9a8d-88314cba8455 service cinder] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:50.676045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58425a-0433-47bb-9a8d-88314cba8455 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:50.677460 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 808/1630] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:51:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:51:50.678516 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c1f0a-6ff4-46f0-8e7c-ee55d34ac166 service nova] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:50.686323 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58425a-0433-47bb-9a8d-88314cba8455 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:50.687848 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58425a-0433-47bb-9a8d-88314cba8455 service cinder] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:50.689813 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c1f0a-6ff4-46f0-8e7c-ee55d34ac166 service nova] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:50.695678 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3892c-0e81-4796-8f74-170d44009c88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc92c0a0a2cc4722868e6877bac93ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:50.696284 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3892c-0e81-4796-8f74-170d44009c88 service nova] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:50.696561 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3892c-0e81-4796-8f74-170d44009c88 service nova] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:50.696831 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3892c-0e81-4796-8f74-170d44009c88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:50.697913 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 823/1631] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:51:50 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:51:50.698709 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58425a-0433-47bb-9a8d-88314cba8455 service cinder] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:50.710053 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58425a-0433-47bb-9a8d-88314cba8455 service cinder] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:50.715174 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9058a-0f62-4cd9-8012-f7f6cdd909af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:50.715942 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9058a-0f62-4cd9-8012-f7f6cdd909af admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:50.716252 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9058a-0f62-4cd9-8012-f7f6cdd909af admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:50.716602 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9058a-0f62-4cd9-8012-f7f6cdd909af admin admin] PATH_INFO: `/v3/projects/6f1b1e087bb2450c8b8b8108e31d9332/users/f1ceb3512f914712b3550a1de50d341e/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:50.734339 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9058a-0f62-4cd9-8012-f7f6cdd909af admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f1b1e087bb2450c8b8b8108e31d9332, user_id=f1ceb3512f914712b3550a1de50d341e, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:50.737099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9058a-0f62-4cd9-8012-f7f6cdd909af admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:50.789847 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3892c-0e81-4796-8f74-170d44009c88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:50.791737 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3892c-0e81-4796-8f74-170d44009c88 service nova] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:50.799754 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:51:50.826245 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 809/1632] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:51:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:51:50.872303 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 824/1633] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:51:50 2022] PUT /identity/v3/projects/6f1b1e087bb2450c8b8b8108e31d9332/users/f1ceb3512f914712b3550a1de50d341e/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:51:50.875584 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3892c-0e81-4796-8f74-170d44009c88 service nova] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:50.900703 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3892c-0e81-4796-8f74-170d44009c88 service nova] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:51.023996 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb243495-59b0-4fdb-820f-0bd3ee04af67 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:51.024275 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb243495-59b0-4fdb-820f-0bd3ee04af67 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:51.024553 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb243495-59b0-4fdb-820f-0bd3ee04af67 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:51.026093 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 825/1634] 10.222.0.42 () {54 vars in 912 bytes} [Fri Aug 26 07:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:51:51.035984 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8378088-ca6e-43f4-a830-31dc00598f1e None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:51.036616 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8378088-ca6e-43f4-a830-31dc00598f1e None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:51.036616 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8378088-ca6e-43f4-a830-31dc00598f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:51.037328 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec8203-8f9b-4855-b061-cab7b8fc2c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:51.038028 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec8203-8f9b-4855-b061-cab7b8fc2c2a admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:51.041270 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec8203-8f9b-4855-b061-cab7b8fc2c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:51.041566 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec8203-8f9b-4855-b061-cab7b8fc2c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:51.042242 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec8203-8f9b-4855-b061-cab7b8fc2c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:51.043953 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec8203-8f9b-4855-b061-cab7b8fc2c2a admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:51.067749 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 810/1635] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 07:51:51.072847 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec8203-8f9b-4855-b061-cab7b8fc2c2a admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:51.079938 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-b8378088-ca6e-43f4-a830-31dc00598f1e None None] MFA Rules not processed for user `bc92c0a0a2cc4722868e6877bac93ada`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:51:51.084872 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-b8378088-ca6e-43f4-a830-31dc00598f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:51.089567 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec8203-8f9b-4855-b061-cab7b8fc2c2a admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:51.107913 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55481cc1-5e59-4d44-905c-164324f85741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:51.108248 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55481cc1-5e59-4d44-905c-164324f85741 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:51.108498 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55481cc1-5e59-4d44-905c-164324f85741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:51.108769 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55481cc1-5e59-4d44-905c-164324f85741 admin admin] PATH_INFO: `/v3/projects/6f1b1e087bb2450c8b8b8108e31d9332/users/f1ceb3512f914712b3550a1de50d341e/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:51.112553 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55481cc1-5e59-4d44-905c-164324f85741 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f1b1e087bb2450c8b8b8108e31d9332, user_id=f1ceb3512f914712b3550a1de50d341e, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:51.117372 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55481cc1-5e59-4d44-905c-164324f85741 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:51.133830 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 811/1636] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:51:51 2022] PUT /identity/v3/projects/6f1b1e087bb2450c8b8b8108e31d9332/users/f1ceb3512f914712b3550a1de50d341e/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:51:51.135072 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55481cc1-5e59-4d44-905c-164324f85741 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:51.224857 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55481cc1-5e59-4d44-905c-164324f85741 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:51.229944 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108c941-f53a-47df-aafd-34a5bea8d2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:51.230680 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108c941-f53a-47df-aafd-34a5bea8d2e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:51.231089 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108c941-f53a-47df-aafd-34a5bea8d2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:51.231559 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108c941-f53a-47df-aafd-34a5bea8d2e3 admin admin] PATH_INFO: `/v3/users/d028d38de3af4ac3b8aae463dab108f9` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:51.233077 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108c941-f53a-47df-aafd-34a5bea8d2e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d028d38de3af4ac3b8aae463dab108f9)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:51.235989 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108c941-f53a-47df-aafd-34a5bea8d2e3 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:51.252364 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 826/1637] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Aug 26 07:51:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:51:51.254098 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f3d8b-a388-4d9b-93d1-085cc4648bad None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:51.254385 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f3d8b-a388-4d9b-93d1-085cc4648bad None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:51.254661 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f3d8b-a388-4d9b-93d1-085cc4648bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:51.291798 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-b16f3d8b-a388-4d9b-93d1-085cc4648bad None None] MFA Rules not processed for user `f1ceb3512f914712b3550a1de50d341e`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:51:51.293044 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-b16f3d8b-a388-4d9b-93d1-085cc4648bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:51.395336 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 827/1638] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:51:51 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:51:51.396983 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388c8fd-15e9-4b6e-9d30-84bc927892e9 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:51.397342 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388c8fd-15e9-4b6e-9d30-84bc927892e9 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:51.397626 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388c8fd-15e9-4b6e-9d30-84bc927892e9 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:51.400329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 828/1639] 10.222.0.42 () {54 vars in 912 bytes} [Fri Aug 26 07:51:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:51:51.404050 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d388c8fd-15e9-4b6e-9d30-84bc927892e9 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:51.442342 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:51:51.471895 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d388c8fd-15e9-4b6e-9d30-84bc927892e9 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:51.475777 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e245e7-32c1-44bb-beeb-b9d1037b4035 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:51.476397 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e245e7-32c1-44bb-beeb-b9d1037b4035 service cinder] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:51.476681 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e245e7-32c1-44bb-beeb-b9d1037b4035 service cinder] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:51.477038 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e245e7-32c1-44bb-beeb-b9d1037b4035 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:51.549730 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e245e7-32c1-44bb-beeb-b9d1037b4035 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:51.551225 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e245e7-32c1-44bb-beeb-b9d1037b4035 service cinder] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:51.563950 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 829/1640] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:51:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:51:51.566589 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea1a23-bbd9-4e2f-b0d8-72db432da4b2 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:51.566589 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea1a23-bbd9-4e2f-b0d8-72db432da4b2 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:51.566589 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea1a23-bbd9-4e2f-b0d8-72db432da4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:51.571184 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-9108c941-f53a-47df-aafd-34a5bea8d2e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd028d38de3af4ac3b8aae463dab108f9'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:51:51.571941 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-9108c941-f53a-47df-aafd-34a5bea8d2e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd028d38de3af4ac3b8aae463dab108f9'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:51:51.592113 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-92ea1a23-bbd9-4e2f-b0d8-72db432da4b2 None None] MFA Rules not processed for user `bc92c0a0a2cc4722868e6877bac93ada`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:51:51.595363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-92ea1a23-bbd9-4e2f-b0d8-72db432da4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:51.608539 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 830/1641] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Aug 26 07:51:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:51:51.609222 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea1a23-bbd9-4e2f-b0d8-72db432da4b2 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:51.630752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea1a23-bbd9-4e2f-b0d8-72db432da4b2 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:51.636021 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd503710-82ef-4eba-a628-50a7f04e2dd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:51.637189 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd503710-82ef-4eba-a628-50a7f04e2dd2 service cinder] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:51.637469 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd503710-82ef-4eba-a628-50a7f04e2dd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:51.638514 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd503710-82ef-4eba-a628-50a7f04e2dd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:51.639752 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-9108c941-f53a-47df-aafd-34a5bea8d2e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd028d38de3af4ac3b8aae463dab108f9'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:51:51.641603 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-9108c941-f53a-47df-aafd-34a5bea8d2e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd028d38de3af4ac3b8aae463dab108f9'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:51:51.652445 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-9108c941-f53a-47df-aafd-34a5bea8d2e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd028d38de3af4ac3b8aae463dab108f9'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:51:51.653120 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd503710-82ef-4eba-a628-50a7f04e2dd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:51.655070 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd503710-82ef-4eba-a628-50a7f04e2dd2 service cinder] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:52.045258 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 831/1642] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:51:51 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:51:52.046384 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 812/1643] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:51:51 2022] DELETE /identity/v3/users/d028d38de3af4ac3b8aae463dab108f9 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:51:52.046793 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df31958-13da-4f4f-a2dd-eeadd1f0b2c3 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:52.046793 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df31958-13da-4f4f-a2dd-eeadd1f0b2c3 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:52.046793 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df31958-13da-4f4f-a2dd-eeadd1f0b2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:52.046793 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-3df31958-13da-4f4f-a2dd-eeadd1f0b2c3 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:51:52.046793 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-3df31958-13da-4f4f-a2dd-eeadd1f0b2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:52.046793 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 832/1644] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:51:52.048351 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108c941-f53a-47df-aafd-34a5bea8d2e3 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:52.048351 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-9108c941-f53a-47df-aafd-34a5bea8d2e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:52.048351 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:51:52.048351 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108c941-f53a-47df-aafd-34a5bea8d2e3 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:52.050084 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe42f1-3714-4ac1-8401-0e986ac21663 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:52.050084 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe42f1-3714-4ac1-8401-0e986ac21663 service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:52.050084 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe42f1-3714-4ac1-8401-0e986ac21663 service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:52.050084 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe42f1-3714-4ac1-8401-0e986ac21663 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:52.050511 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe42f1-3714-4ac1-8401-0e986ac21663 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:52.050667 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df31958-13da-4f4f-a2dd-eeadd1f0b2c3 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:52.050875 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe42f1-3714-4ac1-8401-0e986ac21663 service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:52.051054 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-3df31958-13da-4f4f-a2dd-eeadd1f0b2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:52.051205 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 813/1645] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:51:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:51:52.052598 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df31958-13da-4f4f-a2dd-eeadd1f0b2c3 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:52.052598 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5f133-b46e-4dc7-9b12-f1e3877b2803 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:52.052598 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5f133-b46e-4dc7-9b12-f1e3877b2803 service cinder] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:52.052598 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5f133-b46e-4dc7-9b12-f1e3877b2803 service cinder] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:52.052999 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5f133-b46e-4dc7-9b12-f1e3877b2803 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:52.054635 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-33c5f133-b46e-4dc7-9b12-f1e3877b2803 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:52.103891 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:51:52.155593 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5f133-b46e-4dc7-9b12-f1e3877b2803 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:52.157822 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5f133-b46e-4dc7-9b12-f1e3877b2803 service cinder] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:52.171559 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 833/1646] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:51:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:51:52.861074 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe42f1-3714-4ac1-8401-0e986ac21663 service neutron] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:52.867041 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-5bfe42f1-3714-4ac1-8401-0e986ac21663 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:52.925627 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe42f1-3714-4ac1-8401-0e986ac21663 service neutron] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:52.945263 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907d568-ee38-4bf7-97b4-d3be907ea541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:52.949156 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907d568-ee38-4bf7-97b4-d3be907ea541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:52.949660 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907d568-ee38-4bf7-97b4-d3be907ea541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:52.950683 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907d568-ee38-4bf7-97b4-d3be907ea541 admin admin] PATH_INFO: `/v3/projects/6a154190ea0646a0ad61257b79c81748` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:52.955451 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907d568-ee38-4bf7-97b4-d3be907ea541 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a154190ea0646a0ad61257b79c81748)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:52.959566 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: WARNING py.warnings [None req-5907d568-ee38-4bf7-97b4-d3be907ea541 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 07:51:52.959566 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: warnings.warn(msg) Aug 26 07:51:52.959566 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: Aug 26 07:51:52.964439 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907d568-ee38-4bf7-97b4-d3be907ea541 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:53.200007 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-5907d568-ee38-4bf7-97b4-d3be907ea541 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a154190ea0646a0ad61257b79c81748', 'request_id': 'req-5907d568-ee38-4bf7-97b4-d3be907ea541'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:51:53.245564 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-5907d568-ee38-4bf7-97b4-d3be907ea541 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a154190ea0646a0ad61257b79c81748', 'request_id': 'req-5907d568-ee38-4bf7-97b4-d3be907ea541'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:51:53.340708 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-5907d568-ee38-4bf7-97b4-d3be907ea541 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a154190ea0646a0ad61257b79c81748', 'request_id': 'req-5907d568-ee38-4bf7-97b4-d3be907ea541'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:51:53.349516 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5f133-b46e-4dc7-9b12-f1e3877b2803 service cinder] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:53.352303 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-33c5f133-b46e-4dc7-9b12-f1e3877b2803 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:53.399392 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5f133-b46e-4dc7-9b12-f1e3877b2803 service cinder] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:53.418501 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-5907d568-ee38-4bf7-97b4-d3be907ea541 admin admin] The token cache is being invalidate because project 6a154190ea0646a0ad61257b79c81748 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:51:53.418798 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-5907d568-ee38-4bf7-97b4-d3be907ea541 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:51:53.419616 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-5907d568-ee38-4bf7-97b4-d3be907ea541 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:51:53.424118 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 814/1647] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:51:52 2022] DELETE /identity/v3/projects/6a154190ea0646a0ad61257b79c81748 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:51:53.424118 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4156d1-fa1e-48c0-adcb-54cf20c54477 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:53.424118 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4156d1-fa1e-48c0-adcb-54cf20c54477 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:53.424118 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4156d1-fa1e-48c0-adcb-54cf20c54477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:53.472405 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-ec4156d1-fa1e-48c0-adcb-54cf20c54477 None None] MFA Rules not processed for user `c28994b4c95d49718fbd048baa67fe3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:51:53.474668 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-ec4156d1-fa1e-48c0-adcb-54cf20c54477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:53.563688 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc1b79-3b43-4bb8-aa97-70abf5973c73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:53.564407 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc1b79-3b43-4bb8-aa97-70abf5973c73 service cinder] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:53.566154 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc1b79-3b43-4bb8-aa97-70abf5973c73 service cinder] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:53.566517 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc1b79-3b43-4bb8-aa97-70abf5973c73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:53.572457 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-4afc1b79-3b43-4bb8-aa97-70abf5973c73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:53.645633 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 815/1648] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:51:53 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:51:53.647297 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4156d1-fa1e-48c0-adcb-54cf20c54477 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:53.649644 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-ec4156d1-fa1e-48c0-adcb-54cf20c54477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:53.741821 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:51:53.775013 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc1b79-3b43-4bb8-aa97-70abf5973c73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:53.778532 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc1b79-3b43-4bb8-aa97-70abf5973c73 service cinder] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:53.814806 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 834/1649] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:51:53 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:51:53.817044 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc1b79-3b43-4bb8-aa97-70abf5973c73 service cinder] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:53.820819 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-4afc1b79-3b43-4bb8-aa97-70abf5973c73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:53.878824 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4156d1-fa1e-48c0-adcb-54cf20c54477 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:53.909083 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20e238-bfb9-4cff-8c3b-48c4e1e8de2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:53.909083 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20e238-bfb9-4cff-8c3b-48c4e1e8de2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:53.909083 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20e238-bfb9-4cff-8c3b-48c4e1e8de2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:53.909083 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20e238-bfb9-4cff-8c3b-48c4e1e8de2e admin admin] PATH_INFO: `/v3/users/66cb98dc9e98497a97ea481f5e5d0249` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:53.909649 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e20e238-bfb9-4cff-8c3b-48c4e1e8de2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=66cb98dc9e98497a97ea481f5e5d0249)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:53.909649 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e20e238-bfb9-4cff-8c3b-48c4e1e8de2e admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:53.958853 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:51:53.991477 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc1b79-3b43-4bb8-aa97-70abf5973c73 service cinder] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:54.001513 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daad0806-d75b-43b2-9b7e-4af68c41f913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:54.002757 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad0806-d75b-43b2-9b7e-4af68c41f913 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:54.003291 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad0806-d75b-43b2-9b7e-4af68c41f913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:54.004485 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad0806-d75b-43b2-9b7e-4af68c41f913 admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:54.005727 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daad0806-d75b-43b2-9b7e-4af68c41f913 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:54.008076 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daad0806-d75b-43b2-9b7e-4af68c41f913 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:54.129513 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 835/1650] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:51:53 2022] POST /identity/v3/projects => generated 403 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:51:54.136902 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daad0806-d75b-43b2-9b7e-4af68c41f913 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:54.257372 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-2e20e238-bfb9-4cff-8c3b-48c4e1e8de2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66cb98dc9e98497a97ea481f5e5d0249'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:51:54.258800 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-2e20e238-bfb9-4cff-8c3b-48c4e1e8de2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66cb98dc9e98497a97ea481f5e5d0249'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:51:54.346177 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daad0806-d75b-43b2-9b7e-4af68c41f913 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:54.360200 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5b681-ebf6-4f5c-9c3b-036b55f7e813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:54.361485 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5b681-ebf6-4f5c-9c3b-036b55f7e813 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:54.362029 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5b681-ebf6-4f5c-9c3b-036b55f7e813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:54.362580 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5b681-ebf6-4f5c-9c3b-036b55f7e813 admin admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:54.365873 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f5b681-ebf6-4f5c-9c3b-036b55f7e813 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:54.367728 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f5b681-ebf6-4f5c-9c3b-036b55f7e813 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:54.373553 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-2e20e238-bfb9-4cff-8c3b-48c4e1e8de2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66cb98dc9e98497a97ea481f5e5d0249'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:51:54.375524 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-2e20e238-bfb9-4cff-8c3b-48c4e1e8de2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66cb98dc9e98497a97ea481f5e5d0249'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:51:54.395623 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-2e20e238-bfb9-4cff-8c3b-48c4e1e8de2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66cb98dc9e98497a97ea481f5e5d0249'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:51:54.423562 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 816/1651] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:51:53 2022] DELETE /identity/v3/users/66cb98dc9e98497a97ea481f5e5d0249 => generated 0 bytes in 777 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:51:54.491526 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 836/1652] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:51:54 2022] POST /identity/v3/users => generated 308 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:51:54.494052 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20e238-bfb9-4cff-8c3b-48c4e1e8de2e admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:54.495785 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-2e20e238-bfb9-4cff-8c3b-48c4e1e8de2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:54.710921 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20e238-bfb9-4cff-8c3b-48c4e1e8de2e admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:54.716730 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0511d69-205f-437f-9851-d458f87ace89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:54.717439 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0511d69-205f-437f-9851-d458f87ace89 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:54.717724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0511d69-205f-437f-9851-d458f87ace89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:54.718554 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0511d69-205f-437f-9851-d458f87ace89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:54.722740 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0511d69-205f-437f-9851-d458f87ace89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:54.722740 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0511d69-205f-437f-9851-d458f87ace89 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:54.739172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 817/1653] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:51:54.741557 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5b681-ebf6-4f5c-9c3b-036b55f7e813 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:54.773636 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5b681-ebf6-4f5c-9c3b-036b55f7e813 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:54.804163 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409c78e-8a0b-4674-accb-bb832d7d74c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:54.804902 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409c78e-8a0b-4674-accb-bb832d7d74c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:54.806267 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409c78e-8a0b-4674-accb-bb832d7d74c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:54.806680 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409c78e-8a0b-4674-accb-bb832d7d74c1 admin admin] PATH_INFO: `/v3/projects/d4ca016531224fe1be9e608de914da96/users/8fa436639cfb4834bbaa338e8da712c2/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:54.858265 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409c78e-8a0b-4674-accb-bb832d7d74c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4ca016531224fe1be9e608de914da96, user_id=8fa436639cfb4834bbaa338e8da712c2, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:54.864974 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409c78e-8a0b-4674-accb-bb832d7d74c1 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:54.980113 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 837/1654] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:51:54 2022] PUT /identity/v3/projects/d4ca016531224fe1be9e608de914da96/users/8fa436639cfb4834bbaa338e8da712c2/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:51:54.981002 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0511d69-205f-437f-9851-d458f87ace89 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:54.995724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0511d69-205f-437f-9851-d458f87ace89 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:55.083095 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:51:55.182244 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde0bfb-9b98-4ab9-8add-1013bee6d13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:55.183325 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde0bfb-9b98-4ab9-8add-1013bee6d13d admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:55.184415 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde0bfb-9b98-4ab9-8add-1013bee6d13d admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:55.184415 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde0bfb-9b98-4ab9-8add-1013bee6d13d admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:55.185064 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde0bfb-9b98-4ab9-8add-1013bee6d13d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:55.187516 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde0bfb-9b98-4ab9-8add-1013bee6d13d admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:55.271985 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409c78e-8a0b-4674-accb-bb832d7d74c1 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:55.272445 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 818/1655] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:51:55.336010 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409c78e-8a0b-4674-accb-bb832d7d74c1 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:55.351595 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55feebc0-903f-4589-93fe-98bee1caa861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:55.352397 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55feebc0-903f-4589-93fe-98bee1caa861 admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:55.352748 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55feebc0-903f-4589-93fe-98bee1caa861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:55.353125 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55feebc0-903f-4589-93fe-98bee1caa861 admin admin] PATH_INFO: `/v3/projects/d4ca016531224fe1be9e608de914da96/users/8fa436639cfb4834bbaa338e8da712c2/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:55.356441 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55feebc0-903f-4589-93fe-98bee1caa861 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4ca016531224fe1be9e608de914da96, user_id=8fa436639cfb4834bbaa338e8da712c2, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:55.358652 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55feebc0-903f-4589-93fe-98bee1caa861 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:55.387043 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 838/1656] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:51:55 2022] PUT /identity/v3/projects/d4ca016531224fe1be9e608de914da96/users/8fa436639cfb4834bbaa338e8da712c2/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:51:55.787883 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde0bfb-9b98-4ab9-8add-1013bee6d13d admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:55.789544 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-adde0bfb-9b98-4ab9-8add-1013bee6d13d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:55.825176 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde0bfb-9b98-4ab9-8add-1013bee6d13d admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:55.988420 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9de95-ea83-4ca0-88a9-bc47e3e56224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:55.989518 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9de95-ea83-4ca0-88a9-bc47e3e56224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:55.989518 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9de95-ea83-4ca0-88a9-bc47e3e56224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:55.989518 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9de95-ea83-4ca0-88a9-bc47e3e56224 admin admin] PATH_INFO: `/v3/projects/df44d6308e944b63b5fb83c41ce5dc41` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:55.996178 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d9de95-ea83-4ca0-88a9-bc47e3e56224 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df44d6308e944b63b5fb83c41ce5dc41)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:55.998138 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d9de95-ea83-4ca0-88a9-bc47e3e56224 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:56.163898 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-53d9de95-ea83-4ca0-88a9-bc47e3e56224 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df44d6308e944b63b5fb83c41ce5dc41', 'request_id': 'req-53d9de95-ea83-4ca0-88a9-bc47e3e56224'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:51:56.175868 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-53d9de95-ea83-4ca0-88a9-bc47e3e56224 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df44d6308e944b63b5fb83c41ce5dc41', 'request_id': 'req-53d9de95-ea83-4ca0-88a9-bc47e3e56224'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:51:56.291869 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-53d9de95-ea83-4ca0-88a9-bc47e3e56224 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df44d6308e944b63b5fb83c41ce5dc41', 'request_id': 'req-53d9de95-ea83-4ca0-88a9-bc47e3e56224'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:51:56.320999 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-53d9de95-ea83-4ca0-88a9-bc47e3e56224 admin admin] The token cache is being invalidate because project df44d6308e944b63b5fb83c41ce5dc41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:51:56.321757 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-53d9de95-ea83-4ca0-88a9-bc47e3e56224 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:51:56.323124 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-53d9de95-ea83-4ca0-88a9-bc47e3e56224 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:51:56.337268 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75957301-cac7-4ed0-be21-5a98915f9719 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:56.338090 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75957301-cac7-4ed0-be21-5a98915f9719 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:56.338837 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75957301-cac7-4ed0-be21-5a98915f9719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:56.339142 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 819/1657] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:51:55 2022] DELETE /identity/v3/projects/df44d6308e944b63b5fb83c41ce5dc41 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:51:56.415713 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-75957301-cac7-4ed0-be21-5a98915f9719 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:51:56.423880 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-75957301-cac7-4ed0-be21-5a98915f9719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:56.616482 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 839/1658] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:51:56.632120 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309dc37-2f4b-4118-8596-b2d8aee06d47 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:56.632415 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309dc37-2f4b-4118-8596-b2d8aee06d47 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:56.634000 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309dc37-2f4b-4118-8596-b2d8aee06d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:56.695842 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-1309dc37-2f4b-4118-8596-b2d8aee06d47 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:51:56.697580 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-1309dc37-2f4b-4118-8596-b2d8aee06d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:56.763840 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 820/1659] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:51:56.768859 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75957301-cac7-4ed0-be21-5a98915f9719 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:56.782435 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75957301-cac7-4ed0-be21-5a98915f9719 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:56.789223 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1309dc37-2f4b-4118-8596-b2d8aee06d47 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:56.791039 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-1309dc37-2f4b-4118-8596-b2d8aee06d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:56.805526 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209106d-085b-4f61-8515-16466aee6f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:56.806163 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209106d-085b-4f61-8515-16466aee6f00 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:56.806446 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209106d-085b-4f61-8515-16466aee6f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:56.806720 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209106d-085b-4f61-8515-16466aee6f00 admin admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:56.807429 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5209106d-085b-4f61-8515-16466aee6f00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:51:56.807741 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5209106d-085b-4f61-8515-16466aee6f00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:56.809370 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1309dc37-2f4b-4118-8596-b2d8aee06d47 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:56.809512 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5209106d-085b-4f61-8515-16466aee6f00 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:56.818368 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e534d-3092-4051-992f-a05d3bca19f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:56.819198 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e534d-3092-4051-992f-a05d3bca19f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:56.819545 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e534d-3092-4051-992f-a05d3bca19f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:56.820014 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e534d-3092-4051-992f-a05d3bca19f5 admin admin] PATH_INFO: `/v3/users/1fb4b55ed2264253ab8b587e369f8949` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:56.829405 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46e534d-3092-4051-992f-a05d3bca19f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fb4b55ed2264253ab8b587e369f8949)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:56.832344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46e534d-3092-4051-992f-a05d3bca19f5 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:56.849667 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 840/1660] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:51:56.853788 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209106d-085b-4f61-8515-16466aee6f00 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:56.873527 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209106d-085b-4f61-8515-16466aee6f00 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:56.897881 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a931f3-07b3-4962-b58c-0e75ddd896c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:56.898802 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a931f3-07b3-4962-b58c-0e75ddd896c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:56.900596 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a931f3-07b3-4962-b58c-0e75ddd896c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:56.901074 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a931f3-07b3-4962-b58c-0e75ddd896c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:56.901901 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a931f3-07b3-4962-b58c-0e75ddd896c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:56.904139 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a931f3-07b3-4962-b58c-0e75ddd896c9 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:56.922686 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:51:57.048385 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 841/1661] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:51:56 2022] POST /identity/v3/projects => generated 377 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:51:57.052931 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a931f3-07b3-4962-b58c-0e75ddd896c9 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:57.189506 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a931f3-07b3-4962-b58c-0e75ddd896c9 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:57.194928 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-d46e534d-3092-4051-992f-a05d3bca19f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fb4b55ed2264253ab8b587e369f8949'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:51:57.196390 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-d46e534d-3092-4051-992f-a05d3bca19f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fb4b55ed2264253ab8b587e369f8949'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:51:57.198781 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:51:57.199679 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c776a1-60de-4df3-9254-8b2dffd06058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:57.200323 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c776a1-60de-4df3-9254-8b2dffd06058 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:57.200605 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c776a1-60de-4df3-9254-8b2dffd06058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:57.200902 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c776a1-60de-4df3-9254-8b2dffd06058 admin admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:57.201531 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c776a1-60de-4df3-9254-8b2dffd06058 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:57.205231 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c776a1-60de-4df3-9254-8b2dffd06058 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:57.314647 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-d46e534d-3092-4051-992f-a05d3bca19f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fb4b55ed2264253ab8b587e369f8949'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:51:57.315601 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-d46e534d-3092-4051-992f-a05d3bca19f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fb4b55ed2264253ab8b587e369f8949'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:51:57.330012 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-d46e534d-3092-4051-992f-a05d3bca19f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fb4b55ed2264253ab8b587e369f8949'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:51:57.350202 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 842/1662] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:51:57 2022] POST /identity/v3/users => generated 289 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:51:57.355166 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c776a1-60de-4df3-9254-8b2dffd06058 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:57.358084 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-29c776a1-60de-4df3-9254-8b2dffd06058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:57.380689 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 821/1663] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:51:56 2022] DELETE /identity/v3/users/1fb4b55ed2264253ab8b587e369f8949 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:51:57.384480 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878dc3e4-992f-411b-9157-0483047223b1 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:57.389089 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878dc3e4-992f-411b-9157-0483047223b1 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:57.391155 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878dc3e4-992f-411b-9157-0483047223b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:57.400489 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c776a1-60de-4df3-9254-8b2dffd06058 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:57.446049 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-878dc3e4-992f-411b-9157-0483047223b1 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:51:57.454373 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-878dc3e4-992f-411b-9157-0483047223b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:57.575435 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eccc50-b44b-43ba-aa66-00679a324575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:57.578279 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eccc50-b44b-43ba-aa66-00679a324575 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:57.579362 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eccc50-b44b-43ba-aa66-00679a324575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:57.580863 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eccc50-b44b-43ba-aa66-00679a324575 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:57.583835 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eccc50-b44b-43ba-aa66-00679a324575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:57.588400 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eccc50-b44b-43ba-aa66-00679a324575 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:57.623298 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 843/1664] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 07:51:57.628471 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eccc50-b44b-43ba-aa66-00679a324575 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:57.643796 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 822/1665] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:51:57.667589 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eccc50-b44b-43ba-aa66-00679a324575 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:57.680967 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2432c-96f6-4e4d-a341-9de185891ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:57.682412 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2432c-96f6-4e4d-a341-9de185891ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:57.683825 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2432c-96f6-4e4d-a341-9de185891ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:57.685370 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2432c-96f6-4e4d-a341-9de185891ec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:57.688833 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d2432c-96f6-4e4d-a341-9de185891ec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:57.693780 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d2432c-96f6-4e4d-a341-9de185891ec7 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:57.731344 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 844/1666] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:51:57.748831 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878dc3e4-992f-411b-9157-0483047223b1 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:57.771309 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878dc3e4-992f-411b-9157-0483047223b1 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:57.780078 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2432c-96f6-4e4d-a341-9de185891ec7 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:57.784033 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-36d2432c-96f6-4e4d-a341-9de185891ec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:57.801694 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e62f1a-34af-4da3-8026-fc0bc32e0512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:57.807268 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e62f1a-34af-4da3-8026-fc0bc32e0512 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:57.808646 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e62f1a-34af-4da3-8026-fc0bc32e0512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:57.811382 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e62f1a-34af-4da3-8026-fc0bc32e0512 admin admin] PATH_INFO: `/v3/projects/a407c7644b5a4a39ae09a83b4265675e/users/4128021efd9e4ae8a2c06933e37c7a35/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:57.886814 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e62f1a-34af-4da3-8026-fc0bc32e0512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a407c7644b5a4a39ae09a83b4265675e, user_id=4128021efd9e4ae8a2c06933e37c7a35, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:57.892126 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e62f1a-34af-4da3-8026-fc0bc32e0512 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:57.966137 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2432c-96f6-4e4d-a341-9de185891ec7 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:57.970408 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328dc851-6b92-4ec9-bf36-1ee95211ada6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:57.971014 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dc851-6b92-4ec9-bf36-1ee95211ada6 service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:57.971302 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dc851-6b92-4ec9-bf36-1ee95211ada6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:57.971580 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dc851-6b92-4ec9-bf36-1ee95211ada6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:57.983441 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328dc851-6b92-4ec9-bf36-1ee95211ada6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:57.985728 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328dc851-6b92-4ec9-bf36-1ee95211ada6 service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:57.994843 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 823/1667] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:51:57 2022] PUT /identity/v3/projects/a407c7644b5a4a39ae09a83b4265675e/users/4128021efd9e4ae8a2c06933e37c7a35/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:51:58.000343 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 845/1668] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:51:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 07:51:58.011703 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b5404-725f-4a89-a9d9-69895076adf6 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:58.012154 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b5404-725f-4a89-a9d9-69895076adf6 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:58.012528 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b5404-725f-4a89-a9d9-69895076adf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:58.053548 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-619b5404-725f-4a89-a9d9-69895076adf6 None None] MFA Rules not processed for user `4128021efd9e4ae8a2c06933e37c7a35`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:51:58.055524 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-619b5404-725f-4a89-a9d9-69895076adf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:58.181398 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 824/1669] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:51:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:51:58.188455 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328dc851-6b92-4ec9-bf36-1ee95211ada6 service neutron] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:58.211768 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328dc851-6b92-4ec9-bf36-1ee95211ada6 service neutron] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:58.214011 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:51:58.361042 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843a229-403c-45b9-b1e6-a6322ca19fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:58.365830 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843a229-403c-45b9-b1e6-a6322ca19fa3 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:58.366160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843a229-403c-45b9-b1e6-a6322ca19fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:58.368960 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843a229-403c-45b9-b1e6-a6322ca19fa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:58.370843 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3843a229-403c-45b9-b1e6-a6322ca19fa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:58.377435 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3843a229-403c-45b9-b1e6-a6322ca19fa3 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:58.530546 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 846/1670] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:51:58 2022] POST /identity/v3/projects => generated 379 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:51:58.532047 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b5404-725f-4a89-a9d9-69895076adf6 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:58.560821 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b5404-725f-4a89-a9d9-69895076adf6 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:58.696736 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba615d2-eede-4cd4-bbce-d01a8ffe6aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:58.697390 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba615d2-eede-4cd4-bbce-d01a8ffe6aee admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:58.697670 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba615d2-eede-4cd4-bbce-d01a8ffe6aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:58.700139 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba615d2-eede-4cd4-bbce-d01a8ffe6aee admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:58.700854 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba615d2-eede-4cd4-bbce-d01a8ffe6aee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:58.704017 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba615d2-eede-4cd4-bbce-d01a8ffe6aee admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:58.886446 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 825/1671] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:51:58 2022] POST /identity/v3/users => generated 296 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:51:58.890964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843a229-403c-45b9-b1e6-a6322ca19fa3 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:58.910652 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843a229-403c-45b9-b1e6-a6322ca19fa3 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:58.959467 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53051cee-9130-4be5-bad7-a751f2b49328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:58.964055 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53051cee-9130-4be5-bad7-a751f2b49328 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:58.964441 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53051cee-9130-4be5-bad7-a751f2b49328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:58.964630 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53051cee-9130-4be5-bad7-a751f2b49328 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:58.965446 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53051cee-9130-4be5-bad7-a751f2b49328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:58.974418 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53051cee-9130-4be5-bad7-a751f2b49328 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:59.007789 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba615d2-eede-4cd4-bbce-d01a8ffe6aee admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:59.020331 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 847/1672] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:51:59.036949 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba615d2-eede-4cd4-bbce-d01a8ffe6aee admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:59.046002 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a8389-2a1b-45c6-8ab3-adefe5e055df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:59.048382 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a8389-2a1b-45c6-8ab3-adefe5e055df admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:59.048382 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a8389-2a1b-45c6-8ab3-adefe5e055df admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:59.048641 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a8389-2a1b-45c6-8ab3-adefe5e055df admin admin] PATH_INFO: `/v3/projects/2ac69a45fe0441249b2c8f734389f907/users/ea23c1862b74459b86027ca83056567b/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:59.105842 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61a8389-2a1b-45c6-8ab3-adefe5e055df admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ac69a45fe0441249b2c8f734389f907, user_id=ea23c1862b74459b86027ca83056567b, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:59.122832 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61a8389-2a1b-45c6-8ab3-adefe5e055df admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:59.137241 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:51:59.323850 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 826/1673] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:51:59 2022] PUT /identity/v3/projects/2ac69a45fe0441249b2c8f734389f907/users/ea23c1862b74459b86027ca83056567b/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:51:59.328047 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53051cee-9130-4be5-bad7-a751f2b49328 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:59.349911 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53051cee-9130-4be5-bad7-a751f2b49328 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:59.527152 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043a880-97f7-4275-bd70-2a89c134bbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:59.527783 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043a880-97f7-4275-bd70-2a89c134bbec admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:59.528060 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043a880-97f7-4275-bd70-2a89c134bbec admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:59.528328 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043a880-97f7-4275-bd70-2a89c134bbec admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:59.530062 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043a880-97f7-4275-bd70-2a89c134bbec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:59.533020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043a880-97f7-4275-bd70-2a89c134bbec admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:59.546655 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 848/1674] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:51:59.550712 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a8389-2a1b-45c6-8ab3-adefe5e055df admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:59.564190 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a8389-2a1b-45c6-8ab3-adefe5e055df admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:51:59.572426 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80cc31-c675-4a0b-ac79-85f705127467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:51:59.579636 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80cc31-c675-4a0b-ac79-85f705127467 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:59.579636 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80cc31-c675-4a0b-ac79-85f705127467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:59.579636 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80cc31-c675-4a0b-ac79-85f705127467 admin admin] PATH_INFO: `/v3/projects/2ac69a45fe0441249b2c8f734389f907/users/ea23c1862b74459b86027ca83056567b/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:59.579636 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80cc31-c675-4a0b-ac79-85f705127467 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ac69a45fe0441249b2c8f734389f907, user_id=ea23c1862b74459b86027ca83056567b, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:51:59.583578 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80cc31-c675-4a0b-ac79-85f705127467 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:51:59.605657 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 827/1675] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:51:59 2022] PUT /identity/v3/projects/2ac69a45fe0441249b2c8f734389f907/users/ea23c1862b74459b86027ca83056567b/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:51:59.617483 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc97146-8a16-4049-af4d-dc65b7af944d None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:51:59.620286 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc97146-8a16-4049-af4d-dc65b7af944d None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:51:59.620884 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc97146-8a16-4049-af4d-dc65b7af944d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:51:59.673756 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-edc97146-8a16-4049-af4d-dc65b7af944d None None] MFA Rules not processed for user `ea23c1862b74459b86027ca83056567b`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:51:59.675393 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-edc97146-8a16-4049-af4d-dc65b7af944d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:51:59.824002 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:51:59.829337 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 849/1676] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:51:59 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:51:59.847556 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80cc31-c675-4a0b-ac79-85f705127467 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:51:59.852024 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-be80cc31-c675-4a0b-ac79-85f705127467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:00.018380 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc97146-8a16-4049-af4d-dc65b7af944d None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:00.019886 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-edc97146-8a16-4049-af4d-dc65b7af944d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:00.061167 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80cc31-c675-4a0b-ac79-85f705127467 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:00.073593 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06de5d-9f8d-4ff3-a086-f0a423b41a0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:00.074353 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06de5d-9f8d-4ff3-a086-f0a423b41a0e service cinder] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:00.074856 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06de5d-9f8d-4ff3-a086-f0a423b41a0e service cinder] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:00.075297 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06de5d-9f8d-4ff3-a086-f0a423b41a0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:00.110000 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf06de5d-9f8d-4ff3-a086-f0a423b41a0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:00.113993 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf06de5d-9f8d-4ff3-a086-f0a423b41a0e service cinder] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:00.140394 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 828/1677] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:51:59 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:52:00.144439 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a7553-68a3-4310-ab0f-3b90af51d3fd None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:00.144747 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a7553-68a3-4310-ab0f-3b90af51d3fd None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:00.145025 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a7553-68a3-4310-ab0f-3b90af51d3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:00.218940 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc97146-8a16-4049-af4d-dc65b7af944d None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:00.219897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-921a7553-68a3-4310-ab0f-3b90af51d3fd None None] MFA Rules not processed for user `8fa436639cfb4834bbaa338e8da712c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:00.222781 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-921a7553-68a3-4310-ab0f-3b90af51d3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:00.230527 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7ec9f-ba5b-4fae-8feb-cff68a6ea143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:00.246449 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7ec9f-ba5b-4fae-8feb-cff68a6ea143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:00.246449 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7ec9f-ba5b-4fae-8feb-cff68a6ea143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:00.246449 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7ec9f-ba5b-4fae-8feb-cff68a6ea143 admin admin] PATH_INFO: `/v3/projects/99aa4a2a73f441aa8a1bc9b7e4f6f48b` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:00.246449 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7ec9f-ba5b-4fae-8feb-cff68a6ea143 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99aa4a2a73f441aa8a1bc9b7e4f6f48b)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:00.246449 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7ec9f-ba5b-4fae-8feb-cff68a6ea143 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:00.424964 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 829/1678] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:00 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:00.462743 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-2bd7ec9f-ba5b-4fae-8feb-cff68a6ea143 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99aa4a2a73f441aa8a1bc9b7e4f6f48b', 'request_id': 'req-2bd7ec9f-ba5b-4fae-8feb-cff68a6ea143'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:00.478234 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-2bd7ec9f-ba5b-4fae-8feb-cff68a6ea143 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99aa4a2a73f441aa8a1bc9b7e4f6f48b', 'request_id': 'req-2bd7ec9f-ba5b-4fae-8feb-cff68a6ea143'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:00.496516 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-2bd7ec9f-ba5b-4fae-8feb-cff68a6ea143 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99aa4a2a73f441aa8a1bc9b7e4f6f48b', 'request_id': 'req-2bd7ec9f-ba5b-4fae-8feb-cff68a6ea143'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:00.542072 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a7553-68a3-4310-ab0f-3b90af51d3fd None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:00.544094 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-921a7553-68a3-4310-ab0f-3b90af51d3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:00.558963 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a7553-68a3-4310-ab0f-3b90af51d3fd None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:00.618905 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-2bd7ec9f-ba5b-4fae-8feb-cff68a6ea143 admin admin] The token cache is being invalidate because project 99aa4a2a73f441aa8a1bc9b7e4f6f48b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:52:00.619314 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-2bd7ec9f-ba5b-4fae-8feb-cff68a6ea143 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:00.620388 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-2bd7ec9f-ba5b-4fae-8feb-cff68a6ea143 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:00.623429 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 850/1679] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:52:00 2022] DELETE /identity/v3/projects/99aa4a2a73f441aa8a1bc9b7e4f6f48b => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:00.628479 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447132f9-b434-4d87-a31d-38997936a296 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:00.628764 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447132f9-b434-4d87-a31d-38997936a296 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:00.629033 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447132f9-b434-4d87-a31d-38997936a296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:00.682438 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-447132f9-b434-4d87-a31d-38997936a296 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:00.684687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-447132f9-b434-4d87-a31d-38997936a296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:00.707787 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22cc73-b4c2-40ca-9df6-b943cfc94b49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:00.708853 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22cc73-b4c2-40ca-9df6-b943cfc94b49 service cinder] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:00.709315 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22cc73-b4c2-40ca-9df6-b943cfc94b49 service cinder] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:00.709871 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22cc73-b4c2-40ca-9df6-b943cfc94b49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:00.714758 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-1d22cc73-b4c2-40ca-9df6-b943cfc94b49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:00.880657 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22cc73-b4c2-40ca-9df6-b943cfc94b49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:00.882580 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22cc73-b4c2-40ca-9df6-b943cfc94b49 service cinder] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:00.893710 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 851/1680] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:00.902277 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7cd9c6-f094-4c9e-9c29-5488e5e37285 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:00.902277 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7cd9c6-f094-4c9e-9c29-5488e5e37285 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:00.902612 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7cd9c6-f094-4c9e-9c29-5488e5e37285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:00.917809 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 830/1681] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 07:52:00.943085 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-fd7cd9c6-f094-4c9e-9c29-5488e5e37285 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:00.945071 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-fd7cd9c6-f094-4c9e-9c29-5488e5e37285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:00.966346 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 852/1682] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:00.971482 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22cc73-b4c2-40ca-9df6-b943cfc94b49 service cinder] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:01.007626 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22cc73-b4c2-40ca-9df6-b943cfc94b49 service cinder] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:01.016693 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11146cec-8b11-4f54-a667-37683a8ebc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:01.019739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11146cec-8b11-4f54-a667-37683a8ebc53 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:01.019739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11146cec-8b11-4f54-a667-37683a8ebc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:01.019739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11146cec-8b11-4f54-a667-37683a8ebc53 admin admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:01.019739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11146cec-8b11-4f54-a667-37683a8ebc53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:52:01.019739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11146cec-8b11-4f54-a667-37683a8ebc53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:01.021394 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11146cec-8b11-4f54-a667-37683a8ebc53 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:01.039845 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 831/1683] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:52:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:52:01.044388 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7cd9c6-f094-4c9e-9c29-5488e5e37285 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:01.057773 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7cd9c6-f094-4c9e-9c29-5488e5e37285 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:01.071148 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97492fcc-fba7-4a76-8435-5d5e329496d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:01.071857 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97492fcc-fba7-4a76-8435-5d5e329496d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:01.072124 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97492fcc-fba7-4a76-8435-5d5e329496d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:01.072416 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97492fcc-fba7-4a76-8435-5d5e329496d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:01.073495 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97492fcc-fba7-4a76-8435-5d5e329496d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:01.075126 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97492fcc-fba7-4a76-8435-5d5e329496d1 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:01.256959 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 853/1684] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:52:01 2022] POST /identity/v3/projects => generated 383 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:01.258828 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11146cec-8b11-4f54-a667-37683a8ebc53 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:01.275640 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11146cec-8b11-4f54-a667-37683a8ebc53 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:01.514029 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c638335b-ffcf-4660-ba34-6338926d2aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:01.523463 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638335b-ffcf-4660-ba34-6338926d2aef admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:01.538158 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638335b-ffcf-4660-ba34-6338926d2aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:01.538559 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638335b-ffcf-4660-ba34-6338926d2aef admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:01.542968 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c638335b-ffcf-4660-ba34-6338926d2aef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:01.553404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c638335b-ffcf-4660-ba34-6338926d2aef admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:01.710420 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:52:01.724984 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 832/1685] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:52:01 2022] POST /identity/v3/users => generated 292 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:01.730281 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97492fcc-fba7-4a76-8435-5d5e329496d1 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:01.738384 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:52:01.747594 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97492fcc-fba7-4a76-8435-5d5e329496d1 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:01.797602 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ec481-c692-4f23-8341-75a88e96fe83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:01.802374 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ec481-c692-4f23-8341-75a88e96fe83 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:01.810848 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ec481-c692-4f23-8341-75a88e96fe83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:01.810848 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ec481-c692-4f23-8341-75a88e96fe83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:01.815085 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ec481-c692-4f23-8341-75a88e96fe83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:01.816112 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ec481-c692-4f23-8341-75a88e96fe83 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:01.892141 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c638335b-ffcf-4660-ba34-6338926d2aef admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:01.902547 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 854/1686] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:01.908191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c638335b-ffcf-4660-ba34-6338926d2aef admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:01.932099 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e45f92-4942-4445-aac9-04114efc70d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:01.934311 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e45f92-4942-4445-aac9-04114efc70d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:01.940265 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e45f92-4942-4445-aac9-04114efc70d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:01.941103 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e45f92-4942-4445-aac9-04114efc70d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:01.943156 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e45f92-4942-4445-aac9-04114efc70d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:01.945858 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e45f92-4942-4445-aac9-04114efc70d5 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:01.979346 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 833/1687] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:01.984848 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ec481-c692-4f23-8341-75a88e96fe83 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:02.000122 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ec481-c692-4f23-8341-75a88e96fe83 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:02.026834 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d54eeb-59e7-4899-ba41-1ee30d23aeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:02.026834 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d54eeb-59e7-4899-ba41-1ee30d23aeb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:02.026834 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d54eeb-59e7-4899-ba41-1ee30d23aeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:02.026834 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d54eeb-59e7-4899-ba41-1ee30d23aeb2 admin admin] PATH_INFO: `/v3/projects/846d327f0a284d2989cd3a10efa5e0b0/users/b821beb41c2e4087adf7fd7f8609606a/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:02.087461 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d54eeb-59e7-4899-ba41-1ee30d23aeb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=846d327f0a284d2989cd3a10efa5e0b0, user_id=b821beb41c2e4087adf7fd7f8609606a, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:02.092615 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d54eeb-59e7-4899-ba41-1ee30d23aeb2 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:02.191606 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 855/1688] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:52:01 2022] PUT /identity/v3/projects/846d327f0a284d2989cd3a10efa5e0b0/users/b821beb41c2e4087adf7fd7f8609606a/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:52:02.203849 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ac69c-973b-4069-b45d-edbd93136a47 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:02.207598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ac69c-973b-4069-b45d-edbd93136a47 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:02.207598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ac69c-973b-4069-b45d-edbd93136a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:02.267183 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-7b0ac69c-973b-4069-b45d-edbd93136a47 None None] MFA Rules not processed for user `b821beb41c2e4087adf7fd7f8609606a`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:02.270659 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-7b0ac69c-973b-4069-b45d-edbd93136a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:02.400591 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 834/1689] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:52:02.402184 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d54eeb-59e7-4899-ba41-1ee30d23aeb2 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:02.559146 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d54eeb-59e7-4899-ba41-1ee30d23aeb2 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:02.577669 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d10e10-ed6a-4b1e-b65c-2b8bd26e05dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:02.578494 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d10e10-ed6a-4b1e-b65c-2b8bd26e05dd admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:02.580272 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d10e10-ed6a-4b1e-b65c-2b8bd26e05dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:02.588170 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d10e10-ed6a-4b1e-b65c-2b8bd26e05dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:02.593907 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d10e10-ed6a-4b1e-b65c-2b8bd26e05dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:02.601600 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d10e10-ed6a-4b1e-b65c-2b8bd26e05dd admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:02.798453 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 856/1690] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:52:02 2022] POST /identity/v3/projects => generated 385 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:02.803135 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ac69c-973b-4069-b45d-edbd93136a47 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:02.821664 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ac69c-973b-4069-b45d-edbd93136a47 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:02.932952 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4965ee-03a7-44b2-8396-e80d243683cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:02.934012 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4965ee-03a7-44b2-8396-e80d243683cb admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:02.934227 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4965ee-03a7-44b2-8396-e80d243683cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:02.934514 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4965ee-03a7-44b2-8396-e80d243683cb admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:02.935339 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4965ee-03a7-44b2-8396-e80d243683cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:02.937629 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4965ee-03a7-44b2-8396-e80d243683cb admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:03.029526 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 835/1691] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:52:02 2022] POST /identity/v3/users => generated 293 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:03.033732 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d10e10-ed6a-4b1e-b65c-2b8bd26e05dd admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:03.049744 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d10e10-ed6a-4b1e-b65c-2b8bd26e05dd admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:03.077545 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10b21b-b5c4-4666-9e80-bccf62227ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:03.084896 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10b21b-b5c4-4666-9e80-bccf62227ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:03.085182 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10b21b-b5c4-4666-9e80-bccf62227ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:03.085486 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10b21b-b5c4-4666-9e80-bccf62227ac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:03.086183 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10b21b-b5c4-4666-9e80-bccf62227ac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:03.087848 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10b21b-b5c4-4666-9e80-bccf62227ac4 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:03.136657 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4965ee-03a7-44b2-8396-e80d243683cb admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:03.136860 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 857/1692] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:03.156847 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4965ee-03a7-44b2-8396-e80d243683cb admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:03.170126 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91faf567-f99e-4ee5-9387-97a8ba859680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:03.171041 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91faf567-f99e-4ee5-9387-97a8ba859680 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:03.171357 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91faf567-f99e-4ee5-9387-97a8ba859680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:03.172123 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91faf567-f99e-4ee5-9387-97a8ba859680 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:03.172822 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91faf567-f99e-4ee5-9387-97a8ba859680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:03.178979 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91faf567-f99e-4ee5-9387-97a8ba859680 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:03.204483 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 836/1693] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:03.206296 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10b21b-b5c4-4666-9e80-bccf62227ac4 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:03.223067 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10b21b-b5c4-4666-9e80-bccf62227ac4 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:03.237739 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95f5de-9376-4b8e-929c-e38924edb6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:03.238483 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95f5de-9376-4b8e-929c-e38924edb6b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:03.238761 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95f5de-9376-4b8e-929c-e38924edb6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:03.239240 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95f5de-9376-4b8e-929c-e38924edb6b4 admin admin] PATH_INFO: `/v3/projects/f5ea387f18214906bfa6d8df2d715a1d/users/7990f4a41aca4d78aa2509bda9a11c3c/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:03.284356 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed95f5de-9376-4b8e-929c-e38924edb6b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5ea387f18214906bfa6d8df2d715a1d, user_id=7990f4a41aca4d78aa2509bda9a11c3c, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:03.287356 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed95f5de-9376-4b8e-929c-e38924edb6b4 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:03.406852 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 858/1694] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:52:03 2022] PUT /identity/v3/projects/f5ea387f18214906bfa6d8df2d715a1d/users/7990f4a41aca4d78aa2509bda9a11c3c/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:03.419340 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e2e31-1b89-455c-807b-aef2684aa218 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:03.419634 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e2e31-1b89-455c-807b-aef2684aa218 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:03.419911 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e2e31-1b89-455c-807b-aef2684aa218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:03.474461 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:52:03.478859 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-cb6e2e31-1b89-455c-807b-aef2684aa218 None None] MFA Rules not processed for user `7990f4a41aca4d78aa2509bda9a11c3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:03.481271 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-cb6e2e31-1b89-455c-807b-aef2684aa218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:03.661689 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 837/1695] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:03.666073 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95f5de-9376-4b8e-929c-e38924edb6b4 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:03.759494 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e2e31-1b89-455c-807b-aef2684aa218 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:03.760013 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-cb6e2e31-1b89-455c-807b-aef2684aa218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:03.930830 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95f5de-9376-4b8e-929c-e38924edb6b4 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:03.940502 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cf843-7574-49d4-8e13-904396a337eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:03.941296 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cf843-7574-49d4-8e13-904396a337eb admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:03.941650 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cf843-7574-49d4-8e13-904396a337eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:03.941988 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cf843-7574-49d4-8e13-904396a337eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:03.942858 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8cf843-7574-49d4-8e13-904396a337eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:03.945112 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8cf843-7574-49d4-8e13-904396a337eb admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:04.085559 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e2e31-1b89-455c-807b-aef2684aa218 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:04.099596 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c47608-9d5e-499d-add5-208463cefb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:04.101217 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c47608-9d5e-499d-add5-208463cefb3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:04.101524 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c47608-9d5e-499d-add5-208463cefb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:04.101803 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 859/1696] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:52:03 2022] POST /identity/v3/projects => generated 387 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:04.103316 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024899e-23a4-40dc-9d96-cd97d44a2e54 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:04.103789 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c47608-9d5e-499d-add5-208463cefb3a admin admin] PATH_INFO: `/v3/users/33cfe206c9ab4e4ab58b9989d7be1998` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:04.115875 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024899e-23a4-40dc-9d96-cd97d44a2e54 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:04.115875 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024899e-23a4-40dc-9d96-cd97d44a2e54 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:04.117040 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c47608-9d5e-499d-add5-208463cefb3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=33cfe206c9ab4e4ab58b9989d7be1998)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:04.119087 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c47608-9d5e-499d-add5-208463cefb3a admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:04.122082 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 860/1697] 10.222.0.42 () {54 vars in 921 bytes} [Fri Aug 26 07:52:04 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:52:04.123906 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024899e-23a4-40dc-9d96-cd97d44a2e54 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:04.241754 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024899e-23a4-40dc-9d96-cd97d44a2e54 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:04.262675 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214cbf9e-d644-44bf-95b9-dc963f291fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:04.264205 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214cbf9e-d644-44bf-95b9-dc963f291fa3 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:04.266429 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214cbf9e-d644-44bf-95b9-dc963f291fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:04.266964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214cbf9e-d644-44bf-95b9-dc963f291fa3 admin admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:04.273178 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214cbf9e-d644-44bf-95b9-dc963f291fa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:04.273178 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214cbf9e-d644-44bf-95b9-dc963f291fa3 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:04.453646 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 861/1698] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:52:04 2022] POST /identity/v3/users => generated 300 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:04.457011 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c2d60-c5bd-43df-b0bf-044dde5e4249 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:04.459694 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c2d60-c5bd-43df-b0bf-044dde5e4249 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:04.460224 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c2d60-c5bd-43df-b0bf-044dde5e4249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:04.486971 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:52:04.524283 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-df9c2d60-c5bd-43df-b0bf-044dde5e4249 None None] MFA Rules not processed for user `f6c2bc293f1b4daca83e8d6dff66a316`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:04.525447 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-df9c2d60-c5bd-43df-b0bf-044dde5e4249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:04.529390 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-94c47608-9d5e-499d-add5-208463cefb3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33cfe206c9ab4e4ab58b9989d7be1998'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:04.530071 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-94c47608-9d5e-499d-add5-208463cefb3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33cfe206c9ab4e4ab58b9989d7be1998'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:04.635851 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-94c47608-9d5e-499d-add5-208463cefb3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33cfe206c9ab4e4ab58b9989d7be1998'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:04.637797 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-94c47608-9d5e-499d-add5-208463cefb3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33cfe206c9ab4e4ab58b9989d7be1998'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:04.666066 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-94c47608-9d5e-499d-add5-208463cefb3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33cfe206c9ab4e4ab58b9989d7be1998'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:04.741417 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 838/1699] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:52:03 2022] DELETE /identity/v3/users/33cfe206c9ab4e4ab58b9989d7be1998 => generated 0 bytes in 984 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:52:04.742659 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c47608-9d5e-499d-add5-208463cefb3a admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:04.745419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-94c47608-9d5e-499d-add5-208463cefb3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:04.816752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 862/1700] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Aug 26 07:52:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:04.817281 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f1ae1-7ab1-48d4-95e1-5015b4610826 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:04.817754 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f1ae1-7ab1-48d4-95e1-5015b4610826 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:04.818055 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f1ae1-7ab1-48d4-95e1-5015b4610826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:04.864116 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-367f1ae1-7ab1-48d4-95e1-5015b4610826 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:04.865356 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-367f1ae1-7ab1-48d4-95e1-5015b4610826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:04.977128 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c47608-9d5e-499d-add5-208463cefb3a admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:04.998724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cc67c-dc5b-47aa-9a3b-3f275c6b789d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:05.002283 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cc67c-dc5b-47aa-9a3b-3f275c6b789d admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:05.002588 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cc67c-dc5b-47aa-9a3b-3f275c6b789d admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:05.002857 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cc67c-dc5b-47aa-9a3b-3f275c6b789d admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:05.003583 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47cc67c-dc5b-47aa-9a3b-3f275c6b789d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:05.011756 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47cc67c-dc5b-47aa-9a3b-3f275c6b789d admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:05.054531 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 839/1701] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:05.056186 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cc67c-dc5b-47aa-9a3b-3f275c6b789d admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:05.058558 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-c47cc67c-dc5b-47aa-9a3b-3f275c6b789d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:05.067146 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 863/1702] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:05.075694 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49457f-649b-44c2-a74a-350ca019eb04 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:05.076135 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49457f-649b-44c2-a74a-350ca019eb04 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:05.078486 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49457f-649b-44c2-a74a-350ca019eb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:05.159142 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-4f49457f-649b-44c2-a74a-350ca019eb04 None None] MFA Rules not processed for user `cc96be5baacf490bad43962fa4a24e4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:05.159142 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-4f49457f-649b-44c2-a74a-350ca019eb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:05.310049 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cc67c-dc5b-47aa-9a3b-3f275c6b789d admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:05.328805 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f46a3a-4b12-458f-8bfe-f1901a24c021 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c2bc293f1b4daca83e8d6dff66a316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:05.334827 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f46a3a-4b12-458f-8bfe-f1901a24c021 service placement] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:05.334827 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f46a3a-4b12-458f-8bfe-f1901a24c021 service placement] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:05.335866 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f46a3a-4b12-458f-8bfe-f1901a24c021 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:05.357284 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f46a3a-4b12-458f-8bfe-f1901a24c021 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:05.362230 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f46a3a-4b12-458f-8bfe-f1901a24c021 service placement] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:05.394034 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:52:05.400748 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 864/1703] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:05 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:05.415164 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f49457f-649b-44c2-a74a-350ca019eb04 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:05.424747 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 840/1704] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:52:05.426976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f46a3a-4b12-458f-8bfe-f1901a24c021 service placement] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:05.430483 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-24f46a3a-4b12-458f-8bfe-f1901a24c021 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:05.461992 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f49457f-649b-44c2-a74a-350ca019eb04 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:05.473983 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5c8f2-1e4e-46a1-b2d9-0f7cad0a3823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:05.474689 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5c8f2-1e4e-46a1-b2d9-0f7cad0a3823 admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:05.474971 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5c8f2-1e4e-46a1-b2d9-0f7cad0a3823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:05.475274 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5c8f2-1e4e-46a1-b2d9-0f7cad0a3823 admin admin] PATH_INFO: `/v3/projects/ed40d94a6e1d4fde9df37bf0170f6ea5/users/4dfe4dad6c944c88a88b17271f447c22/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:05.500328 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d5c8f2-1e4e-46a1-b2d9-0f7cad0a3823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed40d94a6e1d4fde9df37bf0170f6ea5, user_id=4dfe4dad6c944c88a88b17271f447c22, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:05.504894 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d5c8f2-1e4e-46a1-b2d9-0f7cad0a3823 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:05.618062 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 865/1705] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:52:05 2022] PUT /identity/v3/projects/ed40d94a6e1d4fde9df37bf0170f6ea5/users/4dfe4dad6c944c88a88b17271f447c22/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:05.618062 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5c8f2-1e4e-46a1-b2d9-0f7cad0a3823 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:05.621057 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-b1d5c8f2-1e4e-46a1-b2d9-0f7cad0a3823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:05.677428 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f46a3a-4b12-458f-8bfe-f1901a24c021 service placement] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:05.802320 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4f2d4-1915-4033-a4da-500138f681b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:05.803815 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4f2d4-1915-4033-a4da-500138f681b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:05.804243 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4f2d4-1915-4033-a4da-500138f681b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:05.806247 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4f2d4-1915-4033-a4da-500138f681b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:05.902173 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5c8f2-1e4e-46a1-b2d9-0f7cad0a3823 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:05.927070 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da736f5a-2d13-4065-ba29-667f26454bc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc92c0a0a2cc4722868e6877bac93ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:05.928084 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da736f5a-2d13-4065-ba29-667f26454bc0 service nova] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:05.928370 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da736f5a-2d13-4065-ba29-667f26454bc0 service nova] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:05.930181 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da736f5a-2d13-4065-ba29-667f26454bc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:05.973600 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d4f2d4-1915-4033-a4da-500138f681b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:05.974463 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d4f2d4-1915-4033-a4da-500138f681b1 service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:05.997800 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 841/1706] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:52:05.998753 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4f2d4-1915-4033-a4da-500138f681b1 service neutron] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:06.021622 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4f2d4-1915-4033-a4da-500138f681b1 service neutron] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:06.037298 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da099159-8cca-419f-b59b-7172be23693f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:06.038855 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da099159-8cca-419f-b59b-7172be23693f admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:06.038855 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da099159-8cca-419f-b59b-7172be23693f admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:06.038855 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da099159-8cca-419f-b59b-7172be23693f admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:06.044333 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da099159-8cca-419f-b59b-7172be23693f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:06.044333 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da099159-8cca-419f-b59b-7172be23693f admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:06.063380 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 842/1707] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:06.066051 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da736f5a-2d13-4065-ba29-667f26454bc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:06.068324 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da736f5a-2d13-4065-ba29-667f26454bc0 service nova] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:06.069559 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da099159-8cca-419f-b59b-7172be23693f admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:06.101946 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 866/1708] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:05 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:52:06.111408 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da099159-8cca-419f-b59b-7172be23693f admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:06.116068 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ed267-9313-4ef2-9ef6-7c21a7600eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:06.116794 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ed267-9313-4ef2-9ef6-7c21a7600eef admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:06.117080 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ed267-9313-4ef2-9ef6-7c21a7600eef admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:06.117360 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ed267-9313-4ef2-9ef6-7c21a7600eef admin admin] PATH_INFO: `/v3/projects/ed40d94a6e1d4fde9df37bf0170f6ea5/users/4dfe4dad6c944c88a88b17271f447c22/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:06.132294 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3ed267-9313-4ef2-9ef6-7c21a7600eef admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed40d94a6e1d4fde9df37bf0170f6ea5, user_id=4dfe4dad6c944c88a88b17271f447c22, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:06.137695 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3ed267-9313-4ef2-9ef6-7c21a7600eef admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:06.168097 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 843/1709] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:52:06 2022] PUT /identity/v3/projects/ed40d94a6e1d4fde9df37bf0170f6ea5/users/4dfe4dad6c944c88a88b17271f447c22/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:06.179664 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f5737-fd48-4d7a-bd89-c765dbe0150b None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:06.180085 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f5737-fd48-4d7a-bd89-c765dbe0150b None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:06.180085 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f5737-fd48-4d7a-bd89-c765dbe0150b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:06.199958 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad168f-9ce4-4265-ac89-aba003d3f956 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:06.200315 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad168f-9ce4-4265-ac89-aba003d3f956 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:06.200598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad168f-9ce4-4265-ac89-aba003d3f956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:06.264243 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-672f5737-fd48-4d7a-bd89-c765dbe0150b None None] MFA Rules not processed for user `4dfe4dad6c944c88a88b17271f447c22`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:06.266179 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-672f5737-fd48-4d7a-bd89-c765dbe0150b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:06.294171 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-2aad168f-9ce4-4265-ac89-aba003d3f956 None None] MFA Rules not processed for user `c9de80eade38407c99f00c5acf45e2bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:06.297148 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-2aad168f-9ce4-4265-ac89-aba003d3f956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:06.490133 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 867/1710] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:06 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:06.503443 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 844/1711] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:52:06.517471 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96d333-b080-4d0b-a51d-1d11111bca62 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:06.517752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96d333-b080-4d0b-a51d-1d11111bca62 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:06.518026 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96d333-b080-4d0b-a51d-1d11111bca62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:06.556884 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad168f-9ce4-4265-ac89-aba003d3f956 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:06.558526 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-2aad168f-9ce4-4265-ac89-aba003d3f956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:06.562492 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-ef96d333-b080-4d0b-a51d-1d11111bca62 None None] MFA Rules not processed for user `c9de80eade38407c99f00c5acf45e2bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:06.564646 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-ef96d333-b080-4d0b-a51d-1d11111bca62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:06.599485 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 868/1712] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:06.612643 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96d333-b080-4d0b-a51d-1d11111bca62 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:06.620342 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-ef96d333-b080-4d0b-a51d-1d11111bca62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:06.738585 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad168f-9ce4-4265-ac89-aba003d3f956 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:06.750663 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a8e88-edd2-4cc6-9c74-3510d615a247 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:06.751580 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a8e88-edd2-4cc6-9c74-3510d615a247 service cinder] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:06.752038 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a8e88-edd2-4cc6-9c74-3510d615a247 service cinder] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:06.752583 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a8e88-edd2-4cc6-9c74-3510d615a247 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:06.778617 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a8e88-edd2-4cc6-9c74-3510d615a247 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:06.780687 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a8e88-edd2-4cc6-9c74-3510d615a247 service cinder] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:06.797524 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 845/1713] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:06 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 07:52:06.826137 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:52:06.847796 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca05c26-5621-4284-8364-ae9dd88055c3 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:06.848348 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca05c26-5621-4284-8364-ae9dd88055c3 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:06.848874 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca05c26-5621-4284-8364-ae9dd88055c3 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:06.852235 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 846/1714] 10.222.0.42 () {54 vars in 921 bytes} [Fri Aug 26 07:52:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:52:06.888008 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96d333-b080-4d0b-a51d-1d11111bca62 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:06.893044 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63aadc-6df4-41af-80df-8874f7420785 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc92c0a0a2cc4722868e6877bac93ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:06.893692 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63aadc-6df4-41af-80df-8874f7420785 service nova] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:06.894052 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63aadc-6df4-41af-80df-8874f7420785 service nova] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:06.894399 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63aadc-6df4-41af-80df-8874f7420785 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:06.906911 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c63aadc-6df4-41af-80df-8874f7420785 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:06.919512 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c63aadc-6df4-41af-80df-8874f7420785 service nova] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:06.943296 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 869/1715] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:06 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:52:07.095233 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b4b61-d51b-4c02-8fa7-f0a65c60185a None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:07.095604 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b4b61-d51b-4c02-8fa7-f0a65c60185a None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:07.095938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b4b61-d51b-4c02-8fa7-f0a65c60185a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:07.135032 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-e17b4b61-d51b-4c02-8fa7-f0a65c60185a None None] MFA Rules not processed for user `f6c2bc293f1b4daca83e8d6dff66a316`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:07.136233 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-e17b4b61-d51b-4c02-8fa7-f0a65c60185a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:07.288373 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 847/1716] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Aug 26 07:52:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:07.361683 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ac76f-6f1a-4535-a788-842d20bd81ed None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:07.362540 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ac76f-6f1a-4535-a788-842d20bd81ed None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:07.364115 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ac76f-6f1a-4535-a788-842d20bd81ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:07.382588 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b4b61-d51b-4c02-8fa7-f0a65c60185a None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:07.403256 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b4b61-d51b-4c02-8fa7-f0a65c60185a None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:07.412081 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:52:07.425666 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-a53ac76f-6f1a-4535-a788-842d20bd81ed None None] MFA Rules not processed for user `9b91e6d68e3e40388fe50436ddb22847`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:07.427535 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-a53ac76f-6f1a-4535-a788-842d20bd81ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:07.432528 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f4451-6253-4457-a873-4408965ae8e7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c2bc293f1b4daca83e8d6dff66a316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:07.433098 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f4451-6253-4457-a873-4408965ae8e7 service placement] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:07.433692 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f4451-6253-4457-a873-4408965ae8e7 service placement] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:07.433968 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f4451-6253-4457-a873-4408965ae8e7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:07.447374 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30f4451-6253-4457-a873-4408965ae8e7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:07.450411 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30f4451-6253-4457-a873-4408965ae8e7 service placement] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:07.489303 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 848/1717] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:52:07.490780 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f4451-6253-4457-a873-4408965ae8e7 service placement] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:07.493083 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-e30f4451-6253-4457-a873-4408965ae8e7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:07.564942 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 870/1718] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:07.586296 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a39733-c2fc-42dc-8bee-63a0e9ccac91 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:07.588015 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a39733-c2fc-42dc-8bee-63a0e9ccac91 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:07.588591 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a39733-c2fc-42dc-8bee-63a0e9ccac91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:07.597859 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f4451-6253-4457-a873-4408965ae8e7 service placement] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:07.603879 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d2ca7-bf12-4e55-844b-b3f6f4aeda11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:07.605959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d2ca7-bf12-4e55-844b-b3f6f4aeda11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:07.606421 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d2ca7-bf12-4e55-844b-b3f6f4aeda11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:07.606854 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d2ca7-bf12-4e55-844b-b3f6f4aeda11 admin admin] PATH_INFO: `/v3/users/c28994b4c95d49718fbd048baa67fe3c` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:07.609182 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d2ca7-bf12-4e55-844b-b3f6f4aeda11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c28994b4c95d49718fbd048baa67fe3c)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:07.612117 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d2ca7-bf12-4e55-844b-b3f6f4aeda11 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:07.622884 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-e1a39733-c2fc-42dc-8bee-63a0e9ccac91 None None] MFA Rules not processed for user `9b91e6d68e3e40388fe50436ddb22847`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:07.625491 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-e1a39733-c2fc-42dc-8bee-63a0e9ccac91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:07.652187 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 871/1719] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:07.660853 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a39733-c2fc-42dc-8bee-63a0e9ccac91 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:07.682013 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a39733-c2fc-42dc-8bee-63a0e9ccac91 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:07.694538 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4332484-b348-4fd3-a4af-450bf729aabc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc92c0a0a2cc4722868e6877bac93ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:07.695318 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4332484-b348-4fd3-a4af-450bf729aabc service nova] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:07.695662 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4332484-b348-4fd3-a4af-450bf729aabc service nova] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:07.701849 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4332484-b348-4fd3-a4af-450bf729aabc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:07.710687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4332484-b348-4fd3-a4af-450bf729aabc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:07.713894 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4332484-b348-4fd3-a4af-450bf729aabc service nova] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:07.737967 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 872/1720] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:52:07.934913 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-c89d2ca7-bf12-4e55-844b-b3f6f4aeda11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c28994b4c95d49718fbd048baa67fe3c'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:07.949784 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-c89d2ca7-bf12-4e55-844b-b3f6f4aeda11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c28994b4c95d49718fbd048baa67fe3c'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:08.038807 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-c89d2ca7-bf12-4e55-844b-b3f6f4aeda11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c28994b4c95d49718fbd048baa67fe3c'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:08.042300 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-c89d2ca7-bf12-4e55-844b-b3f6f4aeda11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c28994b4c95d49718fbd048baa67fe3c'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:08.097553 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b9b34-a5d0-4f67-8ee7-64b58ea75a3e None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:08.097919 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b9b34-a5d0-4f67-8ee7-64b58ea75a3e None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:08.098627 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b9b34-a5d0-4f67-8ee7-64b58ea75a3e None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:08.100041 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 873/1721] 10.222.0.42 () {54 vars in 912 bytes} [Fri Aug 26 07:52:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 07:52:08.117483 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-c89d2ca7-bf12-4e55-844b-b3f6f4aeda11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c28994b4c95d49718fbd048baa67fe3c'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:08.127608 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a499416-cf62-4619-974d-1317e902c560 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:08.128129 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a499416-cf62-4619-974d-1317e902c560 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:08.128761 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a499416-cf62-4619-974d-1317e902c560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:08.154871 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 849/1722] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:52:07 2022] DELETE /identity/v3/users/c28994b4c95d49718fbd048baa67fe3c => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:08.194520 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-0a499416-cf62-4619-974d-1317e902c560 None None] MFA Rules not processed for user `a5ea9916c82647f3a645f1a4258f558b`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:08.196151 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-0a499416-cf62-4619-974d-1317e902c560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:08.263908 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 874/1723] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Aug 26 07:52:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:08.340286 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d2ca7-bf12-4e55-844b-b3f6f4aeda11 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:08.349815 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-c89d2ca7-bf12-4e55-844b-b3f6f4aeda11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:08.428307 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d2ca7-bf12-4e55-844b-b3f6f4aeda11 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:08.511552 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce7d32-cc8f-4bce-9b7b-e95d3a9b9bd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:08.511552 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce7d32-cc8f-4bce-9b7b-e95d3a9b9bd3 service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:08.511552 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce7d32-cc8f-4bce-9b7b-e95d3a9b9bd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:08.511552 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce7d32-cc8f-4bce-9b7b-e95d3a9b9bd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:08.523417 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce7d32-cc8f-4bce-9b7b-e95d3a9b9bd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:08.527354 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce7d32-cc8f-4bce-9b7b-e95d3a9b9bd3 service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:08.549139 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 850/1724] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:52:08.632508 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c48ad-ea1b-45ea-93d9-ed532afa9349 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:08.633078 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c48ad-ea1b-45ea-93d9-ed532afa9349 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:08.633078 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c48ad-ea1b-45ea-93d9-ed532afa9349 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:08.634693 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 875/1725] 10.222.0.42 () {54 vars in 912 bytes} [Fri Aug 26 07:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:52:08.640863 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:52:08.641822 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833ae48-bc71-4b70-b733-4866b530cc5f None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:08.642307 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833ae48-bc71-4b70-b733-4866b530cc5f None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:08.642387 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833ae48-bc71-4b70-b733-4866b530cc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:08.888299 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-0833ae48-bc71-4b70-b733-4866b530cc5f None None] MFA Rules not processed for user `a5ea9916c82647f3a645f1a4258f558b`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:08.888299 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-0833ae48-bc71-4b70-b733-4866b530cc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:08.888299 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 851/1726] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Aug 26 07:52:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:08.889700 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c48ad-ea1b-45ea-93d9-ed532afa9349 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:08.889700 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-8f8c48ad-ea1b-45ea-93d9-ed532afa9349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:08.889700 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c48ad-ea1b-45ea-93d9-ed532afa9349 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:08.892957 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ba048-fc2f-40a4-8496-189581c7d2f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:08.892957 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ba048-fc2f-40a4-8496-189581c7d2f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:08.892957 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ba048-fc2f-40a4-8496-189581c7d2f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:08.892957 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ba048-fc2f-40a4-8496-189581c7d2f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:08.893753 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ba048-fc2f-40a4-8496-189581c7d2f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:08.893753 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ba048-fc2f-40a4-8496-189581c7d2f2 service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:08.893753 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 876/1727] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:52:08.994022 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833ae48-bc71-4b70-b733-4866b530cc5f None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:08.995612 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-0833ae48-bc71-4b70-b733-4866b530cc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:09.070560 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833ae48-bc71-4b70-b733-4866b530cc5f None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:09.076103 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a691d4-8fd6-47bf-ba65-b1daac3e889b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:09.077626 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a691d4-8fd6-47bf-ba65-b1daac3e889b service cinder] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:09.078218 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a691d4-8fd6-47bf-ba65-b1daac3e889b service cinder] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:09.078500 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a691d4-8fd6-47bf-ba65-b1daac3e889b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:09.082058 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-c3a691d4-8fd6-47bf-ba65-b1daac3e889b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:09.120355 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ba048-fc2f-40a4-8496-189581c7d2f2 service neutron] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:09.122232 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-d69ba048-fc2f-40a4-8496-189581c7d2f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:09.217565 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a691d4-8fd6-47bf-ba65-b1daac3e889b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:09.219400 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a691d4-8fd6-47bf-ba65-b1daac3e889b service cinder] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:09.240313 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 852/1728] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:52:09.241224 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a691d4-8fd6-47bf-ba65-b1daac3e889b service cinder] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:09.245420 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-c3a691d4-8fd6-47bf-ba65-b1daac3e889b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:09.424076 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ba048-fc2f-40a4-8496-189581c7d2f2 service neutron] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:09.448439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab6e74-7564-44dd-99da-f5f6de8f15e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:09.450363 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a691d4-8fd6-47bf-ba65-b1daac3e889b service cinder] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:09.451464 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab6e74-7564-44dd-99da-f5f6de8f15e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:09.457366 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab6e74-7564-44dd-99da-f5f6de8f15e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:09.458541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab6e74-7564-44dd-99da-f5f6de8f15e4 admin admin] PATH_INFO: `/v3/projects/da27193d2e5f468b9698b74988b37481` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:09.463125 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab6e74-7564-44dd-99da-f5f6de8f15e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da27193d2e5f468b9698b74988b37481)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:09.467920 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab6e74-7564-44dd-99da-f5f6de8f15e4 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:09.474809 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44736e52-44ed-4b70-b715-2f95d806f9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:09.475504 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44736e52-44ed-4b70-b715-2f95d806f9c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:09.475791 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44736e52-44ed-4b70-b715-2f95d806f9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:09.476064 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44736e52-44ed-4b70-b715-2f95d806f9c2 admin admin] PATH_INFO: `/v3/projects/a187eaa1bbe44bfbae3640994b76e5dc` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:09.479618 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44736e52-44ed-4b70-b715-2f95d806f9c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a187eaa1bbe44bfbae3640994b76e5dc)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:09.487546 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44736e52-44ed-4b70-b715-2f95d806f9c2 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:09.724978 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-44736e52-44ed-4b70-b715-2f95d806f9c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a187eaa1bbe44bfbae3640994b76e5dc', 'request_id': 'req-44736e52-44ed-4b70-b715-2f95d806f9c2'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:09.736153 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-44736e52-44ed-4b70-b715-2f95d806f9c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a187eaa1bbe44bfbae3640994b76e5dc', 'request_id': 'req-44736e52-44ed-4b70-b715-2f95d806f9c2'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:09.774536 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-86ab6e74-7564-44dd-99da-f5f6de8f15e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da27193d2e5f468b9698b74988b37481', 'request_id': 'req-86ab6e74-7564-44dd-99da-f5f6de8f15e4'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:09.794634 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-86ab6e74-7564-44dd-99da-f5f6de8f15e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da27193d2e5f468b9698b74988b37481', 'request_id': 'req-86ab6e74-7564-44dd-99da-f5f6de8f15e4'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:09.810581 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-86ab6e74-7564-44dd-99da-f5f6de8f15e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da27193d2e5f468b9698b74988b37481', 'request_id': 'req-86ab6e74-7564-44dd-99da-f5f6de8f15e4'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:09.840814 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-44736e52-44ed-4b70-b715-2f95d806f9c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a187eaa1bbe44bfbae3640994b76e5dc', 'request_id': 'req-44736e52-44ed-4b70-b715-2f95d806f9c2'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:09.862693 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-44736e52-44ed-4b70-b715-2f95d806f9c2 admin admin] The token cache is being invalidate because project a187eaa1bbe44bfbae3640994b76e5dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:52:09.863371 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-44736e52-44ed-4b70-b715-2f95d806f9c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:09.864725 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-44736e52-44ed-4b70-b715-2f95d806f9c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:09.866848 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 853/1729] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:52:09 2022] DELETE /identity/v3/projects/a187eaa1bbe44bfbae3640994b76e5dc => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:09.868018 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44736e52-44ed-4b70-b715-2f95d806f9c2 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:09.869606 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-44736e52-44ed-4b70-b715-2f95d806f9c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:09.986526 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-86ab6e74-7564-44dd-99da-f5f6de8f15e4 admin admin] The token cache is being invalidate because project da27193d2e5f468b9698b74988b37481 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:52:09.987017 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-86ab6e74-7564-44dd-99da-f5f6de8f15e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:09.991085 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-86ab6e74-7564-44dd-99da-f5f6de8f15e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:10.011925 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 877/1730] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:52:09 2022] DELETE /identity/v3/projects/da27193d2e5f468b9698b74988b37481 => generated 0 bytes in 891 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:52:10.017392 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a699df-84a5-45fc-80a2-54634bb68943 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:10.017392 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a699df-84a5-45fc-80a2-54634bb68943 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:10.017392 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a699df-84a5-45fc-80a2-54634bb68943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:10.060493 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44736e52-44ed-4b70-b715-2f95d806f9c2 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:10.104830 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-f1a699df-84a5-45fc-80a2-54634bb68943 None None] MFA Rules not processed for user `c9de80eade38407c99f00c5acf45e2bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:10.106209 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-f1a699df-84a5-45fc-80a2-54634bb68943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:10.162832 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c9258-b06a-4322-98f4-2519b5b94401 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c2bc293f1b4daca83e8d6dff66a316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:10.163580 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c9258-b06a-4322-98f4-2519b5b94401 service placement] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:10.171578 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c9258-b06a-4322-98f4-2519b5b94401 service placement] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:10.171578 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c9258-b06a-4322-98f4-2519b5b94401 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:10.171578 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-6e2c9258-b06a-4322-98f4-2519b5b94401 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:10.184294 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2c9258-b06a-4322-98f4-2519b5b94401 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:10.189792 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2c9258-b06a-4322-98f4-2519b5b94401 service placement] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:10.208848 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 854/1731] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:52:10.210418 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cd813-794f-42d9-8321-9620685b9f69 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:10.211009 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cd813-794f-42d9-8321-9620685b9f69 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:10.211395 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cd813-794f-42d9-8321-9620685b9f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:10.237417 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-dd1cd813-794f-42d9-8321-9620685b9f69 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:10.243635 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-dd1cd813-794f-42d9-8321-9620685b9f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:10.248751 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 878/1732] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:10 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:10.250570 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a699df-84a5-45fc-80a2-54634bb68943 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:10.268283 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-f1a699df-84a5-45fc-80a2-54634bb68943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:10.390647 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 855/1733] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:10.390647 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5514e-9d10-41d6-be60-6499f33a7ace None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:10.390647 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5514e-9d10-41d6-be60-6499f33a7ace None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:10.390647 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5514e-9d10-41d6-be60-6499f33a7ace None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:10.393255 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 856/1734] 10.222.0.42 () {54 vars in 961 bytes} [Fri Aug 26 07:52:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:52:10.415652 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1f7ec-986d-47d3-9685-7fb2ab5cd5d4 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:10.415942 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1f7ec-986d-47d3-9685-7fb2ab5cd5d4 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:10.416224 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1f7ec-986d-47d3-9685-7fb2ab5cd5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:10.471081 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-44e1f7ec-986d-47d3-9685-7fb2ab5cd5d4 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:10.475517 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-44e1f7ec-986d-47d3-9685-7fb2ab5cd5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:10.497628 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 857/1735] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:10.501203 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a625b-57f2-4615-86ce-11dc52f435ad None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:10.503012 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a625b-57f2-4615-86ce-11dc52f435ad None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:10.503320 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a625b-57f2-4615-86ce-11dc52f435ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:10.507012 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a699df-84a5-45fc-80a2-54634bb68943 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:10.519766 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646fbc9-d4eb-4ed6-ab9f-5f33cff1f377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:10.520680 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646fbc9-d4eb-4ed6-ab9f-5f33cff1f377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:10.521111 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646fbc9-d4eb-4ed6-ab9f-5f33cff1f377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:10.521565 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646fbc9-d4eb-4ed6-ab9f-5f33cff1f377 admin admin] PATH_INFO: `/v3/users/8fa436639cfb4834bbaa338e8da712c2` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:10.529674 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f646fbc9-d4eb-4ed6-ab9f-5f33cff1f377 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fa436639cfb4834bbaa338e8da712c2)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:10.529674 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: WARNING py.warnings [None req-f646fbc9-d4eb-4ed6-ab9f-5f33cff1f377 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 07:52:10.529674 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: warnings.warn(msg) Aug 26 07:52:10.529674 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: Aug 26 07:52:10.536183 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f646fbc9-d4eb-4ed6-ab9f-5f33cff1f377 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:10.541279 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-bd4a625b-57f2-4615-86ce-11dc52f435ad None None] MFA Rules not processed for user `f6c2bc293f1b4daca83e8d6dff66a316`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:10.544472 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-bd4a625b-57f2-4615-86ce-11dc52f435ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:10.567434 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 858/1736] 10.222.0.42 () {58 vars in 1058 bytes} [Fri Aug 26 07:52:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:10.569099 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a625b-57f2-4615-86ce-11dc52f435ad None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:10.617898 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a625b-57f2-4615-86ce-11dc52f435ad None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:10.625184 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaeb862-30af-4b0b-9c67-0f2ef6a4d88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:10.626175 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaeb862-30af-4b0b-9c67-0f2ef6a4d88e admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:10.626772 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaeb862-30af-4b0b-9c67-0f2ef6a4d88e admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:10.630536 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaeb862-30af-4b0b-9c67-0f2ef6a4d88e admin admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:10.633565 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaeb862-30af-4b0b-9c67-0f2ef6a4d88e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:52:10.634054 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaeb862-30af-4b0b-9c67-0f2ef6a4d88e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:10.635944 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaeb862-30af-4b0b-9c67-0f2ef6a4d88e admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:10.668915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 859/1737] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:52:10.668915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaeb862-30af-4b0b-9c67-0f2ef6a4d88e admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:10.691188 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaeb862-30af-4b0b-9c67-0f2ef6a4d88e admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:10.698816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b81a4-9ce6-4868-9059-c124447fe25a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c2bc293f1b4daca83e8d6dff66a316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:10.702633 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b81a4-9ce6-4868-9059-c124447fe25a service placement] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:10.702633 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b81a4-9ce6-4868-9059-c124447fe25a service placement] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:10.702633 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b81a4-9ce6-4868-9059-c124447fe25a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:10.711219 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b81a4-9ce6-4868-9059-c124447fe25a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:10.714195 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b81a4-9ce6-4868-9059-c124447fe25a service placement] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:10.732051 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 860/1738] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:52:10.732940 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b81a4-9ce6-4868-9059-c124447fe25a service placement] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:10.744480 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b81a4-9ce6-4868-9059-c124447fe25a service placement] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:10.750654 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032f3e1-d5cf-4dc7-81d3-78d3da8bef86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:10.751580 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032f3e1-d5cf-4dc7-81d3-78d3da8bef86 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:10.752156 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032f3e1-d5cf-4dc7-81d3-78d3da8bef86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:10.752606 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032f3e1-d5cf-4dc7-81d3-78d3da8bef86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:10.753401 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b032f3e1-d5cf-4dc7-81d3-78d3da8bef86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:10.757411 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b032f3e1-d5cf-4dc7-81d3-78d3da8bef86 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:10.918676 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 861/1739] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:52:10 2022] POST /identity/v3/projects => generated 375 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:10.924952 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032f3e1-d5cf-4dc7-81d3-78d3da8bef86 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:10.957419 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-f646fbc9-d4eb-4ed6-ab9f-5f33cff1f377 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fa436639cfb4834bbaa338e8da712c2'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:11.001522 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-f646fbc9-d4eb-4ed6-ab9f-5f33cff1f377 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fa436639cfb4834bbaa338e8da712c2'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:11.105805 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032f3e1-d5cf-4dc7-81d3-78d3da8bef86 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:11.111390 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924824c-e911-41bb-87e4-f87af98fa00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:11.111808 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924824c-e911-41bb-87e4-f87af98fa00a admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:11.112082 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924824c-e911-41bb-87e4-f87af98fa00a admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:11.112356 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924824c-e911-41bb-87e4-f87af98fa00a admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:11.117526 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924824c-e911-41bb-87e4-f87af98fa00a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:11.118832 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924824c-e911-41bb-87e4-f87af98fa00a admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:11.275612 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-f646fbc9-d4eb-4ed6-ab9f-5f33cff1f377 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fa436639cfb4834bbaa338e8da712c2'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:11.277032 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-f646fbc9-d4eb-4ed6-ab9f-5f33cff1f377 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fa436639cfb4834bbaa338e8da712c2'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:11.291255 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 862/1740] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:52:10 2022] POST /identity/v3/users => generated 288 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:11.294193 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924824c-e911-41bb-87e4-f87af98fa00a admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:11.298434 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-7924824c-e911-41bb-87e4-f87af98fa00a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:11.352742 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-f646fbc9-d4eb-4ed6-ab9f-5f33cff1f377 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fa436639cfb4834bbaa338e8da712c2'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:11.353991 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924824c-e911-41bb-87e4-f87af98fa00a admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:11.366805 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b57869d-56d7-4197-8a2a-b3064be050d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:11.367864 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57869d-56d7-4197-8a2a-b3064be050d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:11.369200 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 879/1741] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:52:10 2022] DELETE /identity/v3/users/8fa436639cfb4834bbaa338e8da712c2 => generated 0 bytes in 1120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:11.369718 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57869d-56d7-4197-8a2a-b3064be050d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:11.370005 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57869d-56d7-4197-8a2a-b3064be050d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:11.370765 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b57869d-56d7-4197-8a2a-b3064be050d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:11.372437 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b57869d-56d7-4197-8a2a-b3064be050d6 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:11.411075 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 863/1742] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:11.412205 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646fbc9-d4eb-4ed6-ab9f-5f33cff1f377 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:11.587449 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646fbc9-d4eb-4ed6-ab9f-5f33cff1f377 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:11.619525 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd7b2f-a991-49ce-949f-4cd4bef67f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:11.626384 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd7b2f-a991-49ce-949f-4cd4bef67f15 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:11.626884 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd7b2f-a991-49ce-949f-4cd4bef67f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:11.627409 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd7b2f-a991-49ce-949f-4cd4bef67f15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:11.628526 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd7b2f-a991-49ce-949f-4cd4bef67f15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:11.639262 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd7b2f-a991-49ce-949f-4cd4bef67f15 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:11.688695 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 880/1743] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:11.692102 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b57869d-56d7-4197-8a2a-b3064be050d6 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:11.708570 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b57869d-56d7-4197-8a2a-b3064be050d6 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:11.716684 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753f8a9-625b-4193-baa7-afd1745a2d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:11.719153 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753f8a9-625b-4193-baa7-afd1745a2d5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:11.719473 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753f8a9-625b-4193-baa7-afd1745a2d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:11.719990 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753f8a9-625b-4193-baa7-afd1745a2d5f admin admin] PATH_INFO: `/v3/projects/3b1412449ade4c638cd8057d3189e2b4/users/ff5c23f4883742a385f85b0821facc89/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:11.748553 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753f8a9-625b-4193-baa7-afd1745a2d5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b1412449ade4c638cd8057d3189e2b4, user_id=ff5c23f4883742a385f85b0821facc89, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:11.758892 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753f8a9-625b-4193-baa7-afd1745a2d5f admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:11.834584 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:52:11.879867 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd7b2f-a991-49ce-949f-4cd4bef67f15 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:11.886628 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-95cd7b2f-a991-49ce-949f-4cd4bef67f15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:11.900437 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 864/1744] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:52:11 2022] PUT /identity/v3/projects/3b1412449ade4c638cd8057d3189e2b4/users/ff5c23f4883742a385f85b0821facc89/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:52:11.914163 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd7b2f-a991-49ce-949f-4cd4bef67f15 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:11.916832 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613aa70-6341-48f9-b0a4-4d5969baa2f2 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:11.917558 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613aa70-6341-48f9-b0a4-4d5969baa2f2 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:11.917558 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613aa70-6341-48f9-b0a4-4d5969baa2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:12.076847 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-6613aa70-6341-48f9-b0a4-4d5969baa2f2 None None] MFA Rules not processed for user `ff5c23f4883742a385f85b0821facc89`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:12.079202 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-6613aa70-6341-48f9-b0a4-4d5969baa2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:12.107138 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662660ee-a677-4c4b-adc2-1d75543f4c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:12.107993 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662660ee-a677-4c4b-adc2-1d75543f4c82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:12.108165 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662660ee-a677-4c4b-adc2-1d75543f4c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:12.108862 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662660ee-a677-4c4b-adc2-1d75543f4c82 admin admin] PATH_INFO: `/v3/projects/d4ca016531224fe1be9e608de914da96` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:12.129619 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662660ee-a677-4c4b-adc2-1d75543f4c82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4ca016531224fe1be9e608de914da96)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:12.131856 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662660ee-a677-4c4b-adc2-1d75543f4c82 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:12.266788 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:52:12.468691 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 865/1745] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 552 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:12.478257 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613aa70-6341-48f9-b0a4-4d5969baa2f2 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:12.481061 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-6613aa70-6341-48f9-b0a4-4d5969baa2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:12.482069 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-662660ee-a677-4c4b-adc2-1d75543f4c82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4ca016531224fe1be9e608de914da96', 'request_id': 'req-662660ee-a677-4c4b-adc2-1d75543f4c82'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:12.504998 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-662660ee-a677-4c4b-adc2-1d75543f4c82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4ca016531224fe1be9e608de914da96', 'request_id': 'req-662660ee-a677-4c4b-adc2-1d75543f4c82'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:12.556316 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-662660ee-a677-4c4b-adc2-1d75543f4c82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4ca016531224fe1be9e608de914da96', 'request_id': 'req-662660ee-a677-4c4b-adc2-1d75543f4c82'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:12.702845 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613aa70-6341-48f9-b0a4-4d5969baa2f2 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:12.718439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-662660ee-a677-4c4b-adc2-1d75543f4c82 admin admin] The token cache is being invalidate because project d4ca016531224fe1be9e608de914da96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:52:12.719351 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-662660ee-a677-4c4b-adc2-1d75543f4c82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:12.730827 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-662660ee-a677-4c4b-adc2-1d75543f4c82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:12.739886 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 881/1746] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:52:11 2022] DELETE /identity/v3/projects/d4ca016531224fe1be9e608de914da96 => generated 0 bytes in 856 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:52:12.742473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13eb9c-1cea-45f0-a7ea-18cd0d55b2b7 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:12.742974 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13eb9c-1cea-45f0-a7ea-18cd0d55b2b7 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:12.743524 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13eb9c-1cea-45f0-a7ea-18cd0d55b2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:12.769789 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-ed13eb9c-1cea-45f0-a7ea-18cd0d55b2b7 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:12.771823 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-ed13eb9c-1cea-45f0-a7ea-18cd0d55b2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:12.919776 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b803f6-3ec6-48cd-ab08-7a0aed419f97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc92c0a0a2cc4722868e6877bac93ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:12.922014 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b803f6-3ec6-48cd-ab08-7a0aed419f97 service nova] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:12.922684 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b803f6-3ec6-48cd-ab08-7a0aed419f97 service nova] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:12.945791 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 882/1747] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:12.948520 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497fbd7-2ea4-4090-844f-85763aa17b05 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:12.949009 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497fbd7-2ea4-4090-844f-85763aa17b05 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:12.949366 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497fbd7-2ea4-4090-844f-85763aa17b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:12.954826 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b803f6-3ec6-48cd-ab08-7a0aed419f97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:12.969800 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-95b803f6-3ec6-48cd-ab08-7a0aed419f97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:12.992766 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-8497fbd7-2ea4-4090-844f-85763aa17b05 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:12.994442 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-8497fbd7-2ea4-4090-844f-85763aa17b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:13.019464 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 883/1748] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:13.020744 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497fbd7-2ea4-4090-844f-85763aa17b05 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:13.045106 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497fbd7-2ea4-4090-844f-85763aa17b05 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:13.059359 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed274704-eff9-4b01-9c4b-37c4a54e520f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:13.060309 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed274704-eff9-4b01-9c4b-37c4a54e520f admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:13.062134 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed274704-eff9-4b01-9c4b-37c4a54e520f admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:13.062765 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed274704-eff9-4b01-9c4b-37c4a54e520f admin admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:13.077409 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed274704-eff9-4b01-9c4b-37c4a54e520f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:52:13.079667 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed274704-eff9-4b01-9c4b-37c4a54e520f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:13.095607 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed274704-eff9-4b01-9c4b-37c4a54e520f admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:13.132610 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 884/1749] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:52:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:52:13.133662 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed274704-eff9-4b01-9c4b-37c4a54e520f admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:13.146825 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed274704-eff9-4b01-9c4b-37c4a54e520f admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:13.166865 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a40bd7-4bdc-4630-b71e-07e248725dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:13.167526 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a40bd7-4bdc-4630-b71e-07e248725dbe admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:13.167938 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a40bd7-4bdc-4630-b71e-07e248725dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:13.172586 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a40bd7-4bdc-4630-b71e-07e248725dbe admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:13.177731 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a40bd7-4bdc-4630-b71e-07e248725dbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:13.179830 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a40bd7-4bdc-4630-b71e-07e248725dbe admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:13.244433 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b803f6-3ec6-48cd-ab08-7a0aed419f97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:13.247809 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b803f6-3ec6-48cd-ab08-7a0aed419f97 service nova] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:13.277902 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 866/1750] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 800 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:52:13.381172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b803f6-3ec6-48cd-ab08-7a0aed419f97 service nova] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:13.383007 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 885/1751] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:52:13 2022] POST /identity/v3/projects => generated 367 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:13.403992 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b803f6-3ec6-48cd-ab08-7a0aed419f97 service nova] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:13.577677 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215f822-a250-4b4c-80b7-8cc6eea5581b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:13.577677 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215f822-a250-4b4c-80b7-8cc6eea5581b admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:13.577677 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215f822-a250-4b4c-80b7-8cc6eea5581b admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:13.577677 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215f822-a250-4b4c-80b7-8cc6eea5581b admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:13.577978 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6215f822-a250-4b4c-80b7-8cc6eea5581b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:13.577978 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6215f822-a250-4b4c-80b7-8cc6eea5581b admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:13.695125 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 867/1752] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:52:13 2022] POST /identity/v3/users => generated 284 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 07:52:13.697308 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a40bd7-4bdc-4630-b71e-07e248725dbe admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:13.733669 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a40bd7-4bdc-4630-b71e-07e248725dbe admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:13.751710 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b204fe6-9770-4d83-bb2c-02077bc2d3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:13.753043 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b204fe6-9770-4d83-bb2c-02077bc2d3e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:13.753576 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b204fe6-9770-4d83-bb2c-02077bc2d3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:13.754000 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b204fe6-9770-4d83-bb2c-02077bc2d3e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:13.755421 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b204fe6-9770-4d83-bb2c-02077bc2d3e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:13.757254 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b204fe6-9770-4d83-bb2c-02077bc2d3e4 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:13.802365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 886/1753] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:13.809580 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215f822-a250-4b4c-80b7-8cc6eea5581b admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:13.831848 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215f822-a250-4b4c-80b7-8cc6eea5581b admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:13.853918 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb5375-ce95-4122-be83-7f6a923dd76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:13.855155 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb5375-ce95-4122-be83-7f6a923dd76d admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:13.855671 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb5375-ce95-4122-be83-7f6a923dd76d admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:13.856135 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb5375-ce95-4122-be83-7f6a923dd76d admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:13.856838 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb5375-ce95-4122-be83-7f6a923dd76d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:13.859169 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb5375-ce95-4122-be83-7f6a923dd76d admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:13.871303 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 868/1754] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:13.878330 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b204fe6-9770-4d83-bb2c-02077bc2d3e4 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:13.897600 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b204fe6-9770-4d83-bb2c-02077bc2d3e4 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:13.909300 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb5375-ce95-4122-be83-7f6a923dd76d admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:13.911295 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f06f9-9a4a-46f2-bda2-1ff04a79b9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:13.912013 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f06f9-9a4a-46f2-bda2-1ff04a79b9a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:13.912116 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-2abb5375-ce95-4122-be83-7f6a923dd76d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:13.912355 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f06f9-9a4a-46f2-bda2-1ff04a79b9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:13.912780 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f06f9-9a4a-46f2-bda2-1ff04a79b9a2 admin admin] PATH_INFO: `/v3/projects/26bcce9053bd468f92688141d5bae6be/users/18471711c3074387a8aeafa89e1ca465/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:13.933819 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2f06f9-9a4a-46f2-bda2-1ff04a79b9a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26bcce9053bd468f92688141d5bae6be, user_id=18471711c3074387a8aeafa89e1ca465, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:13.937834 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2f06f9-9a4a-46f2-bda2-1ff04a79b9a2 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:13.939347 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb5375-ce95-4122-be83-7f6a923dd76d admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:13.972374 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779d59f-867a-451d-bc60-3bb3ed6e447e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:13.973031 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779d59f-867a-451d-bc60-3bb3ed6e447e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:13.973451 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779d59f-867a-451d-bc60-3bb3ed6e447e admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:13.973732 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779d59f-867a-451d-bc60-3bb3ed6e447e admin admin] PATH_INFO: `/v3/users/ff5c23f4883742a385f85b0821facc89` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:13.976747 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779d59f-867a-451d-bc60-3bb3ed6e447e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff5c23f4883742a385f85b0821facc89)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:13.978786 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779d59f-867a-451d-bc60-3bb3ed6e447e admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:14.045293 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 887/1755] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:52:13 2022] PUT /identity/v3/projects/26bcce9053bd468f92688141d5bae6be/users/18471711c3074387a8aeafa89e1ca465/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:14.057992 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93b566-afe0-49b0-8c28-f50faa4bc708 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:14.058116 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93b566-afe0-49b0-8c28-f50faa4bc708 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:14.058387 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93b566-afe0-49b0-8c28-f50faa4bc708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:14.096659 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-ab93b566-afe0-49b0-8c28-f50faa4bc708 None None] MFA Rules not processed for user `18471711c3074387a8aeafa89e1ca465`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:14.098401 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-ab93b566-afe0-49b0-8c28-f50faa4bc708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:14.211091 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 888/1756] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:14.213056 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab93b566-afe0-49b0-8c28-f50faa4bc708 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:14.325715 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-9779d59f-867a-451d-bc60-3bb3ed6e447e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff5c23f4883742a385f85b0821facc89'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:14.326494 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-9779d59f-867a-451d-bc60-3bb3ed6e447e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff5c23f4883742a385f85b0821facc89'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:14.331881 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab93b566-afe0-49b0-8c28-f50faa4bc708 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:14.343337 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e195fe1-0f08-4c05-af71-a0f76950ca3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:14.345110 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e195fe1-0f08-4c05-af71-a0f76950ca3a admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:14.345557 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e195fe1-0f08-4c05-af71-a0f76950ca3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:14.345972 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e195fe1-0f08-4c05-af71-a0f76950ca3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:14.346765 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e195fe1-0f08-4c05-af71-a0f76950ca3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:14.349553 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e195fe1-0f08-4c05-af71-a0f76950ca3a admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:14.385508 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:52:14.480322 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-9779d59f-867a-451d-bc60-3bb3ed6e447e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff5c23f4883742a385f85b0821facc89'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:14.481239 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-9779d59f-867a-451d-bc60-3bb3ed6e447e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff5c23f4883742a385f85b0821facc89'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:14.493733 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 889/1757] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:52:14 2022] POST /identity/v3/projects => generated 369 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:14.495545 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8ac50-ddac-422b-9894-b80bbd42e70e None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:14.495751 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8ac50-ddac-422b-9894-b80bbd42e70e None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:14.495995 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8ac50-ddac-422b-9894-b80bbd42e70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:14.496808 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-9779d59f-867a-451d-bc60-3bb3ed6e447e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff5c23f4883742a385f85b0821facc89'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:14.532552 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-05c8ac50-ddac-422b-9894-b80bbd42e70e None None] MFA Rules not processed for user `cc96be5baacf490bad43962fa4a24e4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:14.538442 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-05c8ac50-ddac-422b-9894-b80bbd42e70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:14.555860 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 869/1758] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:52:13 2022] DELETE /identity/v3/users/ff5c23f4883742a385f85b0821facc89 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:52:14.557020 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779d59f-867a-451d-bc60-3bb3ed6e447e admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:14.559768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-9779d59f-867a-451d-bc60-3bb3ed6e447e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:14.673598 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 890/1759] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:14 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:14.675220 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f61d1-381c-49c4-84ad-4f7682d67215 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:14.675775 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f61d1-381c-49c4-84ad-4f7682d67215 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:14.676516 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f61d1-381c-49c4-84ad-4f7682d67215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:14.701845 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779d59f-867a-451d-bc60-3bb3ed6e447e admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:14.708315 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa6234-6440-4759-bd9c-d13107925bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:14.709103 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa6234-6440-4759-bd9c-d13107925bf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:14.709452 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa6234-6440-4759-bd9c-d13107925bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:14.709825 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa6234-6440-4759-bd9c-d13107925bf1 admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:14.710534 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa6234-6440-4759-bd9c-d13107925bf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:14.712614 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa6234-6440-4759-bd9c-d13107925bf1 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:14.712918 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-467f61d1-381c-49c4-84ad-4f7682d67215 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:14.715402 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-467f61d1-381c-49c4-84ad-4f7682d67215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:14.779390 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 891/1760] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:14.790620 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f61d1-381c-49c4-84ad-4f7682d67215 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:14.798840 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-467f61d1-381c-49c4-84ad-4f7682d67215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:14.856404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 870/1761] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:52:14 2022] POST /identity/v3/users => generated 291 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:14.857743 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa6234-6440-4759-bd9c-d13107925bf1 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:14.895976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa6234-6440-4759-bd9c-d13107925bf1 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:14.908867 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387ddb3-d978-4a99-998c-4db516b5b986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:14.909667 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387ddb3-d978-4a99-998c-4db516b5b986 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:14.910530 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387ddb3-d978-4a99-998c-4db516b5b986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:14.919318 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f61d1-381c-49c4-84ad-4f7682d67215 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:14.927921 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50bf5e-1d59-49a0-b32e-9d446f11457f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:14.928984 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50bf5e-1d59-49a0-b32e-9d446f11457f service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:14.929451 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50bf5e-1d59-49a0-b32e-9d446f11457f service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:14.929796 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50bf5e-1d59-49a0-b32e-9d446f11457f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:14.931070 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387ddb3-d978-4a99-998c-4db516b5b986 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:14.932134 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9387ddb3-d978-4a99-998c-4db516b5b986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:14.934692 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9387ddb3-d978-4a99-998c-4db516b5b986 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:14.960280 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 871/1762] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:14.967964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d50bf5e-1d59-49a0-b32e-9d446f11457f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:14.971972 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d50bf5e-1d59-49a0-b32e-9d446f11457f service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:14.973109 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387ddb3-d978-4a99-998c-4db516b5b986 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:14.991706 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387ddb3-d978-4a99-998c-4db516b5b986 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:15.009713 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 892/1763] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:52:15.023680 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59971c6-63d6-49d8-875c-3b423bbcdcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:15.024372 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59971c6-63d6-49d8-875c-3b423bbcdcb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:15.031543 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59971c6-63d6-49d8-875c-3b423bbcdcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:15.032762 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59971c6-63d6-49d8-875c-3b423bbcdcb4 admin admin] PATH_INFO: `/v3/projects/40c5506648b34b8ab1e7cfa7850adb8b/users/4e46d8fa45d847c9a875cb998f82ae7f/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:15.068957 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59971c6-63d6-49d8-875c-3b423bbcdcb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40c5506648b34b8ab1e7cfa7850adb8b, user_id=4e46d8fa45d847c9a875cb998f82ae7f, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:15.072269 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59971c6-63d6-49d8-875c-3b423bbcdcb4 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:15.189160 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 872/1764] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:52:14 2022] PUT /identity/v3/projects/40c5506648b34b8ab1e7cfa7850adb8b/users/4e46d8fa45d847c9a875cb998f82ae7f/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:15.193224 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50bf5e-1d59-49a0-b32e-9d446f11457f service neutron] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:15.206621 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50bf5e-1d59-49a0-b32e-9d446f11457f service neutron] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:15.455412 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f66b1-5bee-4150-a584-ac1489481289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:15.456364 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f66b1-5bee-4150-a584-ac1489481289 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:15.456590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f66b1-5bee-4150-a584-ac1489481289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:15.457205 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f66b1-5bee-4150-a584-ac1489481289 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:15.457909 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f66b1-5bee-4150-a584-ac1489481289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:15.460295 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f66b1-5bee-4150-a584-ac1489481289 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:15.474432 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 893/1765] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:15.478672 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59971c6-63d6-49d8-875c-3b423bbcdcb4 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:15.508874 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59971c6-63d6-49d8-875c-3b423bbcdcb4 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:15.519562 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb03c2-0bee-488d-a46a-dc41ee9608e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:15.520260 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb03c2-0bee-488d-a46a-dc41ee9608e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:15.520544 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb03c2-0bee-488d-a46a-dc41ee9608e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:15.520818 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb03c2-0bee-488d-a46a-dc41ee9608e4 admin admin] PATH_INFO: `/v3/projects/40c5506648b34b8ab1e7cfa7850adb8b/users/4e46d8fa45d847c9a875cb998f82ae7f/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:15.525317 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb03c2-0bee-488d-a46a-dc41ee9608e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40c5506648b34b8ab1e7cfa7850adb8b, user_id=4e46d8fa45d847c9a875cb998f82ae7f, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:15.528268 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb03c2-0bee-488d-a46a-dc41ee9608e4 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:15.544793 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 873/1766] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:52:15 2022] PUT /identity/v3/projects/40c5506648b34b8ab1e7cfa7850adb8b/users/4e46d8fa45d847c9a875cb998f82ae7f/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:15.557876 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb0fd8-efd2-4da4-a15a-71629f643400 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:15.557876 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb0fd8-efd2-4da4-a15a-71629f643400 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:15.557876 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb0fd8-efd2-4da4-a15a-71629f643400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:15.607201 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-6dcb0fd8-efd2-4da4-a15a-71629f643400 None None] MFA Rules not processed for user `4e46d8fa45d847c9a875cb998f82ae7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:15.608958 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-6dcb0fd8-efd2-4da4-a15a-71629f643400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:15.674712 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:52:15.727744 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 894/1767] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:15 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:52:15.761829 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb03c2-0bee-488d-a46a-dc41ee9608e4 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:15.767734 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-61fb03c2-0bee-488d-a46a-dc41ee9608e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:15.883930 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb03c2-0bee-488d-a46a-dc41ee9608e4 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:15.889575 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf27b1-750a-47ce-bd73-5566d5a70d7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:15.891091 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf27b1-750a-47ce-bd73-5566d5a70d7c service cinder] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:15.891475 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf27b1-750a-47ce-bd73-5566d5a70d7c service cinder] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:15.891816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf27b1-750a-47ce-bd73-5566d5a70d7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:15.904144 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf27b1-750a-47ce-bd73-5566d5a70d7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:15.906409 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf27b1-750a-47ce-bd73-5566d5a70d7c service cinder] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:15.918820 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 874/1768] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:15 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:52:16.128983 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb0fd8-efd2-4da4-a15a-71629f643400 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:16.130708 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-6dcb0fd8-efd2-4da4-a15a-71629f643400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:16.313985 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb0fd8-efd2-4da4-a15a-71629f643400 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:16.323423 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8816b41e-ad1a-4900-9f55-5bf48d15a082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:16.324518 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816b41e-ad1a-4900-9f55-5bf48d15a082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:16.324997 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816b41e-ad1a-4900-9f55-5bf48d15a082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:16.325541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816b41e-ad1a-4900-9f55-5bf48d15a082 admin admin] PATH_INFO: `/v3/projects/3b1412449ade4c638cd8057d3189e2b4` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:16.328315 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8816b41e-ad1a-4900-9f55-5bf48d15a082 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b1412449ade4c638cd8057d3189e2b4)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:16.330977 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8816b41e-ad1a-4900-9f55-5bf48d15a082 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:16.615120 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-8816b41e-ad1a-4900-9f55-5bf48d15a082 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b1412449ade4c638cd8057d3189e2b4', 'request_id': 'req-8816b41e-ad1a-4900-9f55-5bf48d15a082'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:16.642655 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-8816b41e-ad1a-4900-9f55-5bf48d15a082 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b1412449ade4c638cd8057d3189e2b4', 'request_id': 'req-8816b41e-ad1a-4900-9f55-5bf48d15a082'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:16.660588 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-8816b41e-ad1a-4900-9f55-5bf48d15a082 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b1412449ade4c638cd8057d3189e2b4', 'request_id': 'req-8816b41e-ad1a-4900-9f55-5bf48d15a082'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:16.862782 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-8816b41e-ad1a-4900-9f55-5bf48d15a082 admin admin] The token cache is being invalidate because project 3b1412449ade4c638cd8057d3189e2b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:52:16.864540 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-8816b41e-ad1a-4900-9f55-5bf48d15a082 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:16.867822 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-8816b41e-ad1a-4900-9f55-5bf48d15a082 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:16.877229 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 895/1769] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:52:16 2022] DELETE /identity/v3/projects/3b1412449ade4c638cd8057d3189e2b4 => generated 0 bytes in 746 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:16.880273 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb8f9e-2e05-45c5-8945-2d153cbb6eee None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:16.881275 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb8f9e-2e05-45c5-8945-2d153cbb6eee None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:16.881829 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb8f9e-2e05-45c5-8945-2d153cbb6eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:16.945747 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-dfcb8f9e-2e05-45c5-8945-2d153cbb6eee None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:16.949947 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-dfcb8f9e-2e05-45c5-8945-2d153cbb6eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:17.090507 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b459f1d-badc-433f-9fdc-11045472865e None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:17.090804 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b459f1d-badc-433f-9fdc-11045472865e None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:17.091098 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b459f1d-badc-433f-9fdc-11045472865e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:17.095476 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 875/1770] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:17.097517 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb8f9e-2e05-45c5-8945-2d153cbb6eee None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:17.100626 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-dfcb8f9e-2e05-45c5-8945-2d153cbb6eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:17.116832 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-9b459f1d-badc-433f-9fdc-11045472865e None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:17.118057 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-9b459f1d-badc-433f-9fdc-11045472865e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:17.126473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 896/1771] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:17.131171 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b459f1d-badc-433f-9fdc-11045472865e None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:17.150860 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b459f1d-badc-433f-9fdc-11045472865e None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:17.167853 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1846a1c-1fe9-499d-b6d4-970b57ece459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:17.168629 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1846a1c-1fe9-499d-b6d4-970b57ece459 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:17.169005 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1846a1c-1fe9-499d-b6d4-970b57ece459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:17.169159 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1846a1c-1fe9-499d-b6d4-970b57ece459 admin admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:17.169825 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1846a1c-1fe9-499d-b6d4-970b57ece459 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:52:17.170096 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1846a1c-1fe9-499d-b6d4-970b57ece459 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:17.172551 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1846a1c-1fe9-499d-b6d4-970b57ece459 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:17.204499 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 897/1772] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:52:17.215232 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1846a1c-1fe9-499d-b6d4-970b57ece459 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:17.221862 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb8f9e-2e05-45c5-8945-2d153cbb6eee None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:17.229345 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9a9c5-0fa5-49f6-895d-cb87352722cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:17.230521 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9a9c5-0fa5-49f6-895d-cb87352722cd service cinder] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:17.230960 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9a9c5-0fa5-49f6-895d-cb87352722cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:17.231455 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9a9c5-0fa5-49f6-895d-cb87352722cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:17.232220 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1846a1c-1fe9-499d-b6d4-970b57ece459 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:17.234977 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-70e9a9c5-0fa5-49f6-895d-cb87352722cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:17.239940 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e9e05-484b-47ea-ab30-9b1a39b64b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:17.254015 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e9e05-484b-47ea-ab30-9b1a39b64b72 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:17.268391 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e9e05-484b-47ea-ab30-9b1a39b64b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:17.269706 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e9e05-484b-47ea-ab30-9b1a39b64b72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:17.272794 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e9e05-484b-47ea-ab30-9b1a39b64b72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:17.290501 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e9e05-484b-47ea-ab30-9b1a39b64b72 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:17.372429 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9a9c5-0fa5-49f6-895d-cb87352722cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:17.374348 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9a9c5-0fa5-49f6-895d-cb87352722cd service cinder] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:17.391072 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:52:17.406293 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 876/1773] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:52:17.418458 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f8ef4-d694-4a40-b485-7024bcd4ac9b None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:17.422413 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f8ef4-d694-4a40-b485-7024bcd4ac9b None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:17.422886 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f8ef4-d694-4a40-b485-7024bcd4ac9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:17.504438 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 898/1774] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:52:17 2022] POST /identity/v3/projects => generated 371 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:17.505760 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e9e05-484b-47ea-ab30-9b1a39b64b72 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:17.530783 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-506f8ef4-d694-4a40-b485-7024bcd4ac9b None None] MFA Rules not processed for user `30dc2621143f4604b53bb44b82e8efbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:17.532252 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-506f8ef4-d694-4a40-b485-7024bcd4ac9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:17.630188 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e9e05-484b-47ea-ab30-9b1a39b64b72 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:17.636052 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ff747-b67a-4c26-b8db-e21eb646c0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:17.636693 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ff747-b67a-4c26-b8db-e21eb646c0ee admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:17.636973 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ff747-b67a-4c26-b8db-e21eb646c0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:17.637582 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ff747-b67a-4c26-b8db-e21eb646c0ee admin admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:17.638465 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ff747-b67a-4c26-b8db-e21eb646c0ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:17.640657 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ff747-b67a-4c26-b8db-e21eb646c0ee admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:17.757364 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 877/1775] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Aug 26 07:52:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:17.798467 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 899/1776] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:52:17 2022] POST /identity/v3/users => generated 286 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:17.802775 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f8ef4-d694-4a40-b485-7024bcd4ac9b None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:17.822154 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f8ef4-d694-4a40-b485-7024bcd4ac9b None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:17.837537 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b45d2d-92c8-42af-9a7f-bb02a06e930d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:17.837537 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b45d2d-92c8-42af-9a7f-bb02a06e930d admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:17.837537 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b45d2d-92c8-42af-9a7f-bb02a06e930d admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:17.837843 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b45d2d-92c8-42af-9a7f-bb02a06e930d admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:17.838464 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b45d2d-92c8-42af-9a7f-bb02a06e930d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:17.840210 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b45d2d-92c8-42af-9a7f-bb02a06e930d admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:17.859119 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 878/1777] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 07:52:17.860948 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ff747-b67a-4c26-b8db-e21eb646c0ee admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:17.874855 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ff747-b67a-4c26-b8db-e21eb646c0ee admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:17.888830 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec385ae-f7f8-470f-ae88-450ac8c6e7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:17.889529 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec385ae-f7f8-470f-ae88-450ac8c6e7a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:17.889819 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec385ae-f7f8-470f-ae88-450ac8c6e7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:17.890192 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec385ae-f7f8-470f-ae88-450ac8c6e7a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:17.890858 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec385ae-f7f8-470f-ae88-450ac8c6e7a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:17.892600 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec385ae-f7f8-470f-ae88-450ac8c6e7a5 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:17.918133 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 900/1778] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:17.921884 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b45d2d-92c8-42af-9a7f-bb02a06e930d admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:17.935360 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b45d2d-92c8-42af-9a7f-bb02a06e930d admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:17.940866 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f468e-f98d-44b9-9d9e-1e5a53e79ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:17.941697 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f468e-f98d-44b9-9d9e-1e5a53e79ca1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:17.941958 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f468e-f98d-44b9-9d9e-1e5a53e79ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:17.942231 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f468e-f98d-44b9-9d9e-1e5a53e79ca1 admin admin] PATH_INFO: `/v3/projects/6235a7cf7c8a4384a73e4093bfbc5552/users/929b25c26d9b4ad197def51a67d5261f/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:17.975559 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0f468e-f98d-44b9-9d9e-1e5a53e79ca1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6235a7cf7c8a4384a73e4093bfbc5552, user_id=929b25c26d9b4ad197def51a67d5261f, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:17.975559 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0f468e-f98d-44b9-9d9e-1e5a53e79ca1 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:18.173433 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 879/1779] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:52:17 2022] PUT /identity/v3/projects/6235a7cf7c8a4384a73e4093bfbc5552/users/929b25c26d9b4ad197def51a67d5261f/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:18.188445 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d76f3-072d-4e5e-af64-20761e14b0d6 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:18.189231 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d76f3-072d-4e5e-af64-20761e14b0d6 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:18.190390 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d76f3-072d-4e5e-af64-20761e14b0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:18.302478 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-321d76f3-072d-4e5e-af64-20761e14b0d6 None None] MFA Rules not processed for user `929b25c26d9b4ad197def51a67d5261f`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:18.306161 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-321d76f3-072d-4e5e-af64-20761e14b0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:18.363872 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f468e-f98d-44b9-9d9e-1e5a53e79ca1 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:18.364232 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-3c0f468e-f98d-44b9-9d9e-1e5a53e79ca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:18.400176 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 901/1780] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:18.405318 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d76f3-072d-4e5e-af64-20761e14b0d6 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:18.475697 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f468e-f98d-44b9-9d9e-1e5a53e79ca1 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:18.477596 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d76f3-072d-4e5e-af64-20761e14b0d6 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:18.483449 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09352198-1f3e-4ad4-8771-9d9d43a87c31 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3142255c263e44a189db82c621f87e7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:18.484487 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09352198-1f3e-4ad4-8771-9d9d43a87c31 service swift] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:18.484914 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09352198-1f3e-4ad4-8771-9d9d43a87c31 service swift] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:18.485476 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09352198-1f3e-4ad4-8771-9d9d43a87c31 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:18.492752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc5e7b9-c6e2-4afa-a211-237246c54dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:18.494006 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5e7b9-c6e2-4afa-a211-237246c54dd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:18.494458 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5e7b9-c6e2-4afa-a211-237246c54dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:18.494898 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5e7b9-c6e2-4afa-a211-237246c54dd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:18.496068 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc5e7b9-c6e2-4afa-a211-237246c54dd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:18.499666 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc5e7b9-c6e2-4afa-a211-237246c54dd9 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:18.572485 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09352198-1f3e-4ad4-8771-9d9d43a87c31 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:18.574262 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09352198-1f3e-4ad4-8771-9d9d43a87c31 service swift] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:18.592801 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 880/1781] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 26 07:52:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 26 07:52:18.641619 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 902/1782] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:52:18 2022] POST /identity/v3/projects => generated 373 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 07:52:18.642753 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09352198-1f3e-4ad4-8771-9d9d43a87c31 service swift] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:18.691800 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09352198-1f3e-4ad4-8771-9d9d43a87c31 service swift] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:18.949596 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc5e7b9-c6e2-4afa-a211-237246c54dd9 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:18.954770 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-5cc5e7b9-c6e2-4afa-a211-237246c54dd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:18.999074 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a587d4c-1680-49e5-9397-71f7b365f7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:18.999074 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a587d4c-1680-49e5-9397-71f7b365f7bf admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:19.006962 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a587d4c-1680-49e5-9397-71f7b365f7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:19.009537 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a587d4c-1680-49e5-9397-71f7b365f7bf admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:19.020067 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a587d4c-1680-49e5-9397-71f7b365f7bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:19.032177 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a587d4c-1680-49e5-9397-71f7b365f7bf admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:19.252568 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 881/1783] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:52:18 2022] POST /identity/v3/users => generated 293 bytes in 612 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:19.254039 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a587d4c-1680-49e5-9397-71f7b365f7bf admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:19.280477 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a587d4c-1680-49e5-9397-71f7b365f7bf admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:19.316417 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5347204-f61f-404a-b6dd-d77fc8b3d484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:19.321960 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5347204-f61f-404a-b6dd-d77fc8b3d484 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:19.321960 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5347204-f61f-404a-b6dd-d77fc8b3d484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:19.321960 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5347204-f61f-404a-b6dd-d77fc8b3d484 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:19.321960 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5347204-f61f-404a-b6dd-d77fc8b3d484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:19.321960 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5347204-f61f-404a-b6dd-d77fc8b3d484 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:19.356507 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:52:19.396301 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 882/1784] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:19.397598 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc5e7b9-c6e2-4afa-a211-237246c54dd9 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:19.398560 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5347204-f61f-404a-b6dd-d77fc8b3d484 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:19.441241 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5347204-f61f-404a-b6dd-d77fc8b3d484 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:19.446265 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40097116-bafe-4ebb-9e6f-364bad173a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:19.447309 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40097116-bafe-4ebb-9e6f-364bad173a50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:19.447861 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40097116-bafe-4ebb-9e6f-364bad173a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:19.448351 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40097116-bafe-4ebb-9e6f-364bad173a50 admin admin] PATH_INFO: `/v3/users/4128021efd9e4ae8a2c06933e37c7a35` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:19.452549 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40097116-bafe-4ebb-9e6f-364bad173a50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4128021efd9e4ae8a2c06933e37c7a35)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:19.458385 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40097116-bafe-4ebb-9e6f-364bad173a50 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:19.473357 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90021552-eba9-43e9-8a50-2dbe87b32929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:19.490025 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90021552-eba9-43e9-8a50-2dbe87b32929 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:19.490817 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90021552-eba9-43e9-8a50-2dbe87b32929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:19.491887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90021552-eba9-43e9-8a50-2dbe87b32929 admin admin] PATH_INFO: `/v3/projects/2c6fa982a3a9431caf45500e96b76d8f/users/bb952b5f6e91402d9b3cea0283b53fbb/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:19.566366 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90021552-eba9-43e9-8a50-2dbe87b32929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c6fa982a3a9431caf45500e96b76d8f, user_id=bb952b5f6e91402d9b3cea0283b53fbb, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:19.570267 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90021552-eba9-43e9-8a50-2dbe87b32929 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:19.673332 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 883/1785] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:52:19 2022] PUT /identity/v3/projects/2c6fa982a3a9431caf45500e96b76d8f/users/bb952b5f6e91402d9b3cea0283b53fbb/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:19.676463 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a349b-c65d-496d-9bf3-d1c47970fa98 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:19.680681 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a349b-c65d-496d-9bf3-d1c47970fa98 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:19.680681 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a349b-c65d-496d-9bf3-d1c47970fa98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:19.767483 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-568a349b-c65d-496d-9bf3-d1c47970fa98 None None] MFA Rules not processed for user `a5ea9916c82647f3a645f1a4258f558b`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:19.768947 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-568a349b-c65d-496d-9bf3-d1c47970fa98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:19.854718 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-40097116-bafe-4ebb-9e6f-364bad173a50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4128021efd9e4ae8a2c06933e37c7a35'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:19.877469 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-40097116-bafe-4ebb-9e6f-364bad173a50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4128021efd9e4ae8a2c06933e37c7a35'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:19.924897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 884/1786] 10.222.0.72 () {58 vars in 1015 bytes} [Fri Aug 26 07:52:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:19.926264 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a349b-c65d-496d-9bf3-d1c47970fa98 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:20.028294 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-40097116-bafe-4ebb-9e6f-364bad173a50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4128021efd9e4ae8a2c06933e37c7a35'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:20.029072 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-40097116-bafe-4ebb-9e6f-364bad173a50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4128021efd9e4ae8a2c06933e37c7a35'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:20.035361 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a349b-c65d-496d-9bf3-d1c47970fa98 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:20.040114 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eff067-6575-4bdb-ab9c-f4f78dc1de70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:20.041760 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eff067-6575-4bdb-ab9c-f4f78dc1de70 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:20.041760 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eff067-6575-4bdb-ab9c-f4f78dc1de70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:20.041760 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eff067-6575-4bdb-ab9c-f4f78dc1de70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:20.042035 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eff067-6575-4bdb-ab9c-f4f78dc1de70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:20.043964 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eff067-6575-4bdb-ab9c-f4f78dc1de70 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:20.077787 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-40097116-bafe-4ebb-9e6f-364bad173a50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4128021efd9e4ae8a2c06933e37c7a35'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:20.096363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 903/1787] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:52:18 2022] DELETE /identity/v3/users/4128021efd9e4ae8a2c06933e37c7a35 => generated 0 bytes in 1144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:20.099421 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40097116-bafe-4ebb-9e6f-364bad173a50 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:20.102589 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-40097116-bafe-4ebb-9e6f-364bad173a50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:20.116484 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 885/1788] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:20.120843 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eff067-6575-4bdb-ab9c-f4f78dc1de70 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:20.147586 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-77eff067-6575-4bdb-ab9c-f4f78dc1de70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:20.227613 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eff067-6575-4bdb-ab9c-f4f78dc1de70 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:20.233446 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40097116-bafe-4ebb-9e6f-364bad173a50 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:20.238331 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b9da6-6de7-40cd-b9c0-db4cac3b5d5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:20.239088 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b9da6-6de7-40cd-b9c0-db4cac3b5d5d service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:20.240292 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b9da6-6de7-40cd-b9c0-db4cac3b5d5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:20.240780 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b9da6-6de7-40cd-b9c0-db4cac3b5d5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:20.246695 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-784b9da6-6de7-40cd-b9c0-db4cac3b5d5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:20.266830 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b9da6-6de7-40cd-b9c0-db4cac3b5d5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:20.285831 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b9da6-6de7-40cd-b9c0-db4cac3b5d5d service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:20.285831 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 904/1789] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:52:20.285831 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb7cad-a4f0-4425-a14a-cc0808114fce None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:20.285831 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb7cad-a4f0-4425-a14a-cc0808114fce None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:20.285831 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb7cad-a4f0-4425-a14a-cc0808114fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:20.317186 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486159d6-161f-4a26-86a1-177134c4c81c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:20.318161 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486159d6-161f-4a26-86a1-177134c4c81c service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:20.318735 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486159d6-161f-4a26-86a1-177134c4c81c service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:20.319824 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486159d6-161f-4a26-86a1-177134c4c81c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:20.353492 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486159d6-161f-4a26-86a1-177134c4c81c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:20.356237 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486159d6-161f-4a26-86a1-177134c4c81c service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:20.372913 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-87cb7cad-a4f0-4425-a14a-cc0808114fce None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:20.375209 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-87cb7cad-a4f0-4425-a14a-cc0808114fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:20.377839 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 886/1790] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:52:20.383865 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486159d6-161f-4a26-86a1-177134c4c81c service neutron] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:20.386204 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-486159d6-161f-4a26-86a1-177134c4c81c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:20.572115 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 905/1791] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:20.580660 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb7cad-a4f0-4425-a14a-cc0808114fce None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:20.583971 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-87cb7cad-a4f0-4425-a14a-cc0808114fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:20.616878 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb7cad-a4f0-4425-a14a-cc0808114fce None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:20.636551 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a74238-6295-46ce-b371-8d6d8ea115b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:20.637358 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a74238-6295-46ce-b371-8d6d8ea115b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:20.637662 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a74238-6295-46ce-b371-8d6d8ea115b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:20.637974 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a74238-6295-46ce-b371-8d6d8ea115b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:20.651016 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486159d6-161f-4a26-86a1-177134c4c81c service neutron] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:20.661520 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a74238-6295-46ce-b371-8d6d8ea115b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:20.663243 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a74238-6295-46ce-b371-8d6d8ea115b3 service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:20.676185 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c98568-5513-41ab-898e-13e548e143f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:20.677498 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c98568-5513-41ab-898e-13e548e143f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:20.677884 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c98568-5513-41ab-898e-13e548e143f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:20.678394 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c98568-5513-41ab-898e-13e548e143f2 admin admin] PATH_INFO: `/v3/projects/2c6fa982a3a9431caf45500e96b76d8f/users/bb952b5f6e91402d9b3cea0283b53fbb/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:20.682198 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c98568-5513-41ab-898e-13e548e143f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c6fa982a3a9431caf45500e96b76d8f, user_id=bb952b5f6e91402d9b3cea0283b53fbb, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:20.691736 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c98568-5513-41ab-898e-13e548e143f2 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:20.693083 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 906/1792] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:52:20.727248 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 887/1793] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:52:20 2022] PUT /identity/v3/projects/2c6fa982a3a9431caf45500e96b76d8f/users/bb952b5f6e91402d9b3cea0283b53fbb/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:20.737689 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95551d-b9e2-4dd2-a49b-dd5707d59e27 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:20.739088 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95551d-b9e2-4dd2-a49b-dd5707d59e27 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:20.743268 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95551d-b9e2-4dd2-a49b-dd5707d59e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:20.867810 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-5e95551d-b9e2-4dd2-a49b-dd5707d59e27 None None] MFA Rules not processed for user `bb952b5f6e91402d9b3cea0283b53fbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:20.870205 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-5e95551d-b9e2-4dd2-a49b-dd5707d59e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:21.072415 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 907/1794] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:21.197089 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c98568-5513-41ab-898e-13e548e143f2 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:21.207267 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-40c98568-5513-41ab-898e-13e548e143f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:21.415352 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c98568-5513-41ab-898e-13e548e143f2 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:21.425836 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a105c-4afb-46bf-b98e-2841fa245acd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:21.426790 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a105c-4afb-46bf-b98e-2841fa245acd service cinder] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:21.429624 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a105c-4afb-46bf-b98e-2841fa245acd service cinder] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:21.430281 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a105c-4afb-46bf-b98e-2841fa245acd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:21.460013 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a105c-4afb-46bf-b98e-2841fa245acd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:21.461861 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a105c-4afb-46bf-b98e-2841fa245acd service cinder] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:21.492402 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 888/1795] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:21 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:52:21.988120 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95551d-b9e2-4dd2-a49b-dd5707d59e27 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:21.997133 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-5e95551d-b9e2-4dd2-a49b-dd5707d59e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:22.009559 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95551d-b9e2-4dd2-a49b-dd5707d59e27 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:22.014409 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4e1e8-230a-447a-bf72-f55f33ce93a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:22.015248 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4e1e8-230a-447a-bf72-f55f33ce93a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:22.015590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4e1e8-230a-447a-bf72-f55f33ce93a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:22.015823 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4e1e8-230a-447a-bf72-f55f33ce93a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:22.017957 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-b0b4e1e8-230a-447a-bf72-f55f33ce93a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:22.152031 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b4e1e8-230a-447a-bf72-f55f33ce93a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:22.156257 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b4e1e8-230a-447a-bf72-f55f33ce93a9 service cinder] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:22.195285 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 908/1796] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:52:22.423929 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:52:22.859556 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a105c-4afb-46bf-b98e-2841fa245acd service cinder] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:22.862769 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-f54a105c-4afb-46bf-b98e-2841fa245acd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:22.883818 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41182320-1761-49cd-bb24-0ebb77e412f3 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:22.884135 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41182320-1761-49cd-bb24-0ebb77e412f3 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:22.884500 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41182320-1761-49cd-bb24-0ebb77e412f3 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:22.886402 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 909/1797] 10.222.0.42 () {54 vars in 921 bytes} [Fri Aug 26 07:52:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:52:22.894080 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c86e27-a12e-4481-acdc-87498d33e118 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:22.894566 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c86e27-a12e-4481-acdc-87498d33e118 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:22.895050 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c86e27-a12e-4481-acdc-87498d33e118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:22.987653 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-62c86e27-a12e-4481-acdc-87498d33e118 None None] MFA Rules not processed for user `bc92c0a0a2cc4722868e6877bac93ada`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:22.990512 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-62c86e27-a12e-4481-acdc-87498d33e118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:23.097475 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a105c-4afb-46bf-b98e-2841fa245acd service cinder] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:23.110388 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c53b85-9bb5-475b-8018-f00c9968ab71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:23.114180 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c53b85-9bb5-475b-8018-f00c9968ab71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:23.114468 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c53b85-9bb5-475b-8018-f00c9968ab71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:23.114757 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c53b85-9bb5-475b-8018-f00c9968ab71 admin admin] PATH_INFO: `/v3/projects/a407c7644b5a4a39ae09a83b4265675e` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:23.117554 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c53b85-9bb5-475b-8018-f00c9968ab71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a407c7644b5a4a39ae09a83b4265675e)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:23.122112 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c53b85-9bb5-475b-8018-f00c9968ab71 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:23.254271 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 910/1798] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Aug 26 07:52:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:23.379977 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-c5c53b85-9bb5-475b-8018-f00c9968ab71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a407c7644b5a4a39ae09a83b4265675e', 'request_id': 'req-c5c53b85-9bb5-475b-8018-f00c9968ab71'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:23.388502 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-c5c53b85-9bb5-475b-8018-f00c9968ab71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a407c7644b5a4a39ae09a83b4265675e', 'request_id': 'req-c5c53b85-9bb5-475b-8018-f00c9968ab71'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:23.462895 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c86e27-a12e-4481-acdc-87498d33e118 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:23.464744 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-62c86e27-a12e-4481-acdc-87498d33e118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:23.489313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c86e27-a12e-4481-acdc-87498d33e118 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:23.513485 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-c5c53b85-9bb5-475b-8018-f00c9968ab71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a407c7644b5a4a39ae09a83b4265675e', 'request_id': 'req-c5c53b85-9bb5-475b-8018-f00c9968ab71'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:23.547894 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-c5c53b85-9bb5-475b-8018-f00c9968ab71 admin admin] The token cache is being invalidate because project a407c7644b5a4a39ae09a83b4265675e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:52:23.548193 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-c5c53b85-9bb5-475b-8018-f00c9968ab71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:23.553825 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-c5c53b85-9bb5-475b-8018-f00c9968ab71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:23.557135 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 889/1799] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:52:22 2022] DELETE /identity/v3/projects/a407c7644b5a4a39ae09a83b4265675e => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:23.558481 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c53b85-9bb5-475b-8018-f00c9968ab71 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:23.565840 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-c5c53b85-9bb5-475b-8018-f00c9968ab71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:23.716539 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e6bbe-a4a5-4c90-bcec-8d6ce98fb26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:23.721908 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e6bbe-a4a5-4c90-bcec-8d6ce98fb26c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:23.721908 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e6bbe-a4a5-4c90-bcec-8d6ce98fb26c admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:23.721908 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e6bbe-a4a5-4c90-bcec-8d6ce98fb26c admin admin] PATH_INFO: `/v3/users/ed91f8665bdb471e99ae6d2625b3a1be` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:23.726141 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e6bbe-a4a5-4c90-bcec-8d6ce98fb26c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed91f8665bdb471e99ae6d2625b3a1be)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:23.728809 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e6bbe-a4a5-4c90-bcec-8d6ce98fb26c admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:23.811843 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c53b85-9bb5-475b-8018-f00c9968ab71 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:23.822768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110de875-eb62-4ce4-9f6d-35fbf5986830 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc92c0a0a2cc4722868e6877bac93ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:23.823750 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110de875-eb62-4ce4-9f6d-35fbf5986830 service nova] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:23.824234 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110de875-eb62-4ce4-9f6d-35fbf5986830 service nova] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:23.824631 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110de875-eb62-4ce4-9f6d-35fbf5986830 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:23.828467 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-110de875-eb62-4ce4-9f6d-35fbf5986830 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:23.845647 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110de875-eb62-4ce4-9f6d-35fbf5986830 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:23.847246 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110de875-eb62-4ce4-9f6d-35fbf5986830 service nova] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:23.859016 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 890/1800] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:52:23.859956 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110de875-eb62-4ce4-9f6d-35fbf5986830 service nova] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:23.861443 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-110de875-eb62-4ce4-9f6d-35fbf5986830 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:23.876432 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110de875-eb62-4ce4-9f6d-35fbf5986830 service nova] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:23.881797 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf42cb-b3fe-4c47-b0d0-f889989827d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:23.882610 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf42cb-b3fe-4c47-b0d0-f889989827d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:23.883475 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf42cb-b3fe-4c47-b0d0-f889989827d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:23.883956 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf42cb-b3fe-4c47-b0d0-f889989827d7 admin admin] PATH_INFO: `/v3/users/ea23c1862b74459b86027ca83056567b` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:23.885633 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbf42cb-b3fe-4c47-b0d0-f889989827d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea23c1862b74459b86027ca83056567b)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:23.887941 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbf42cb-b3fe-4c47-b0d0-f889989827d7 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:23.976071 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:52:24.136418 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-f15e6bbe-a4a5-4c90-bcec-8d6ce98fb26c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed91f8665bdb471e99ae6d2625b3a1be'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:24.146284 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-f15e6bbe-a4a5-4c90-bcec-8d6ce98fb26c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed91f8665bdb471e99ae6d2625b3a1be'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:24.173973 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-ebbf42cb-b3fe-4c47-b0d0-f889989827d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea23c1862b74459b86027ca83056567b'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:24.179323 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-ebbf42cb-b3fe-4c47-b0d0-f889989827d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea23c1862b74459b86027ca83056567b'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:24.280835 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-f15e6bbe-a4a5-4c90-bcec-8d6ce98fb26c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed91f8665bdb471e99ae6d2625b3a1be'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:24.281827 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-f15e6bbe-a4a5-4c90-bcec-8d6ce98fb26c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed91f8665bdb471e99ae6d2625b3a1be'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:24.307143 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-f15e6bbe-a4a5-4c90-bcec-8d6ce98fb26c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed91f8665bdb471e99ae6d2625b3a1be'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:24.327386 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 911/1801] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:52:23 2022] DELETE /identity/v3/users/ed91f8665bdb471e99ae6d2625b3a1be => generated 0 bytes in 862 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:24.332451 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021d84a-bd66-4051-af82-c8d8f83bcee5 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:24.332750 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021d84a-bd66-4051-af82-c8d8f83bcee5 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:24.333025 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021d84a-bd66-4051-af82-c8d8f83bcee5 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:24.339905 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 912/1802] 10.222.0.42 () {54 vars in 921 bytes} [Fri Aug 26 07:52:24 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:52:24.341549 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4145e-65dc-4d52-bb46-1fc2846232ef None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:24.344423 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4145e-65dc-4d52-bb46-1fc2846232ef None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:24.345657 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4145e-65dc-4d52-bb46-1fc2846232ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:24.388103 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-ebbf42cb-b3fe-4c47-b0d0-f889989827d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea23c1862b74459b86027ca83056567b'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:24.389105 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-ebbf42cb-b3fe-4c47-b0d0-f889989827d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea23c1862b74459b86027ca83056567b'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:24.399320 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-ebbf42cb-b3fe-4c47-b0d0-f889989827d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea23c1862b74459b86027ca83056567b'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:24.409090 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-88d4145e-65dc-4d52-bb46-1fc2846232ef None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:24.413706 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-88d4145e-65dc-4d52-bb46-1fc2846232ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:24.468510 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 891/1803] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:52:23 2022] DELETE /identity/v3/users/ea23c1862b74459b86027ca83056567b => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:24.472026 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d205f-1111-4b18-8acf-801e94eb852e None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:24.472327 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d205f-1111-4b18-8acf-801e94eb852e None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:24.472609 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d205f-1111-4b18-8acf-801e94eb852e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:24.532360 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 913/1804] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:24.542739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-fd5d205f-1111-4b18-8acf-801e94eb852e None None] MFA Rules not processed for user `bc92c0a0a2cc4722868e6877bac93ada`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:24.549094 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-fd5d205f-1111-4b18-8acf-801e94eb852e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:24.561041 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4145e-65dc-4d52-bb46-1fc2846232ef None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:24.570822 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-88d4145e-65dc-4d52-bb46-1fc2846232ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:24.728600 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4145e-65dc-4d52-bb46-1fc2846232ef None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:24.820366 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c93458-4770-462f-bf25-03870ed706de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:24.821489 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c93458-4770-462f-bf25-03870ed706de service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:24.821805 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c93458-4770-462f-bf25-03870ed706de service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:24.822200 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c93458-4770-462f-bf25-03870ed706de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:24.907026 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 892/1805] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Aug 26 07:52:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 441 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:24.931444 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c93458-4770-462f-bf25-03870ed706de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:24.933053 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c93458-4770-462f-bf25-03870ed706de service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:24.945574 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 914/1806] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:52:25.538650 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d205f-1111-4b18-8acf-801e94eb852e None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:25.540621 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-fd5d205f-1111-4b18-8acf-801e94eb852e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:25.581305 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d205f-1111-4b18-8acf-801e94eb852e None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:25.581305 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f44f7-2f01-4021-9b90-9af4b2325f31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc92c0a0a2cc4722868e6877bac93ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:25.581305 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f44f7-2f01-4021-9b90-9af4b2325f31 service nova] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:25.581305 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f44f7-2f01-4021-9b90-9af4b2325f31 service nova] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:25.582559 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f44f7-2f01-4021-9b90-9af4b2325f31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:25.602673 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161f44f7-2f01-4021-9b90-9af4b2325f31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:25.605150 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161f44f7-2f01-4021-9b90-9af4b2325f31 service nova] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:25.631998 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 893/1807] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:52:25.830102 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c93458-4770-462f-bf25-03870ed706de service neutron] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:25.832869 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-27c93458-4770-462f-bf25-03870ed706de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:25.870294 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f44f7-2f01-4021-9b90-9af4b2325f31 service nova] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:25.872283 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-161f44f7-2f01-4021-9b90-9af4b2325f31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:25.886084 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c93458-4770-462f-bf25-03870ed706de service neutron] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:25.904949 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5c293-cd5b-43be-899f-1e09792767d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:25.906887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f44f7-2f01-4021-9b90-9af4b2325f31 service nova] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:25.909420 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5c293-cd5b-43be-899f-1e09792767d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:25.909710 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5c293-cd5b-43be-899f-1e09792767d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:25.918479 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5c293-cd5b-43be-899f-1e09792767d7 admin admin] PATH_INFO: `/v3/users/18471711c3074387a8aeafa89e1ca465` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:25.920599 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b5c293-cd5b-43be-899f-1e09792767d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18471711c3074387a8aeafa89e1ca465)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:25.928171 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b5c293-cd5b-43be-899f-1e09792767d7 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:25.942709 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0fa125-6b30-4160-a962-1b24658337b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:25.945449 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fa125-6b30-4160-a962-1b24658337b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:25.950821 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fa125-6b30-4160-a962-1b24658337b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:25.967524 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:52:25.969138 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fa125-6b30-4160-a962-1b24658337b8 admin admin] PATH_INFO: `/v3/users/b821beb41c2e4087adf7fd7f8609606a` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:25.979648 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0fa125-6b30-4160-a962-1b24658337b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b821beb41c2e4087adf7fd7f8609606a)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:25.993455 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0fa125-6b30-4160-a962-1b24658337b8 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:26.358423 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-71b5c293-cd5b-43be-899f-1e09792767d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18471711c3074387a8aeafa89e1ca465'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:26.390365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-71b5c293-cd5b-43be-899f-1e09792767d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18471711c3074387a8aeafa89e1ca465'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:26.437066 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-eb0fa125-6b30-4160-a962-1b24658337b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b821beb41c2e4087adf7fd7f8609606a'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:26.449443 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-eb0fa125-6b30-4160-a962-1b24658337b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b821beb41c2e4087adf7fd7f8609606a'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:26.522895 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-71b5c293-cd5b-43be-899f-1e09792767d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18471711c3074387a8aeafa89e1ca465'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:26.523992 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-71b5c293-cd5b-43be-899f-1e09792767d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18471711c3074387a8aeafa89e1ca465'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:26.553639 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-71b5c293-cd5b-43be-899f-1e09792767d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18471711c3074387a8aeafa89e1ca465'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:26.565034 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 915/1808] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:52:25 2022] DELETE /identity/v3/users/18471711c3074387a8aeafa89e1ca465 => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:26.567925 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5c293-cd5b-43be-899f-1e09792767d7 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:26.571928 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-71b5c293-cd5b-43be-899f-1e09792767d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:26.628371 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-eb0fa125-6b30-4160-a962-1b24658337b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b821beb41c2e4087adf7fd7f8609606a'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:26.629152 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-eb0fa125-6b30-4160-a962-1b24658337b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b821beb41c2e4087adf7fd7f8609606a'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:26.653271 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-eb0fa125-6b30-4160-a962-1b24658337b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b821beb41c2e4087adf7fd7f8609606a'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:26.717620 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 894/1809] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:52:25 2022] DELETE /identity/v3/users/b821beb41c2e4087adf7fd7f8609606a => generated 0 bytes in 844 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:26.722331 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490ab4b-2bd4-4024-b93f-6bf6502032b5 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:26.725127 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490ab4b-2bd4-4024-b93f-6bf6502032b5 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:26.725547 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490ab4b-2bd4-4024-b93f-6bf6502032b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:26.765492 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-9490ab4b-2bd4-4024-b93f-6bf6502032b5 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:26.766734 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-9490ab4b-2bd4-4024-b93f-6bf6502032b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:26.820990 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5c293-cd5b-43be-899f-1e09792767d7 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:26.873008 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 895/1810] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:26.875319 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4eb58-d869-4da4-8e8a-6609d08be1b6 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:26.876041 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4eb58-d869-4da4-8e8a-6609d08be1b6 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:26.877394 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4eb58-d869-4da4-8e8a-6609d08be1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:26.906610 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-73d4eb58-d869-4da4-8e8a-6609d08be1b6 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:26.909012 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-73d4eb58-d869-4da4-8e8a-6609d08be1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:26.920615 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 896/1811] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:26.946166 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d4eb58-d869-4da4-8e8a-6609d08be1b6 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:26.948327 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6fae6-f243-43cc-a346-2cd54dff86fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:26.950712 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6fae6-f243-43cc-a346-2cd54dff86fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:26.951134 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-73d4eb58-d869-4da4-8e8a-6609d08be1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:26.951281 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6fae6-f243-43cc-a346-2cd54dff86fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:26.951281 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6fae6-f243-43cc-a346-2cd54dff86fe admin admin] PATH_INFO: `/v3/projects/2ac69a45fe0441249b2c8f734389f907` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:26.957428 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a6fae6-f243-43cc-a346-2cd54dff86fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ac69a45fe0441249b2c8f734389f907)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:26.967612 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a6fae6-f243-43cc-a346-2cd54dff86fe admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:27.115304 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d4eb58-d869-4da4-8e8a-6609d08be1b6 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:27.119144 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e8a4d-4fb0-447f-a296-f3568779f397 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:27.119771 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e8a4d-4fb0-447f-a296-f3568779f397 service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:27.120053 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e8a4d-4fb0-447f-a296-f3568779f397 service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:27.120327 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e8a4d-4fb0-447f-a296-f3568779f397 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:27.133114 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e8a4d-4fb0-447f-a296-f3568779f397 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:27.134774 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e8a4d-4fb0-447f-a296-f3568779f397 service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:27.148970 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 897/1812] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 07:52:27.150403 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e8a4d-4fb0-447f-a296-f3568779f397 service neutron] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:27.153341 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-9d8e8a4d-4fb0-447f-a296-f3568779f397 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:27.172020 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e8a4d-4fb0-447f-a296-f3568779f397 service neutron] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:27.203603 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32190734-c161-4cfd-8899-635aa524e9cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:27.204274 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32190734-c161-4cfd-8899-635aa524e9cc service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:27.204561 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32190734-c161-4cfd-8899-635aa524e9cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:27.215431 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32190734-c161-4cfd-8899-635aa524e9cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:27.240245 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32190734-c161-4cfd-8899-635aa524e9cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:27.241908 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32190734-c161-4cfd-8899-635aa524e9cc service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:27.270424 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 898/1813] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:52:27.297121 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-53a6fae6-f243-43cc-a346-2cd54dff86fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ac69a45fe0441249b2c8f734389f907', 'request_id': 'req-53a6fae6-f243-43cc-a346-2cd54dff86fe'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:27.305841 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-53a6fae6-f243-43cc-a346-2cd54dff86fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ac69a45fe0441249b2c8f734389f907', 'request_id': 'req-53a6fae6-f243-43cc-a346-2cd54dff86fe'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:27.335856 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-53a6fae6-f243-43cc-a346-2cd54dff86fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ac69a45fe0441249b2c8f734389f907', 'request_id': 'req-53a6fae6-f243-43cc-a346-2cd54dff86fe'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:27.538925 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-53a6fae6-f243-43cc-a346-2cd54dff86fe admin admin] The token cache is being invalidate because project 2ac69a45fe0441249b2c8f734389f907 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:52:27.539656 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-53a6fae6-f243-43cc-a346-2cd54dff86fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:27.540665 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-53a6fae6-f243-43cc-a346-2cd54dff86fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:27.543071 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 916/1814] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:52:26 2022] DELETE /identity/v3/projects/2ac69a45fe0441249b2c8f734389f907 => generated 0 bytes in 977 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:27.548580 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fb3fe-4e5c-4279-874f-0f7db790d729 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:27.549399 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fb3fe-4e5c-4279-874f-0f7db790d729 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:27.549688 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fb3fe-4e5c-4279-874f-0f7db790d729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:27.589876 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-435fb3fe-4e5c-4279-874f-0f7db790d729 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:27.591134 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-435fb3fe-4e5c-4279-874f-0f7db790d729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:27.744400 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 899/1815] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:27.754761 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce9889-51cf-4c60-9442-7835157c0a18 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:27.755309 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce9889-51cf-4c60-9442-7835157c0a18 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:27.755757 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce9889-51cf-4c60-9442-7835157c0a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:27.793181 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-0dce9889-51cf-4c60-9442-7835157c0a18 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:27.794686 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-0dce9889-51cf-4c60-9442-7835157c0a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:27.808415 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 917/1816] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:27.810109 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435fb3fe-4e5c-4279-874f-0f7db790d729 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:27.831733 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce9889-51cf-4c60-9442-7835157c0a18 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:27.834591 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435fb3fe-4e5c-4279-874f-0f7db790d729 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:27.834707 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-0dce9889-51cf-4c60-9442-7835157c0a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:27.845187 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c265f-a0dd-4f6a-bc17-95767dc0a55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:27.845956 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c265f-a0dd-4f6a-bc17-95767dc0a55f admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:27.846317 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c265f-a0dd-4f6a-bc17-95767dc0a55f admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:27.846565 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c265f-a0dd-4f6a-bc17-95767dc0a55f admin admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:27.847381 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c265f-a0dd-4f6a-bc17-95767dc0a55f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:52:27.847689 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c265f-a0dd-4f6a-bc17-95767dc0a55f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:27.849647 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce9889-51cf-4c60-9442-7835157c0a18 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:27.855522 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c265f-a0dd-4f6a-bc17-95767dc0a55f admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:27.885986 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6633a6d-ed3a-4cfd-ba5d-05b0d84fa664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:27.887166 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6633a6d-ed3a-4cfd-ba5d-05b0d84fa664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:27.889224 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6633a6d-ed3a-4cfd-ba5d-05b0d84fa664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:27.889858 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6633a6d-ed3a-4cfd-ba5d-05b0d84fa664 admin admin] PATH_INFO: `/v3/projects/21cbb287c90c46b2aaa103ab09ff7524` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:27.891578 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6633a6d-ed3a-4cfd-ba5d-05b0d84fa664 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21cbb287c90c46b2aaa103ab09ff7524)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:27.894964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6633a6d-ed3a-4cfd-ba5d-05b0d84fa664 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:27.900568 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 900/1817] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:52:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:52:27.901711 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c265f-a0dd-4f6a-bc17-95767dc0a55f admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:27.917049 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c265f-a0dd-4f6a-bc17-95767dc0a55f admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:27.923391 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12299996-9a02-4a3b-9e5b-7ed2921c4c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:27.924356 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12299996-9a02-4a3b-9e5b-7ed2921c4c81 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:27.924641 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12299996-9a02-4a3b-9e5b-7ed2921c4c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:27.925137 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12299996-9a02-4a3b-9e5b-7ed2921c4c81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:27.926060 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12299996-9a02-4a3b-9e5b-7ed2921c4c81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:27.928806 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12299996-9a02-4a3b-9e5b-7ed2921c4c81 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:28.005874 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:52:28.155126 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-d6633a6d-ed3a-4cfd-ba5d-05b0d84fa664 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21cbb287c90c46b2aaa103ab09ff7524', 'request_id': 'req-d6633a6d-ed3a-4cfd-ba5d-05b0d84fa664'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:28.172329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-d6633a6d-ed3a-4cfd-ba5d-05b0d84fa664 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21cbb287c90c46b2aaa103ab09ff7524', 'request_id': 'req-d6633a6d-ed3a-4cfd-ba5d-05b0d84fa664'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:28.181802 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-d6633a6d-ed3a-4cfd-ba5d-05b0d84fa664 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21cbb287c90c46b2aaa103ab09ff7524', 'request_id': 'req-d6633a6d-ed3a-4cfd-ba5d-05b0d84fa664'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:28.189372 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 901/1818] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:52:27 2022] POST /identity/v3/projects => generated 373 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:28.206322 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12299996-9a02-4a3b-9e5b-7ed2921c4c81 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:28.313421 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-d6633a6d-ed3a-4cfd-ba5d-05b0d84fa664 admin admin] The token cache is being invalidate because project 21cbb287c90c46b2aaa103ab09ff7524 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:52:28.314104 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-d6633a6d-ed3a-4cfd-ba5d-05b0d84fa664 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:28.315129 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-d6633a6d-ed3a-4cfd-ba5d-05b0d84fa664 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:28.317143 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 918/1819] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:52:27 2022] DELETE /identity/v3/projects/21cbb287c90c46b2aaa103ab09ff7524 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:28.322362 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6633a6d-ed3a-4cfd-ba5d-05b0d84fa664 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:28.328619 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12299996-9a02-4a3b-9e5b-7ed2921c4c81 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:28.332649 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-d6633a6d-ed3a-4cfd-ba5d-05b0d84fa664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:28.347322 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0846b-5b64-421d-ad6b-a1dc571cd783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:28.347919 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0846b-5b64-421d-ad6b-a1dc571cd783 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:28.348369 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0846b-5b64-421d-ad6b-a1dc571cd783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:28.348710 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0846b-5b64-421d-ad6b-a1dc571cd783 admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:28.349397 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e0846b-5b64-421d-ad6b-a1dc571cd783 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:28.351617 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e0846b-5b64-421d-ad6b-a1dc571cd783 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:28.516897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 902/1820] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:52:28 2022] POST /identity/v3/users => generated 287 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:28.525757 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0846b-5b64-421d-ad6b-a1dc571cd783 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:28.534223 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6633a6d-ed3a-4cfd-ba5d-05b0d84fa664 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:28.543744 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-73e0846b-5b64-421d-ad6b-a1dc571cd783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:28.555346 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab74560-a5b6-4031-a02d-74b8a42a27f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:28.556262 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab74560-a5b6-4031-a02d-74b8a42a27f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:28.556593 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab74560-a5b6-4031-a02d-74b8a42a27f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:28.556984 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab74560-a5b6-4031-a02d-74b8a42a27f7 admin admin] PATH_INFO: `/v3/users/f1ceb3512f914712b3550a1de50d341e` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:28.563944 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab74560-a5b6-4031-a02d-74b8a42a27f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1ceb3512f914712b3550a1de50d341e)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:28.574521 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab74560-a5b6-4031-a02d-74b8a42a27f7 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:28.596023 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0846b-5b64-421d-ad6b-a1dc571cd783 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:28.610800 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f26cee-cb20-4c4a-9a2d-7162607c1f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:28.616771 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f26cee-cb20-4c4a-9a2d-7162607c1f25 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:28.616771 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f26cee-cb20-4c4a-9a2d-7162607c1f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:28.616771 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f26cee-cb20-4c4a-9a2d-7162607c1f25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:28.616771 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f26cee-cb20-4c4a-9a2d-7162607c1f25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:28.616771 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f26cee-cb20-4c4a-9a2d-7162607c1f25 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:28.642608 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 903/1821] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:28.643756 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f26cee-cb20-4c4a-9a2d-7162607c1f25 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:28.657186 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f26cee-cb20-4c4a-9a2d-7162607c1f25 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:28.672977 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2268f-22c6-4b52-849d-ba2bc1310d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:28.673768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2268f-22c6-4b52-849d-ba2bc1310d9e admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:28.673923 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2268f-22c6-4b52-849d-ba2bc1310d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:28.674223 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2268f-22c6-4b52-849d-ba2bc1310d9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:28.675211 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d2268f-22c6-4b52-849d-ba2bc1310d9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:28.677612 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d2268f-22c6-4b52-849d-ba2bc1310d9e admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:28.699641 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 904/1822] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:28.705647 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2268f-22c6-4b52-849d-ba2bc1310d9e admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:28.727688 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2268f-22c6-4b52-849d-ba2bc1310d9e admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:28.740386 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0912066-72df-4b13-b85b-755dd6113fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:28.741131 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0912066-72df-4b13-b85b-755dd6113fd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:28.741475 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0912066-72df-4b13-b85b-755dd6113fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:28.741794 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0912066-72df-4b13-b85b-755dd6113fd7 admin admin] PATH_INFO: `/v3/projects/128b154b3286498cbffe5682c82531bc/users/4f96737113d14aa8b50e676e92d403a1/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:28.761973 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0912066-72df-4b13-b85b-755dd6113fd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=128b154b3286498cbffe5682c82531bc, user_id=4f96737113d14aa8b50e676e92d403a1, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:28.765547 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0912066-72df-4b13-b85b-755dd6113fd7 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:28.891755 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 905/1823] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:52:28 2022] PUT /identity/v3/projects/128b154b3286498cbffe5682c82531bc/users/4f96737113d14aa8b50e676e92d403a1/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:28.893868 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0912066-72df-4b13-b85b-755dd6113fd7 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:28.896871 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-c0912066-72df-4b13-b85b-755dd6113fd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:28.927812 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-eab74560-a5b6-4031-a02d-74b8a42a27f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1ceb3512f914712b3550a1de50d341e'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:28.947692 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-eab74560-a5b6-4031-a02d-74b8a42a27f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1ceb3512f914712b3550a1de50d341e'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:28.996606 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0912066-72df-4b13-b85b-755dd6113fd7 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:29.010280 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d89995-cda8-4f14-9993-b0335b104adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:29.011406 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d89995-cda8-4f14-9993-b0335b104adb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:29.022561 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d89995-cda8-4f14-9993-b0335b104adb admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:29.022561 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d89995-cda8-4f14-9993-b0335b104adb admin admin] PATH_INFO: `/v3/projects/846d327f0a284d2989cd3a10efa5e0b0` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:29.022561 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d89995-cda8-4f14-9993-b0335b104adb admin admin] RBAC: Authorizing `identity:delete_project(project_id=846d327f0a284d2989cd3a10efa5e0b0)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:29.022561 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d89995-cda8-4f14-9993-b0335b104adb admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:29.051126 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-eab74560-a5b6-4031-a02d-74b8a42a27f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1ceb3512f914712b3550a1de50d341e'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:29.051545 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-eab74560-a5b6-4031-a02d-74b8a42a27f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1ceb3512f914712b3550a1de50d341e'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:29.065447 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-eab74560-a5b6-4031-a02d-74b8a42a27f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1ceb3512f914712b3550a1de50d341e'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:29.071944 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 919/1824] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:52:28 2022] DELETE /identity/v3/users/f1ceb3512f914712b3550a1de50d341e => generated 0 bytes in 751 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:29.073295 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e543e-7e02-4ff6-b7e1-52a7b52c9b17 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:29.073635 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e543e-7e02-4ff6-b7e1-52a7b52c9b17 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:29.074043 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e543e-7e02-4ff6-b7e1-52a7b52c9b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:29.103315 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-130e543e-7e02-4ff6-b7e1-52a7b52c9b17 None None] MFA Rules not processed for user `4f96737113d14aa8b50e676e92d403a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:29.104561 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-130e543e-7e02-4ff6-b7e1-52a7b52c9b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:29.155794 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-14d89995-cda8-4f14-9993-b0335b104adb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '846d327f0a284d2989cd3a10efa5e0b0', 'request_id': 'req-14d89995-cda8-4f14-9993-b0335b104adb'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:29.162793 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-14d89995-cda8-4f14-9993-b0335b104adb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '846d327f0a284d2989cd3a10efa5e0b0', 'request_id': 'req-14d89995-cda8-4f14-9993-b0335b104adb'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:29.181244 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 920/1825] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:29.182098 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e543e-7e02-4ff6-b7e1-52a7b52c9b17 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:29.183511 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-130e543e-7e02-4ff6-b7e1-52a7b52c9b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:29.249834 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e543e-7e02-4ff6-b7e1-52a7b52c9b17 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:29.284324 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-14d89995-cda8-4f14-9993-b0335b104adb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '846d327f0a284d2989cd3a10efa5e0b0', 'request_id': 'req-14d89995-cda8-4f14-9993-b0335b104adb'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:29.298872 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-14d89995-cda8-4f14-9993-b0335b104adb admin admin] The token cache is being invalidate because project 846d327f0a284d2989cd3a10efa5e0b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:52:29.299193 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-14d89995-cda8-4f14-9993-b0335b104adb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:29.304387 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-14d89995-cda8-4f14-9993-b0335b104adb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:29.304387 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 906/1826] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:52:28 2022] DELETE /identity/v3/projects/846d327f0a284d2989cd3a10efa5e0b0 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:29.304387 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d89995-cda8-4f14-9993-b0335b104adb admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:29.304962 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-14d89995-cda8-4f14-9993-b0335b104adb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:29.312011 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:52:29.321689 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee9e8f-51a4-4434-8dfe-bef78f5c0c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:29.322333 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee9e8f-51a4-4434-8dfe-bef78f5c0c20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:29.322615 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee9e8f-51a4-4434-8dfe-bef78f5c0c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:29.322892 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee9e8f-51a4-4434-8dfe-bef78f5c0c20 admin admin] PATH_INFO: `/v3/projects/26bcce9053bd468f92688141d5bae6be` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:29.324069 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee9e8f-51a4-4434-8dfe-bef78f5c0c20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26bcce9053bd468f92688141d5bae6be)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:29.326058 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee9e8f-51a4-4434-8dfe-bef78f5c0c20 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:29.398055 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d89995-cda8-4f14-9993-b0335b104adb admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:29.403024 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ab7b7-84e6-4ca7-986f-8771dd6a58af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:29.403647 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ab7b7-84e6-4ca7-986f-8771dd6a58af admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:29.403926 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ab7b7-84e6-4ca7-986f-8771dd6a58af admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:29.404877 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ab7b7-84e6-4ca7-986f-8771dd6a58af admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:29.405917 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28ab7b7-84e6-4ca7-986f-8771dd6a58af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:29.407847 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28ab7b7-84e6-4ca7-986f-8771dd6a58af admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:29.460029 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-e5ee9e8f-51a4-4434-8dfe-bef78f5c0c20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26bcce9053bd468f92688141d5bae6be', 'request_id': 'req-e5ee9e8f-51a4-4434-8dfe-bef78f5c0c20'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:29.465919 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-e5ee9e8f-51a4-4434-8dfe-bef78f5c0c20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26bcce9053bd468f92688141d5bae6be', 'request_id': 'req-e5ee9e8f-51a4-4434-8dfe-bef78f5c0c20'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:29.473067 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-e5ee9e8f-51a4-4434-8dfe-bef78f5c0c20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26bcce9053bd468f92688141d5bae6be', 'request_id': 'req-e5ee9e8f-51a4-4434-8dfe-bef78f5c0c20'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:29.516048 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 907/1827] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:52:29 2022] POST /identity/v3/projects => generated 373 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:29.517004 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ab7b7-84e6-4ca7-986f-8771dd6a58af admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:29.518624 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-d28ab7b7-84e6-4ca7-986f-8771dd6a58af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:29.583679 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ab7b7-84e6-4ca7-986f-8771dd6a58af admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:29.587977 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-e5ee9e8f-51a4-4434-8dfe-bef78f5c0c20 admin admin] The token cache is being invalidate because project 26bcce9053bd468f92688141d5bae6be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:52:29.588272 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-e5ee9e8f-51a4-4434-8dfe-bef78f5c0c20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:29.594305 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-e5ee9e8f-51a4-4434-8dfe-bef78f5c0c20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:29.594305 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 921/1828] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:52:29 2022] DELETE /identity/v3/projects/26bcce9053bd468f92688141d5bae6be => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:29.594305 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee9e8f-51a4-4434-8dfe-bef78f5c0c20 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:29.594623 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa7ed8-5a8a-4119-9230-b745900f4498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:29.594623 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa7ed8-5a8a-4119-9230-b745900f4498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:29.594824 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-e5ee9e8f-51a4-4434-8dfe-bef78f5c0c20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:29.594909 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa7ed8-5a8a-4119-9230-b745900f4498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:29.594909 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa7ed8-5a8a-4119-9230-b745900f4498 admin admin] PATH_INFO: `/v3/users/7990f4a41aca4d78aa2509bda9a11c3c` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:29.594909 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa7ed8-5a8a-4119-9230-b745900f4498 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7990f4a41aca4d78aa2509bda9a11c3c)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:29.596576 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa7ed8-5a8a-4119-9230-b745900f4498 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:29.660178 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee9e8f-51a4-4434-8dfe-bef78f5c0c20 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:29.666327 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290f3a4-8604-439b-8f65-f30813e07f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:29.667176 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290f3a4-8604-439b-8f65-f30813e07f5f admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:29.667456 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290f3a4-8604-439b-8f65-f30813e07f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:29.667729 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290f3a4-8604-439b-8f65-f30813e07f5f admin admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:29.668360 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290f3a4-8604-439b-8f65-f30813e07f5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:29.670832 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290f3a4-8604-439b-8f65-f30813e07f5f admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:29.856722 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 922/1829] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:52:29 2022] POST /identity/v3/users => generated 293 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:29.858246 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290f3a4-8604-439b-8f65-f30813e07f5f admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:29.859870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-7290f3a4-8604-439b-8f65-f30813e07f5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:29.872033 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290f3a4-8604-439b-8f65-f30813e07f5f admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:29.877420 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84543bb1-315b-49d7-aa80-51be53f46eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:29.877955 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84543bb1-315b-49d7-aa80-51be53f46eb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:29.878234 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84543bb1-315b-49d7-aa80-51be53f46eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:29.878505 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84543bb1-315b-49d7-aa80-51be53f46eb1 admin admin] PATH_INFO: `/v3/users/4e46d8fa45d847c9a875cb998f82ae7f` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:29.884160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84543bb1-315b-49d7-aa80-51be53f46eb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e46d8fa45d847c9a875cb998f82ae7f)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:29.884160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84543bb1-315b-49d7-aa80-51be53f46eb1 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:29.967546 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-2bfa7ed8-5a8a-4119-9230-b745900f4498 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7990f4a41aca4d78aa2509bda9a11c3c'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:29.968222 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-2bfa7ed8-5a8a-4119-9230-b745900f4498 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7990f4a41aca4d78aa2509bda9a11c3c'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:30.089195 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-2bfa7ed8-5a8a-4119-9230-b745900f4498 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7990f4a41aca4d78aa2509bda9a11c3c'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:30.089976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-2bfa7ed8-5a8a-4119-9230-b745900f4498 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7990f4a41aca4d78aa2509bda9a11c3c'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:30.098682 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-2bfa7ed8-5a8a-4119-9230-b745900f4498 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7990f4a41aca4d78aa2509bda9a11c3c'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:30.120997 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 908/1830] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:52:29 2022] DELETE /identity/v3/users/7990f4a41aca4d78aa2509bda9a11c3c => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:30.120997 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa7ed8-5a8a-4119-9230-b745900f4498 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:30.120997 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-2bfa7ed8-5a8a-4119-9230-b745900f4498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:30.121321 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-84543bb1-315b-49d7-aa80-51be53f46eb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e46d8fa45d847c9a875cb998f82ae7f'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:30.128268 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-84543bb1-315b-49d7-aa80-51be53f46eb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e46d8fa45d847c9a875cb998f82ae7f'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:30.201448 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa7ed8-5a8a-4119-9230-b745900f4498 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:30.209399 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732735c-e391-4da8-afd7-7dc9de56ebca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:30.210465 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732735c-e391-4da8-afd7-7dc9de56ebca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:30.211021 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732735c-e391-4da8-afd7-7dc9de56ebca admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:30.211513 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732735c-e391-4da8-afd7-7dc9de56ebca admin admin] PATH_INFO: `/v3/projects/6f1b1e087bb2450c8b8b8108e31d9332` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:30.213389 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0732735c-e391-4da8-afd7-7dc9de56ebca admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f1b1e087bb2450c8b8b8108e31d9332)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:30.218835 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0732735c-e391-4da8-afd7-7dc9de56ebca admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:30.250948 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-84543bb1-315b-49d7-aa80-51be53f46eb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e46d8fa45d847c9a875cb998f82ae7f'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:30.251901 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-84543bb1-315b-49d7-aa80-51be53f46eb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e46d8fa45d847c9a875cb998f82ae7f'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:30.268632 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-84543bb1-315b-49d7-aa80-51be53f46eb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e46d8fa45d847c9a875cb998f82ae7f'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:30.279970 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 923/1831] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:52:29 2022] DELETE /identity/v3/users/4e46d8fa45d847c9a875cb998f82ae7f => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:30.281441 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84543bb1-315b-49d7-aa80-51be53f46eb1 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:30.284565 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-84543bb1-315b-49d7-aa80-51be53f46eb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:30.363228 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84543bb1-315b-49d7-aa80-51be53f46eb1 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:30.375069 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-0732735c-e391-4da8-afd7-7dc9de56ebca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f1b1e087bb2450c8b8b8108e31d9332', 'request_id': 'req-0732735c-e391-4da8-afd7-7dc9de56ebca'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:30.381536 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-0732735c-e391-4da8-afd7-7dc9de56ebca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f1b1e087bb2450c8b8b8108e31d9332', 'request_id': 'req-0732735c-e391-4da8-afd7-7dc9de56ebca'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:30.429962 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cef30-d69a-4495-9f69-0ddf0ce0ce1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:30.430942 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cef30-d69a-4495-9f69-0ddf0ce0ce1b admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:30.431418 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cef30-d69a-4495-9f69-0ddf0ce0ce1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:30.431691 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cef30-d69a-4495-9f69-0ddf0ce0ce1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:30.432352 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3cef30-d69a-4495-9f69-0ddf0ce0ce1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:30.434079 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3cef30-d69a-4495-9f69-0ddf0ce0ce1b admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:30.447063 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 924/1832] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:30.452910 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cef30-d69a-4495-9f69-0ddf0ce0ce1b admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:30.465352 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cef30-d69a-4495-9f69-0ddf0ce0ce1b admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:30.471672 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d86f5-779d-4ecc-85bd-b68ccfa87ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:30.472345 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d86f5-779d-4ecc-85bd-b68ccfa87ed1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:30.472652 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d86f5-779d-4ecc-85bd-b68ccfa87ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:30.472977 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d86f5-779d-4ecc-85bd-b68ccfa87ed1 admin admin] PATH_INFO: `/v3/projects/54d02ecbf8c94d1ebda98ab8e7559c55/users/70e872e0866e4999a1c0413564fafbca/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:30.495312 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d86f5-779d-4ecc-85bd-b68ccfa87ed1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54d02ecbf8c94d1ebda98ab8e7559c55, user_id=70e872e0866e4999a1c0413564fafbca, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:30.499715 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d86f5-779d-4ecc-85bd-b68ccfa87ed1 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:30.515659 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-0732735c-e391-4da8-afd7-7dc9de56ebca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f1b1e087bb2450c8b8b8108e31d9332', 'request_id': 'req-0732735c-e391-4da8-afd7-7dc9de56ebca'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:30.538023 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-0732735c-e391-4da8-afd7-7dc9de56ebca admin admin] The token cache is being invalidate because project 6f1b1e087bb2450c8b8b8108e31d9332 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:52:30.538657 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-0732735c-e391-4da8-afd7-7dc9de56ebca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:30.540239 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-0732735c-e391-4da8-afd7-7dc9de56ebca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:30.542806 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 909/1833] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:52:30 2022] DELETE /identity/v3/projects/6f1b1e087bb2450c8b8b8108e31d9332 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:30.565605 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417c104-26b3-4ed1-a3f2-c9f4f3aad08e None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:30.566063 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417c104-26b3-4ed1-a3f2-c9f4f3aad08e None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:30.566445 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417c104-26b3-4ed1-a3f2-c9f4f3aad08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:30.631617 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 925/1834] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:52:30 2022] PUT /identity/v3/projects/54d02ecbf8c94d1ebda98ab8e7559c55/users/70e872e0866e4999a1c0413564fafbca/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:30.632752 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-9417c104-26b3-4ed1-a3f2-c9f4f3aad08e None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:30.633991 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-9417c104-26b3-4ed1-a3f2-c9f4f3aad08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:30.635551 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d86f5-779d-4ecc-85bd-b68ccfa87ed1 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:30.641134 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-9d8d86f5-779d-4ecc-85bd-b68ccfa87ed1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:30.776508 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d86f5-779d-4ecc-85bd-b68ccfa87ed1 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:30.783558 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 910/1835] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:30.786526 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78720224-419e-4683-81b5-a6fa008d4346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:30.787475 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78720224-419e-4683-81b5-a6fa008d4346 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:30.787777 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78720224-419e-4683-81b5-a6fa008d4346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:30.788151 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78720224-419e-4683-81b5-a6fa008d4346 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:30.788914 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78720224-419e-4683-81b5-a6fa008d4346 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:30.790743 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78720224-419e-4683-81b5-a6fa008d4346 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:30.795741 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d9b1d-5115-4fed-980c-cd004ffdcfc6 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:30.796154 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d9b1d-5115-4fed-980c-cd004ffdcfc6 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:30.796525 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d9b1d-5115-4fed-980c-cd004ffdcfc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:30.835705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 926/1836] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:30.837887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-8e2d9b1d-5115-4fed-980c-cd004ffdcfc6 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:30.840144 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78720224-419e-4683-81b5-a6fa008d4346 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:30.842607 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-8e2d9b1d-5115-4fed-980c-cd004ffdcfc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:30.856417 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78720224-419e-4683-81b5-a6fa008d4346 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:30.862501 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a4960-5c97-484d-a044-fdded14c2032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:30.863317 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a4960-5c97-484d-a044-fdded14c2032 admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:30.863670 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a4960-5c97-484d-a044-fdded14c2032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:30.864009 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a4960-5c97-484d-a044-fdded14c2032 admin admin] PATH_INFO: `/v3/projects/54d02ecbf8c94d1ebda98ab8e7559c55/users/70e872e0866e4999a1c0413564fafbca/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:30.865855 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 911/1837] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:30.866462 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a4960-5c97-484d-a044-fdded14c2032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54d02ecbf8c94d1ebda98ab8e7559c55, user_id=70e872e0866e4999a1c0413564fafbca, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:30.869887 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a4960-5c97-484d-a044-fdded14c2032 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:30.871651 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d9b1d-5115-4fed-980c-cd004ffdcfc6 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:30.885857 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 927/1838] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:52:30 2022] PUT /identity/v3/projects/54d02ecbf8c94d1ebda98ab8e7559c55/users/70e872e0866e4999a1c0413564fafbca/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:30.899161 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d9b1d-5115-4fed-980c-cd004ffdcfc6 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:30.901272 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c73d3-4808-47ca-98c9-cdbb38cdc190 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:30.902133 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c73d3-4808-47ca-98c9-cdbb38cdc190 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:30.902133 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c73d3-4808-47ca-98c9-cdbb38cdc190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:30.944779 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-1e7c73d3-4808-47ca-98c9-cdbb38cdc190 None None] MFA Rules not processed for user `70e872e0866e4999a1c0413564fafbca`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:30.944779 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-1e7c73d3-4808-47ca-98c9-cdbb38cdc190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:30.963890 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67024687-b134-4e02-917a-fe8e00eb167f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:30.964604 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67024687-b134-4e02-917a-fe8e00eb167f admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:30.964952 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67024687-b134-4e02-917a-fe8e00eb167f admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:30.965289 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67024687-b134-4e02-917a-fe8e00eb167f admin admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:30.966006 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67024687-b134-4e02-917a-fe8e00eb167f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:52:30.966372 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67024687-b134-4e02-917a-fe8e00eb167f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:30.968424 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67024687-b134-4e02-917a-fe8e00eb167f admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:30.982891 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 912/1839] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:52:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:52:30.987264 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67024687-b134-4e02-917a-fe8e00eb167f admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:31.001159 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67024687-b134-4e02-917a-fe8e00eb167f admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:31.007030 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b5b86-51cb-4159-84a9-651c58174db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:31.007258 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b5b86-51cb-4159-84a9-651c58174db8 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:31.007590 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b5b86-51cb-4159-84a9-651c58174db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:31.018419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b5b86-51cb-4159-84a9-651c58174db8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:31.019459 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09b5b86-51cb-4159-84a9-651c58174db8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:31.021855 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09b5b86-51cb-4159-84a9-651c58174db8 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:31.114167 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 928/1840] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:30 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:31.115158 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c73d3-4808-47ca-98c9-cdbb38cdc190 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:31.116573 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-1e7c73d3-4808-47ca-98c9-cdbb38cdc190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:31.147160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c73d3-4808-47ca-98c9-cdbb38cdc190 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:31.153627 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833089f2-783f-4f5a-b655-c23c3f295de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:31.154944 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833089f2-783f-4f5a-b655-c23c3f295de3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:31.155502 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833089f2-783f-4f5a-b655-c23c3f295de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:31.155761 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833089f2-783f-4f5a-b655-c23c3f295de3 admin admin] PATH_INFO: `/v3/projects/f5ea387f18214906bfa6d8df2d715a1d` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:31.156951 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833089f2-783f-4f5a-b655-c23c3f295de3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5ea387f18214906bfa6d8df2d715a1d)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:31.158879 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833089f2-783f-4f5a-b655-c23c3f295de3 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:31.178364 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 913/1841] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:52:30 2022] POST /identity/v3/projects => generated 365 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:31.179754 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b5b86-51cb-4159-84a9-651c58174db8 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:31.181746 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-b09b5b86-51cb-4159-84a9-651c58174db8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:31.259753 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b5b86-51cb-4159-84a9-651c58174db8 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:31.265381 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412abb1c-18b8-456c-8623-731dd512959d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:31.266117 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412abb1c-18b8-456c-8623-731dd512959d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:31.266401 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412abb1c-18b8-456c-8623-731dd512959d admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:31.266781 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412abb1c-18b8-456c-8623-731dd512959d admin admin] PATH_INFO: `/v3/projects/40c5506648b34b8ab1e7cfa7850adb8b` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:31.267974 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412abb1c-18b8-456c-8623-731dd512959d admin admin] RBAC: Authorizing `identity:delete_project(project_id=40c5506648b34b8ab1e7cfa7850adb8b)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:31.270074 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412abb1c-18b8-456c-8623-731dd512959d admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:31.308170 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:52:31.309114 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-833089f2-783f-4f5a-b655-c23c3f295de3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5ea387f18214906bfa6d8df2d715a1d', 'request_id': 'req-833089f2-783f-4f5a-b655-c23c3f295de3'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:31.330554 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-833089f2-783f-4f5a-b655-c23c3f295de3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5ea387f18214906bfa6d8df2d715a1d', 'request_id': 'req-833089f2-783f-4f5a-b655-c23c3f295de3'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:31.339071 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-833089f2-783f-4f5a-b655-c23c3f295de3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5ea387f18214906bfa6d8df2d715a1d', 'request_id': 'req-833089f2-783f-4f5a-b655-c23c3f295de3'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:31.445664 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-833089f2-783f-4f5a-b655-c23c3f295de3 admin admin] The token cache is being invalidate because project f5ea387f18214906bfa6d8df2d715a1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:52:31.445952 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-833089f2-783f-4f5a-b655-c23c3f295de3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:31.446627 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-833089f2-783f-4f5a-b655-c23c3f295de3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:31.448218 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 929/1842] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:52:31 2022] DELETE /identity/v3/projects/f5ea387f18214906bfa6d8df2d715a1d => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:31.449053 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833089f2-783f-4f5a-b655-c23c3f295de3 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:31.450790 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-833089f2-783f-4f5a-b655-c23c3f295de3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:31.459199 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-412abb1c-18b8-456c-8623-731dd512959d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40c5506648b34b8ab1e7cfa7850adb8b', 'request_id': 'req-412abb1c-18b8-456c-8623-731dd512959d'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:31.464788 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-412abb1c-18b8-456c-8623-731dd512959d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40c5506648b34b8ab1e7cfa7850adb8b', 'request_id': 'req-412abb1c-18b8-456c-8623-731dd512959d'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:31.519079 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833089f2-783f-4f5a-b655-c23c3f295de3 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:31.569877 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-412abb1c-18b8-456c-8623-731dd512959d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40c5506648b34b8ab1e7cfa7850adb8b', 'request_id': 'req-412abb1c-18b8-456c-8623-731dd512959d'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:31.571330 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d100b7-d962-4539-9e93-4093aee2f2cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:31.571942 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d100b7-d962-4539-9e93-4093aee2f2cb service cinder] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:31.572217 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d100b7-d962-4539-9e93-4093aee2f2cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:31.572485 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d100b7-d962-4539-9e93-4093aee2f2cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:31.574327 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-18d100b7-d962-4539-9e93-4093aee2f2cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:31.583928 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-412abb1c-18b8-456c-8623-731dd512959d admin admin] The token cache is being invalidate because project 40c5506648b34b8ab1e7cfa7850adb8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:52:31.584377 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-412abb1c-18b8-456c-8623-731dd512959d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:31.592588 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-412abb1c-18b8-456c-8623-731dd512959d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:31.597874 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 914/1843] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:52:31 2022] DELETE /identity/v3/projects/40c5506648b34b8ab1e7cfa7850adb8b => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:31.598785 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412abb1c-18b8-456c-8623-731dd512959d admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:31.600257 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-412abb1c-18b8-456c-8623-731dd512959d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:31.669030 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d100b7-d962-4539-9e93-4093aee2f2cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:31.670627 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d100b7-d962-4539-9e93-4093aee2f2cb service cinder] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:31.682185 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 930/1844] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:52:31.683270 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d100b7-d962-4539-9e93-4093aee2f2cb service cinder] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:31.684869 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-18d100b7-d962-4539-9e93-4093aee2f2cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:31.690850 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412abb1c-18b8-456c-8623-731dd512959d admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:31.697327 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163c122-b6bb-4cf3-9e5e-90ba0f762d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:31.697973 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163c122-b6bb-4cf3-9e5e-90ba0f762d10 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:31.698331 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163c122-b6bb-4cf3-9e5e-90ba0f762d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:31.698609 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163c122-b6bb-4cf3-9e5e-90ba0f762d10 admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:31.699340 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7163c122-b6bb-4cf3-9e5e-90ba0f762d10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:31.701952 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7163c122-b6bb-4cf3-9e5e-90ba0f762d10 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:31.703653 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d100b7-d962-4539-9e93-4093aee2f2cb service cinder] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:31.709490 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe1c5ba-bc1e-4616-af70-d4f2ac01270a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:31.709838 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1c5ba-bc1e-4616-af70-d4f2ac01270a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:31.710122 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1c5ba-bc1e-4616-af70-d4f2ac01270a admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:31.719711 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1c5ba-bc1e-4616-af70-d4f2ac01270a admin admin] PATH_INFO: `/v3/users/4dfe4dad6c944c88a88b17271f447c22` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:31.719711 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe1c5ba-bc1e-4616-af70-d4f2ac01270a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dfe4dad6c944c88a88b17271f447c22)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:31.719711 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe1c5ba-bc1e-4616-af70-d4f2ac01270a admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:31.888424 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 915/1845] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:52:31 2022] POST /identity/v3/users => generated 283 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:31.888424 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe4a76-292a-46f0-88dc-ee90e4b9ac1e None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:31.888424 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe4a76-292a-46f0-88dc-ee90e4b9ac1e None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:31.889282 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe4a76-292a-46f0-88dc-ee90e4b9ac1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:31.930915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-81fe4a76-292a-46f0-88dc-ee90e4b9ac1e None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:31.932503 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-81fe4a76-292a-46f0-88dc-ee90e4b9ac1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:31.949952 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 916/1846] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:31.959206 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe4a76-292a-46f0-88dc-ee90e4b9ac1e None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:31.969491 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe4a76-292a-46f0-88dc-ee90e4b9ac1e None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:31.980124 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51891bc-0a22-451b-8322-0c9dc396b14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:31.980581 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51891bc-0a22-451b-8322-0c9dc396b14e admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:31.980863 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51891bc-0a22-451b-8322-0c9dc396b14e admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:31.981141 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51891bc-0a22-451b-8322-0c9dc396b14e admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:31.981798 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51891bc-0a22-451b-8322-0c9dc396b14e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:31.984974 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51891bc-0a22-451b-8322-0c9dc396b14e admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:32.004449 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 917/1847] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:32.005916 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6d2a7-87a4-42b9-aae4-3def0b62c852 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:32.006235 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6d2a7-87a4-42b9-aae4-3def0b62c852 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:32.012986 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6d2a7-87a4-42b9-aae4-3def0b62c852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:32.028787 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-d8a6d2a7-87a4-42b9-aae4-3def0b62c852 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:32.031349 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-d8a6d2a7-87a4-42b9-aae4-3def0b62c852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:32.046516 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 918/1848] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:32.047436 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a6d2a7-87a4-42b9-aae4-3def0b62c852 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:32.058178 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a6d2a7-87a4-42b9-aae4-3def0b62c852 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:32.063812 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144d1c6-ef05-4006-895c-ee45dd1b2263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:32.065308 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144d1c6-ef05-4006-895c-ee45dd1b2263 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:32.065597 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144d1c6-ef05-4006-895c-ee45dd1b2263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:32.065875 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144d1c6-ef05-4006-895c-ee45dd1b2263 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:32.066631 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2144d1c6-ef05-4006-895c-ee45dd1b2263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:32.068530 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2144d1c6-ef05-4006-895c-ee45dd1b2263 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:32.082231 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 919/1849] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:32.083829 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144d1c6-ef05-4006-895c-ee45dd1b2263 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:32.096353 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144d1c6-ef05-4006-895c-ee45dd1b2263 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:32.101403 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725dc0bd-7b3c-48b6-9015-c20b7479a66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:32.102502 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725dc0bd-7b3c-48b6-9015-c20b7479a66d admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:32.102502 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725dc0bd-7b3c-48b6-9015-c20b7479a66d admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:32.102780 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725dc0bd-7b3c-48b6-9015-c20b7479a66d admin admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:32.103470 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725dc0bd-7b3c-48b6-9015-c20b7479a66d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:52:32.103778 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725dc0bd-7b3c-48b6-9015-c20b7479a66d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:32.105922 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725dc0bd-7b3c-48b6-9015-c20b7479a66d admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:32.120220 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 920/1850] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:52:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:52:32.120888 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725dc0bd-7b3c-48b6-9015-c20b7479a66d admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:32.132083 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725dc0bd-7b3c-48b6-9015-c20b7479a66d admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:32.137712 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54ccbb-00fc-4781-bc5d-ee72571e8c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:32.138910 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54ccbb-00fc-4781-bc5d-ee72571e8c20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:32.139224 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54ccbb-00fc-4781-bc5d-ee72571e8c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:32.139502 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54ccbb-00fc-4781-bc5d-ee72571e8c20 admin admin] PATH_INFO: `/v3/projects/9c121375ac1548e18d6416217b28136d/users/fee0ea68a41348939d2965f3abbdb7b4/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:32.160903 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d54ccbb-00fc-4781-bc5d-ee72571e8c20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c121375ac1548e18d6416217b28136d, user_id=fee0ea68a41348939d2965f3abbdb7b4, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:32.163690 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d54ccbb-00fc-4781-bc5d-ee72571e8c20 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:32.171220 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-9fe1c5ba-bc1e-4616-af70-d4f2ac01270a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dfe4dad6c944c88a88b17271f447c22'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:32.178301 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-9fe1c5ba-bc1e-4616-af70-d4f2ac01270a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dfe4dad6c944c88a88b17271f447c22'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:32.313598 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-9fe1c5ba-bc1e-4616-af70-d4f2ac01270a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dfe4dad6c944c88a88b17271f447c22'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:32.314490 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-9fe1c5ba-bc1e-4616-af70-d4f2ac01270a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dfe4dad6c944c88a88b17271f447c22'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:32.336123 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 921/1851] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:52:32 2022] PUT /identity/v3/projects/9c121375ac1548e18d6416217b28136d/users/fee0ea68a41348939d2965f3abbdb7b4/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:32.337898 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54ccbb-00fc-4781-bc5d-ee72571e8c20 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:32.339664 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-8d54ccbb-00fc-4781-bc5d-ee72571e8c20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:32.343777 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-9fe1c5ba-bc1e-4616-af70-d4f2ac01270a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dfe4dad6c944c88a88b17271f447c22'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:32.352373 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 931/1852] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:52:31 2022] DELETE /identity/v3/users/4dfe4dad6c944c88a88b17271f447c22 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:32.353864 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add829e6-6332-44e2-82f1-d418ab386dcc None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:32.354152 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add829e6-6332-44e2-82f1-d418ab386dcc None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:32.354458 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add829e6-6332-44e2-82f1-d418ab386dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:32.473068 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-add829e6-6332-44e2-82f1-d418ab386dcc None None] MFA Rules not processed for user `fee0ea68a41348939d2965f3abbdb7b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:32.474708 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-add829e6-6332-44e2-82f1-d418ab386dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:32.480407 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54ccbb-00fc-4781-bc5d-ee72571e8c20 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:32.581339 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0aad23-4eae-4fd5-af0c-f60d12cf90e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:32.582078 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0aad23-4eae-4fd5-af0c-f60d12cf90e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:32.582542 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0aad23-4eae-4fd5-af0c-f60d12cf90e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:32.583111 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0aad23-4eae-4fd5-af0c-f60d12cf90e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:32.583840 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0aad23-4eae-4fd5-af0c-f60d12cf90e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:32.587014 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0aad23-4eae-4fd5-af0c-f60d12cf90e7 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:32.599571 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 932/1853] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:32.600629 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add829e6-6332-44e2-82f1-d418ab386dcc None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:32.602048 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-add829e6-6332-44e2-82f1-d418ab386dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:32.617171 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add829e6-6332-44e2-82f1-d418ab386dcc None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:32.621993 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37adb319-3336-4ec4-b24c-1d42ff2b4bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:32.622638 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37adb319-3336-4ec4-b24c-1d42ff2b4bc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:32.622950 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37adb319-3336-4ec4-b24c-1d42ff2b4bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:32.623308 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37adb319-3336-4ec4-b24c-1d42ff2b4bc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:32.624104 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37adb319-3336-4ec4-b24c-1d42ff2b4bc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:32.626017 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37adb319-3336-4ec4-b24c-1d42ff2b4bc7 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:33.055842 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:52:33.067190 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 933/1854] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:52:32 2022] POST /identity/v3/projects => generated 365 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:33.067325 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 922/1855] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:52:32 2022] POST /identity/v3/projects => generated 379 bytes in 729 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:33.069950 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37adb319-3336-4ec4-b24c-1d42ff2b4bc7 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:33.070499 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0aad23-4eae-4fd5-af0c-f60d12cf90e7 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:33.187904 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37adb319-3336-4ec4-b24c-1d42ff2b4bc7 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:33.209911 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0aad23-4eae-4fd5-af0c-f60d12cf90e7 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:33.216693 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86122652-f0e1-4fd9-88c2-264ffcbc8b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:33.218273 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86122652-f0e1-4fd9-88c2-264ffcbc8b71 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:33.218273 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86122652-f0e1-4fd9-88c2-264ffcbc8b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:33.218545 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86122652-f0e1-4fd9-88c2-264ffcbc8b71 admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:33.220060 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86122652-f0e1-4fd9-88c2-264ffcbc8b71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:33.223306 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86122652-f0e1-4fd9-88c2-264ffcbc8b71 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:33.290883 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:52:33.295412 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c38dc-c158-4cc3-995a-e53024327af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:33.296549 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c38dc-c158-4cc3-995a-e53024327af5 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:33.296948 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c38dc-c158-4cc3-995a-e53024327af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:33.297335 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c38dc-c158-4cc3-995a-e53024327af5 admin admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:33.298104 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4c38dc-c158-4cc3-995a-e53024327af5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:33.300301 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4c38dc-c158-4cc3-995a-e53024327af5 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:33.354635 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 923/1856] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:52:33 2022] POST /identity/v3/users => generated 290 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:33.360157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86122652-f0e1-4fd9-88c2-264ffcbc8b71 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:33.377429 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86122652-f0e1-4fd9-88c2-264ffcbc8b71 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:33.379491 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c35766-71a1-4601-964f-43e9aff2ca0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:33.380209 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c35766-71a1-4601-964f-43e9aff2ca0d admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:33.380537 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c35766-71a1-4601-964f-43e9aff2ca0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:33.380827 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c35766-71a1-4601-964f-43e9aff2ca0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:33.381490 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c35766-71a1-4601-964f-43e9aff2ca0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:33.383861 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c35766-71a1-4601-964f-43e9aff2ca0d admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:33.402428 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 924/1857] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 07:52:33.406765 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c35766-71a1-4601-964f-43e9aff2ca0d admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:33.417203 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c35766-71a1-4601-964f-43e9aff2ca0d admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:33.422491 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d28e8b-7f72-432e-9278-4b1247c0e38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:33.423160 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d28e8b-7f72-432e-9278-4b1247c0e38d admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:33.423445 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d28e8b-7f72-432e-9278-4b1247c0e38d admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:33.423723 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d28e8b-7f72-432e-9278-4b1247c0e38d admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:33.425089 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d28e8b-7f72-432e-9278-4b1247c0e38d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:33.426784 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d28e8b-7f72-432e-9278-4b1247c0e38d admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:33.438945 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 925/1858] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:33.443316 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d28e8b-7f72-432e-9278-4b1247c0e38d admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:33.454297 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d28e8b-7f72-432e-9278-4b1247c0e38d admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:33.459292 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07f137-eb91-44ab-8968-89d84d43dc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:33.460101 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07f137-eb91-44ab-8968-89d84d43dc07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:33.460491 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07f137-eb91-44ab-8968-89d84d43dc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:33.460837 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07f137-eb91-44ab-8968-89d84d43dc07 admin admin] PATH_INFO: `/v3/projects/b06d3c8ddbe7491782f34a3c2af519aa/users/e81b67cc01d34a0aac9d32f3be8099af/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:33.469036 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 934/1859] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:52:33 2022] POST /identity/v3/users => generated 289 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:33.472998 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c38dc-c158-4cc3-995a-e53024327af5 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:33.482484 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07f137-eb91-44ab-8968-89d84d43dc07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b06d3c8ddbe7491782f34a3c2af519aa, user_id=e81b67cc01d34a0aac9d32f3be8099af, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:33.484077 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c38dc-c158-4cc3-995a-e53024327af5 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:33.485919 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07f137-eb91-44ab-8968-89d84d43dc07 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:33.488916 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f296689-1382-4a25-9270-2ec6b56cbb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:33.489524 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f296689-1382-4a25-9270-2ec6b56cbb1e admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:33.489804 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f296689-1382-4a25-9270-2ec6b56cbb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:33.490073 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f296689-1382-4a25-9270-2ec6b56cbb1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:33.490751 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f296689-1382-4a25-9270-2ec6b56cbb1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:33.492408 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f296689-1382-4a25-9270-2ec6b56cbb1e admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:33.503658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 935/1860] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:33.507897 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f296689-1382-4a25-9270-2ec6b56cbb1e admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:33.518632 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f296689-1382-4a25-9270-2ec6b56cbb1e admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:33.523522 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64970366-9d85-4a4a-a871-e1073c61cc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:33.523919 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64970366-9d85-4a4a-a871-e1073c61cc73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:33.524203 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64970366-9d85-4a4a-a871-e1073c61cc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:33.524480 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64970366-9d85-4a4a-a871-e1073c61cc73 admin admin] PATH_INFO: `/v3/projects/d0887e2dd8ec49deab33716babd69cd4/users/df75ca2b0fc64801abe1d61ded0b0762/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:33.550433 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64970366-9d85-4a4a-a871-e1073c61cc73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0887e2dd8ec49deab33716babd69cd4, user_id=df75ca2b0fc64801abe1d61ded0b0762, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:33.553533 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64970366-9d85-4a4a-a871-e1073c61cc73 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:33.605654 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 926/1861] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:52:33 2022] PUT /identity/v3/projects/b06d3c8ddbe7491782f34a3c2af519aa/users/e81b67cc01d34a0aac9d32f3be8099af/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:52:33.608987 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07f137-eb91-44ab-8968-89d84d43dc07 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:33.608987 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-6c07f137-eb91-44ab-8968-89d84d43dc07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:33.652261 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 936/1862] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:52:33 2022] PUT /identity/v3/projects/d0887e2dd8ec49deab33716babd69cd4/users/df75ca2b0fc64801abe1d61ded0b0762/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:52:33.653708 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fa9b2-4a1b-4b14-bda1-f7823edd4be2 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:33.664488 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fa9b2-4a1b-4b14-bda1-f7823edd4be2 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:33.664488 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fa9b2-4a1b-4b14-bda1-f7823edd4be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:33.683338 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07f137-eb91-44ab-8968-89d84d43dc07 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:33.692739 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-fe6fa9b2-4a1b-4b14-bda1-f7823edd4be2 None None] MFA Rules not processed for user `e81b67cc01d34a0aac9d32f3be8099af`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:33.694184 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-fe6fa9b2-4a1b-4b14-bda1-f7823edd4be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:33.779665 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d5459-931e-4b98-9d93-327a0ed8a809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:33.779665 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d5459-931e-4b98-9d93-327a0ed8a809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:33.779665 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d5459-931e-4b98-9d93-327a0ed8a809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:33.779665 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d5459-931e-4b98-9d93-327a0ed8a809 admin admin] PATH_INFO: `/v3/projects/ed40d94a6e1d4fde9df37bf0170f6ea5` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:33.780037 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d5459-931e-4b98-9d93-327a0ed8a809 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed40d94a6e1d4fde9df37bf0170f6ea5)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:33.786941 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d5459-931e-4b98-9d93-327a0ed8a809 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:33.801555 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 937/1863] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:33.802399 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6fa9b2-4a1b-4b14-bda1-f7823edd4be2 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:33.816953 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6fa9b2-4a1b-4b14-bda1-f7823edd4be2 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:33.824823 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6543f-551b-4cde-a181-b8075112e18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:33.825495 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6543f-551b-4cde-a181-b8075112e18f admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:33.826782 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6543f-551b-4cde-a181-b8075112e18f admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:33.827273 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6543f-551b-4cde-a181-b8075112e18f admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:33.828082 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b6543f-551b-4cde-a181-b8075112e18f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:33.829937 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b6543f-551b-4cde-a181-b8075112e18f admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:33.841574 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 938/1864] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:33.843046 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6543f-551b-4cde-a181-b8075112e18f admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:33.845036 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-f5b6543f-551b-4cde-a181-b8075112e18f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:33.858655 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6543f-551b-4cde-a181-b8075112e18f admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:33.863400 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a0721-c2a1-4332-82a4-f8766abcb95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:33.864033 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a0721-c2a1-4332-82a4-f8766abcb95c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:33.864316 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a0721-c2a1-4332-82a4-f8766abcb95c admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:33.864589 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a0721-c2a1-4332-82a4-f8766abcb95c admin admin] PATH_INFO: `/v3/users/4f96737113d14aa8b50e676e92d403a1` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:33.866033 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223a0721-c2a1-4332-82a4-f8766abcb95c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f96737113d14aa8b50e676e92d403a1)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:33.868586 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223a0721-c2a1-4332-82a4-f8766abcb95c admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:33.948101 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-6b9d5459-931e-4b98-9d93-327a0ed8a809 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed40d94a6e1d4fde9df37bf0170f6ea5', 'request_id': 'req-6b9d5459-931e-4b98-9d93-327a0ed8a809'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:33.954048 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-6b9d5459-931e-4b98-9d93-327a0ed8a809 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed40d94a6e1d4fde9df37bf0170f6ea5', 'request_id': 'req-6b9d5459-931e-4b98-9d93-327a0ed8a809'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:34.370587 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-6b9d5459-931e-4b98-9d93-327a0ed8a809 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed40d94a6e1d4fde9df37bf0170f6ea5', 'request_id': 'req-6b9d5459-931e-4b98-9d93-327a0ed8a809'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:34.385854 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-6b9d5459-931e-4b98-9d93-327a0ed8a809 admin admin] The token cache is being invalidate because project ed40d94a6e1d4fde9df37bf0170f6ea5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:52:34.386156 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-6b9d5459-931e-4b98-9d93-327a0ed8a809 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:34.386924 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-6b9d5459-931e-4b98-9d93-327a0ed8a809 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:34.388887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 927/1865] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:52:33 2022] DELETE /identity/v3/projects/ed40d94a6e1d4fde9df37bf0170f6ea5 => generated 0 bytes in 782 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:34.389627 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d5459-931e-4b98-9d93-327a0ed8a809 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:34.391105 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-6b9d5459-931e-4b98-9d93-327a0ed8a809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:34.459476 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d5459-931e-4b98-9d93-327a0ed8a809 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:34.464645 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f2caaf-b7a2-44d2-a814-3d17c2a10e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:34.465275 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2caaf-b7a2-44d2-a814-3d17c2a10e79 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:34.465559 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2caaf-b7a2-44d2-a814-3d17c2a10e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:34.465834 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2caaf-b7a2-44d2-a814-3d17c2a10e79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:34.466574 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f2caaf-b7a2-44d2-a814-3d17c2a10e79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:34.468702 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f2caaf-b7a2-44d2-a814-3d17c2a10e79 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:34.533489 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-223a0721-c2a1-4332-82a4-f8766abcb95c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f96737113d14aa8b50e676e92d403a1'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:34.540290 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-223a0721-c2a1-4332-82a4-f8766abcb95c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f96737113d14aa8b50e676e92d403a1'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:34.653428 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 928/1866] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:52:34 2022] POST /identity/v3/projects => generated 379 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:34.655146 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f2caaf-b7a2-44d2-a814-3d17c2a10e79 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:34.660500 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-57f2caaf-b7a2-44d2-a814-3d17c2a10e79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:34.729793 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f2caaf-b7a2-44d2-a814-3d17c2a10e79 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:34.736259 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9111b6d-2529-41f1-beb5-e536898786c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:34.736936 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9111b6d-2529-41f1-beb5-e536898786c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:34.737219 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9111b6d-2529-41f1-beb5-e536898786c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:34.737499 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9111b6d-2529-41f1-beb5-e536898786c5 admin admin] PATH_INFO: `/v3/projects/d0887e2dd8ec49deab33716babd69cd4/users/df75ca2b0fc64801abe1d61ded0b0762/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:34.739481 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9111b6d-2529-41f1-beb5-e536898786c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0887e2dd8ec49deab33716babd69cd4, user_id=df75ca2b0fc64801abe1d61ded0b0762, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:34.742170 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-223a0721-c2a1-4332-82a4-f8766abcb95c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f96737113d14aa8b50e676e92d403a1'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:34.742335 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9111b6d-2529-41f1-beb5-e536898786c5 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:34.742867 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-223a0721-c2a1-4332-82a4-f8766abcb95c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f96737113d14aa8b50e676e92d403a1'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:34.757087 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 929/1867] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:52:34 2022] PUT /identity/v3/projects/d0887e2dd8ec49deab33716babd69cd4/users/df75ca2b0fc64801abe1d61ded0b0762/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:34.757896 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-223a0721-c2a1-4332-82a4-f8766abcb95c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f96737113d14aa8b50e676e92d403a1'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:34.761457 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847fa80-b168-4f79-8397-b928eb798934 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:34.761753 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847fa80-b168-4f79-8397-b928eb798934 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:34.762222 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847fa80-b168-4f79-8397-b928eb798934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:34.772579 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 939/1868] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:52:33 2022] DELETE /identity/v3/users/4f96737113d14aa8b50e676e92d403a1 => generated 0 bytes in 930 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:34.773676 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a0721-c2a1-4332-82a4-f8766abcb95c admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:34.775412 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-223a0721-c2a1-4332-82a4-f8766abcb95c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:34.792010 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-3847fa80-b168-4f79-8397-b928eb798934 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:34.792010 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-3847fa80-b168-4f79-8397-b928eb798934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:34.858365 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 930/1869] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:34.860311 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2ce60-5682-4ef8-810c-79080096052f None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:34.860435 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a0721-c2a1-4332-82a4-f8766abcb95c admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:34.860842 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2ce60-5682-4ef8-810c-79080096052f None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:34.861348 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2ce60-5682-4ef8-810c-79080096052f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:34.871480 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84d9fa-b301-4d39-8799-b3913cd9d788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:34.872586 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84d9fa-b301-4d39-8799-b3913cd9d788 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:34.872586 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84d9fa-b301-4d39-8799-b3913cd9d788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:34.872958 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84d9fa-b301-4d39-8799-b3913cd9d788 admin admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:34.873615 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84d9fa-b301-4d39-8799-b3913cd9d788 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:34.875641 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84d9fa-b301-4d39-8799-b3913cd9d788 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:34.896205 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-eef2ce60-5682-4ef8-810c-79080096052f None None] MFA Rules not processed for user `df75ca2b0fc64801abe1d61ded0b0762`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:34.897452 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-eef2ce60-5682-4ef8-810c-79080096052f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:34.994613 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 940/1870] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:52:34 2022] POST /identity/v3/users => generated 296 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:34.997078 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e9309-9db9-4d15-af05-fd80abd33283 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:34.997830 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e9309-9db9-4d15-af05-fd80abd33283 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:34.998315 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e9309-9db9-4d15-af05-fd80abd33283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:35.013935 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 931/1871] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:34 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:35.013935 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a474d98-4928-4bec-95e3-e7c9222c69e9 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:35.013935 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a474d98-4928-4bec-95e3-e7c9222c69e9 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:35.013935 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a474d98-4928-4bec-95e3-e7c9222c69e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:35.023578 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-793e9309-9db9-4d15-af05-fd80abd33283 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:35.024928 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-793e9309-9db9-4d15-af05-fd80abd33283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:35.034828 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 941/1872] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:35.035870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e9309-9db9-4d15-af05-fd80abd33283 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:35.045026 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-5a474d98-4928-4bec-95e3-e7c9222c69e9 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:35.046389 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-5a474d98-4928-4bec-95e3-e7c9222c69e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:35.049028 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e9309-9db9-4d15-af05-fd80abd33283 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:35.054030 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983582af-51b4-4d71-b69a-f899bbda74b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:35.054759 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983582af-51b4-4d71-b69a-f899bbda74b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:35.055137 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983582af-51b4-4d71-b69a-f899bbda74b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:35.055480 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983582af-51b4-4d71-b69a-f899bbda74b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:35.056279 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983582af-51b4-4d71-b69a-f899bbda74b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:35.057758 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 932/1873] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:35.058145 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983582af-51b4-4d71-b69a-f899bbda74b1 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:35.059366 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a474d98-4928-4bec-95e3-e7c9222c69e9 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:35.061170 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-5a474d98-4928-4bec-95e3-e7c9222c69e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:35.076410 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 942/1874] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:35.076410 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983582af-51b4-4d71-b69a-f899bbda74b1 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:35.076410 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-983582af-51b4-4d71-b69a-f899bbda74b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:35.136616 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a474d98-4928-4bec-95e3-e7c9222c69e9 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:35.141141 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bea378-ffc0-4212-aae1-a94856286b27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:35.142095 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bea378-ffc0-4212-aae1-a94856286b27 service cinder] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:35.142472 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bea378-ffc0-4212-aae1-a94856286b27 service cinder] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:35.142869 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bea378-ffc0-4212-aae1-a94856286b27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:35.144412 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983582af-51b4-4d71-b69a-f899bbda74b1 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:35.148158 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc4557-94d1-4660-99c1-1ab67cc5ecb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:35.148862 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc4557-94d1-4660-99c1-1ab67cc5ecb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:35.153455 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc4557-94d1-4660-99c1-1ab67cc5ecb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:35.153455 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc4557-94d1-4660-99c1-1ab67cc5ecb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:35.155487 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bea378-ffc0-4212-aae1-a94856286b27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:35.157227 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bea378-ffc0-4212-aae1-a94856286b27 service cinder] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:35.160381 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc4557-94d1-4660-99c1-1ab67cc5ecb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:35.161803 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc4557-94d1-4660-99c1-1ab67cc5ecb3 service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:35.170064 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 933/1875] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:35 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:52:35.170958 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bea378-ffc0-4212-aae1-a94856286b27 service cinder] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:35.171564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 943/1876] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:52:35.172354 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc4557-94d1-4660-99c1-1ab67cc5ecb3 service neutron] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:35.182387 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc4557-94d1-4660-99c1-1ab67cc5ecb3 service neutron] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:35.186905 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bea378-ffc0-4212-aae1-a94856286b27 service cinder] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:35.188883 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a978c-c54d-4196-825a-77b43a3e36c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:35.189723 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a978c-c54d-4196-825a-77b43a3e36c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:35.190166 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a978c-c54d-4196-825a-77b43a3e36c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:35.190582 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a978c-c54d-4196-825a-77b43a3e36c5 admin admin] PATH_INFO: `/v3/projects/83609a80d1564fb09dd059b5914497e6/users/c4dcc09172ce451d9be3d7071f354236/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:35.195414 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13722aa6-237e-41ae-b5b0-1955177d05c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:35.196049 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13722aa6-237e-41ae-b5b0-1955177d05c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:35.196341 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13722aa6-237e-41ae-b5b0-1955177d05c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:35.196606 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13722aa6-237e-41ae-b5b0-1955177d05c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:35.197479 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13722aa6-237e-41ae-b5b0-1955177d05c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:52:35.197869 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13722aa6-237e-41ae-b5b0-1955177d05c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:35.200514 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13722aa6-237e-41ae-b5b0-1955177d05c2 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:35.207859 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a978c-c54d-4196-825a-77b43a3e36c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83609a80d1564fb09dd059b5914497e6, user_id=c4dcc09172ce451d9be3d7071f354236, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:35.210570 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a978c-c54d-4196-825a-77b43a3e36c5 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:35.217531 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 934/1877] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:52:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:52:35.221814 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13722aa6-237e-41ae-b5b0-1955177d05c2 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:35.232560 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13722aa6-237e-41ae-b5b0-1955177d05c2 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:35.237660 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c5b78-e75c-446b-b112-e4c189695717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:35.238276 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c5b78-e75c-446b-b112-e4c189695717 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:35.238559 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c5b78-e75c-446b-b112-e4c189695717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:35.238834 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c5b78-e75c-446b-b112-e4c189695717 admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:35.239504 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611c5b78-e75c-446b-b112-e4c189695717 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:35.241405 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611c5b78-e75c-446b-b112-e4c189695717 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:35.315082 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 944/1878] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:52:35 2022] PUT /identity/v3/projects/83609a80d1564fb09dd059b5914497e6/users/c4dcc09172ce451d9be3d7071f354236/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:35.319659 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a978c-c54d-4196-825a-77b43a3e36c5 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:35.384671 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a978c-c54d-4196-825a-77b43a3e36c5 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:35.388846 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 935/1879] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:52:35 2022] POST /identity/v3/projects => generated 391 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 07:52:35.390150 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc02e26-69ec-4fc9-9c2f-215fd3ba715e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:35.390774 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc02e26-69ec-4fc9-9c2f-215fd3ba715e admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:35.391084 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc02e26-69ec-4fc9-9c2f-215fd3ba715e admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:35.391362 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc02e26-69ec-4fc9-9c2f-215fd3ba715e admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:35.392065 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc02e26-69ec-4fc9-9c2f-215fd3ba715e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:35.392915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c5b78-e75c-446b-b112-e4c189695717 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:35.393640 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc02e26-69ec-4fc9-9c2f-215fd3ba715e admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:35.405509 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 945/1880] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 07:52:35.409760 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc02e26-69ec-4fc9-9c2f-215fd3ba715e admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:35.420708 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc02e26-69ec-4fc9-9c2f-215fd3ba715e admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:35.460054 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c5b78-e75c-446b-b112-e4c189695717 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:35.465538 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3217d-ab64-4f50-86d5-126368b7fe9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:35.466817 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3217d-ab64-4f50-86d5-126368b7fe9b admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:35.466817 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3217d-ab64-4f50-86d5-126368b7fe9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:35.467327 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3217d-ab64-4f50-86d5-126368b7fe9b admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:35.468449 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca3217d-ab64-4f50-86d5-126368b7fe9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:35.470441 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca3217d-ab64-4f50-86d5-126368b7fe9b admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:35.481702 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad8101-ed39-4fc8-a20e-4fc861f907b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:35.485751 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad8101-ed39-4fc8-a20e-4fc861f907b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:35.486038 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad8101-ed39-4fc8-a20e-4fc861f907b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:35.486869 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad8101-ed39-4fc8-a20e-4fc861f907b5 admin admin] PATH_INFO: `/v3/projects/83609a80d1564fb09dd059b5914497e6/users/c4dcc09172ce451d9be3d7071f354236/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:35.489970 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ad8101-ed39-4fc8-a20e-4fc861f907b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83609a80d1564fb09dd059b5914497e6, user_id=c4dcc09172ce451d9be3d7071f354236, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:35.499323 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ad8101-ed39-4fc8-a20e-4fc861f907b5 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:35.506377 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 946/1881] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:52:35 2022] PUT /identity/v3/projects/83609a80d1564fb09dd059b5914497e6/users/c4dcc09172ce451d9be3d7071f354236/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:52:35.516142 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad8101-ed39-4fc8-a20e-4fc861f907b5 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:35.554182 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 936/1882] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:52:35 2022] POST /identity/v3/users => generated 296 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 07:52:35.554182 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3070ebd-6456-43ee-8904-ed6e926858b8 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:35.554182 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3070ebd-6456-43ee-8904-ed6e926858b8 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:35.554182 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3070ebd-6456-43ee-8904-ed6e926858b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:35.597948 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-f3070ebd-6456-43ee-8904-ed6e926858b8 None None] MFA Rules not processed for user `c4dcc09172ce451d9be3d7071f354236`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:35.599345 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-f3070ebd-6456-43ee-8904-ed6e926858b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:35.613324 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad8101-ed39-4fc8-a20e-4fc861f907b5 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:35.621779 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7eba78-de16-46a6-a8c9-72b74fce31f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:35.622561 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7eba78-de16-46a6-a8c9-72b74fce31f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:35.622857 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7eba78-de16-46a6-a8c9-72b74fce31f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:35.623174 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7eba78-de16-46a6-a8c9-72b74fce31f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:35.625769 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-ed7eba78-de16-46a6-a8c9-72b74fce31f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:35.695699 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7eba78-de16-46a6-a8c9-72b74fce31f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:35.697129 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7eba78-de16-46a6-a8c9-72b74fce31f7 service cinder] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:35.703059 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 937/1883] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:35 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:35.704039 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3070ebd-6456-43ee-8904-ed6e926858b8 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:35.711528 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 947/1884] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:52:35.717219 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7eba78-de16-46a6-a8c9-72b74fce31f7 service cinder] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:35.719009 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-ed7eba78-de16-46a6-a8c9-72b74fce31f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:35.731606 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7eba78-de16-46a6-a8c9-72b74fce31f7 service cinder] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:35.735590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33b5a7-56cf-4721-8a49-6374ac03f8f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:35.736281 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33b5a7-56cf-4721-8a49-6374ac03f8f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:35.736568 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33b5a7-56cf-4721-8a49-6374ac03f8f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:35.736847 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33b5a7-56cf-4721-8a49-6374ac03f8f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:35.746754 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac33b5a7-56cf-4721-8a49-6374ac03f8f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:35.748199 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac33b5a7-56cf-4721-8a49-6374ac03f8f3 service cinder] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:35.763042 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 948/1885] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:35 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 07:52:35.786126 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3070ebd-6456-43ee-8904-ed6e926858b8 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:35.790870 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369a6f4-975a-4125-a981-e26bc4bbf0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:35.791513 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369a6f4-975a-4125-a981-e26bc4bbf0b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:35.791798 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369a6f4-975a-4125-a981-e26bc4bbf0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:35.792074 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369a6f4-975a-4125-a981-e26bc4bbf0b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:35.792735 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369a6f4-975a-4125-a981-e26bc4bbf0b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:35.794339 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369a6f4-975a-4125-a981-e26bc4bbf0b3 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:35.805761 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 938/1886] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:35.810155 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33b5a7-56cf-4721-8a49-6374ac03f8f3 service cinder] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:35.820059 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369a6f4-975a-4125-a981-e26bc4bbf0b3 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:35.822383 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-1369a6f4-975a-4125-a981-e26bc4bbf0b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:35.838620 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33b5a7-56cf-4721-8a49-6374ac03f8f3 service cinder] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:35.845579 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5763b4-39f7-42e5-8941-c35e606b0d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:35.846212 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5763b4-39f7-42e5-8941-c35e606b0d64 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:35.846454 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5763b4-39f7-42e5-8941-c35e606b0d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:35.846716 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5763b4-39f7-42e5-8941-c35e606b0d64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:35.847522 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5763b4-39f7-42e5-8941-c35e606b0d64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:35.849278 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5763b4-39f7-42e5-8941-c35e606b0d64 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:35.858174 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369a6f4-975a-4125-a981-e26bc4bbf0b3 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:35.863021 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 949/1887] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:35.863632 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad6c58-eeb6-4d43-a1f2-e65da6190b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:35.864373 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad6c58-eeb6-4d43-a1f2-e65da6190b72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:35.864659 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad6c58-eeb6-4d43-a1f2-e65da6190b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:35.864940 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad6c58-eeb6-4d43-a1f2-e65da6190b72 admin admin] PATH_INFO: `/v3/projects/128b154b3286498cbffe5682c82531bc` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:35.866377 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5763b4-39f7-42e5-8941-c35e606b0d64 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:35.866494 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad6c58-eeb6-4d43-a1f2-e65da6190b72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=128b154b3286498cbffe5682c82531bc)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:35.868414 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad6c58-eeb6-4d43-a1f2-e65da6190b72 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:35.877945 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5763b4-39f7-42e5-8941-c35e606b0d64 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:35.882803 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54a539-91d5-427f-9953-7158c70379fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:35.891600 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54a539-91d5-427f-9953-7158c70379fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:35.891600 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54a539-91d5-427f-9953-7158c70379fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:35.891600 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54a539-91d5-427f-9953-7158c70379fa admin admin] PATH_INFO: `/v3/projects/33b178342c9c4e60a0189507a1038ac6/users/48895a681ad94a6db93a85c1d5ced7dc/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:35.907270 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b54a539-91d5-427f-9953-7158c70379fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=33b178342c9c4e60a0189507a1038ac6, user_id=48895a681ad94a6db93a85c1d5ced7dc, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:35.916176 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b54a539-91d5-427f-9953-7158c70379fa admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:36.060107 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 950/1888] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:52:35 2022] PUT /identity/v3/projects/33b178342c9c4e60a0189507a1038ac6/users/48895a681ad94a6db93a85c1d5ced7dc/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:52:36.078832 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c7516-10b2-4039-a407-c63e2e891f9f None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:36.079209 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c7516-10b2-4039-a407-c63e2e891f9f None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:36.079513 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c7516-10b2-4039-a407-c63e2e891f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:36.093062 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-ffad6c58-eeb6-4d43-a1f2-e65da6190b72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '128b154b3286498cbffe5682c82531bc', 'request_id': 'req-ffad6c58-eeb6-4d43-a1f2-e65da6190b72'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:36.100971 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-ffad6c58-eeb6-4d43-a1f2-e65da6190b72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '128b154b3286498cbffe5682c82531bc', 'request_id': 'req-ffad6c58-eeb6-4d43-a1f2-e65da6190b72'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:36.116432 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-e26c7516-10b2-4039-a407-c63e2e891f9f None None] MFA Rules not processed for user `48895a681ad94a6db93a85c1d5ced7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:36.117754 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-e26c7516-10b2-4039-a407-c63e2e891f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:36.210598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-ffad6c58-eeb6-4d43-a1f2-e65da6190b72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '128b154b3286498cbffe5682c82531bc', 'request_id': 'req-ffad6c58-eeb6-4d43-a1f2-e65da6190b72'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:36.228694 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-ffad6c58-eeb6-4d43-a1f2-e65da6190b72 admin admin] The token cache is being invalidate because project 128b154b3286498cbffe5682c82531bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:52:36.229368 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-ffad6c58-eeb6-4d43-a1f2-e65da6190b72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:36.230256 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-ffad6c58-eeb6-4d43-a1f2-e65da6190b72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:36.232798 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 939/1889] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:52:35 2022] DELETE /identity/v3/projects/128b154b3286498cbffe5682c82531bc => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:52:36.236878 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad6c58-eeb6-4d43-a1f2-e65da6190b72 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:36.238514 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-ffad6c58-eeb6-4d43-a1f2-e65da6190b72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:36.248050 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 951/1890] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:36 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:52:36.249728 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c7516-10b2-4039-a407-c63e2e891f9f None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:36.323111 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c7516-10b2-4039-a407-c63e2e891f9f None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:36.328261 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08cb133-dbfc-4447-a196-d47ed51267c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:36.328991 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08cb133-dbfc-4447-a196-d47ed51267c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:36.329275 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08cb133-dbfc-4447-a196-d47ed51267c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:36.329546 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08cb133-dbfc-4447-a196-d47ed51267c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:36.330202 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08cb133-dbfc-4447-a196-d47ed51267c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:36.332455 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08cb133-dbfc-4447-a196-d47ed51267c8 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:36.333149 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad6c58-eeb6-4d43-a1f2-e65da6190b72 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:36.340067 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5686d3-7b93-42d5-b185-b417a58f39f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:36.340067 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5686d3-7b93-42d5-b185-b417a58f39f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:36.340067 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5686d3-7b93-42d5-b185-b417a58f39f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:36.340067 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5686d3-7b93-42d5-b185-b417a58f39f7 admin admin] PATH_INFO: `/v3/users/70e872e0866e4999a1c0413564fafbca` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:36.340441 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5686d3-7b93-42d5-b185-b417a58f39f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70e872e0866e4999a1c0413564fafbca)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:36.342317 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5686d3-7b93-42d5-b185-b417a58f39f7 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:36.521848 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 952/1891] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:52:36 2022] POST /identity/v3/projects => generated 393 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:36.525323 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08cb133-dbfc-4447-a196-d47ed51267c8 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:36.527017 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-d08cb133-dbfc-4447-a196-d47ed51267c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:36.624496 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08cb133-dbfc-4447-a196-d47ed51267c8 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:36.629402 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bfaf8f-4436-4336-8afe-89e30358ae4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:36.630057 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bfaf8f-4436-4336-8afe-89e30358ae4a admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:36.630339 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bfaf8f-4436-4336-8afe-89e30358ae4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:36.630614 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bfaf8f-4436-4336-8afe-89e30358ae4a admin admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:36.631280 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bfaf8f-4436-4336-8afe-89e30358ae4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:36.633329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bfaf8f-4436-4336-8afe-89e30358ae4a admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:36.745772 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 953/1892] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:52:36 2022] POST /identity/v3/users => generated 303 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 07:52:36.752335 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bfaf8f-4436-4336-8afe-89e30358ae4a admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:36.753901 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-af5686d3-7b93-42d5-b185-b417a58f39f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70e872e0866e4999a1c0413564fafbca'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:36.754871 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-af5686d3-7b93-42d5-b185-b417a58f39f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70e872e0866e4999a1c0413564fafbca'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:36.764708 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bfaf8f-4436-4336-8afe-89e30358ae4a admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:36.770335 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d54b53-b379-4fb7-bdb4-d3c71ad85e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:36.771426 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d54b53-b379-4fb7-bdb4-d3c71ad85e40 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:36.771426 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d54b53-b379-4fb7-bdb4-d3c71ad85e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:36.771660 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d54b53-b379-4fb7-bdb4-d3c71ad85e40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:36.772357 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d54b53-b379-4fb7-bdb4-d3c71ad85e40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:36.774063 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d54b53-b379-4fb7-bdb4-d3c71ad85e40 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:36.789458 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 954/1893] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:36.790522 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d54b53-b379-4fb7-bdb4-d3c71ad85e40 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:36.818428 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d54b53-b379-4fb7-bdb4-d3c71ad85e40 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:36.827312 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e18d0-ec8c-4466-b096-67581fcaa6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:36.828246 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e18d0-ec8c-4466-b096-67581fcaa6e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:36.828661 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e18d0-ec8c-4466-b096-67581fcaa6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:36.829591 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e18d0-ec8c-4466-b096-67581fcaa6e3 admin admin] PATH_INFO: `/v3/projects/fefec2eba64548449e3905f379426651/users/876475be58b74b9ab5712524d2cf083b/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:36.851517 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723e18d0-ec8c-4466-b096-67581fcaa6e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fefec2eba64548449e3905f379426651, user_id=876475be58b74b9ab5712524d2cf083b, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:36.855780 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723e18d0-ec8c-4466-b096-67581fcaa6e3 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:37.050335 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-af5686d3-7b93-42d5-b185-b417a58f39f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70e872e0866e4999a1c0413564fafbca'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:37.065602 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-af5686d3-7b93-42d5-b185-b417a58f39f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70e872e0866e4999a1c0413564fafbca'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:37.065602 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-af5686d3-7b93-42d5-b185-b417a58f39f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70e872e0866e4999a1c0413564fafbca'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:37.085411 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 940/1894] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:52:36 2022] DELETE /identity/v3/users/70e872e0866e4999a1c0413564fafbca => generated 0 bytes in 849 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:52:37.101764 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 955/1895] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:52:36 2022] PUT /identity/v3/projects/fefec2eba64548449e3905f379426651/users/876475be58b74b9ab5712524d2cf083b/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:37.105865 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5686d3-7b93-42d5-b185-b417a58f39f7 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:37.107676 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-af5686d3-7b93-42d5-b185-b417a58f39f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:37.215143 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5686d3-7b93-42d5-b185-b417a58f39f7 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:37.218605 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:DELETE=5,keystone:SELECT=89,keystone:INSERT=6 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:52:37.293150 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046251f-1759-4aa1-8a3f-b96b599f0831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:37.293908 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046251f-1759-4aa1-8a3f-b96b599f0831 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:37.294239 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046251f-1759-4aa1-8a3f-b96b599f0831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:37.295218 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046251f-1759-4aa1-8a3f-b96b599f0831 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:37.296210 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a046251f-1759-4aa1-8a3f-b96b599f0831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:37.297915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a046251f-1759-4aa1-8a3f-b96b599f0831 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:37.312555 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 941/1896] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:37.313996 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e18d0-ec8c-4466-b096-67581fcaa6e3 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:37.324966 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e18d0-ec8c-4466-b096-67581fcaa6e3 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:37.330822 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0e47e-2308-4bd5-a90c-a04f826f354d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:37.331079 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0e47e-2308-4bd5-a90c-a04f826f354d admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:37.331640 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0e47e-2308-4bd5-a90c-a04f826f354d admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:37.332004 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0e47e-2308-4bd5-a90c-a04f826f354d admin admin] PATH_INFO: `/v3/projects/fefec2eba64548449e3905f379426651/users/876475be58b74b9ab5712524d2cf083b/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:37.334606 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db0e47e-2308-4bd5-a90c-a04f826f354d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fefec2eba64548449e3905f379426651, user_id=876475be58b74b9ab5712524d2cf083b, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:37.337177 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db0e47e-2308-4bd5-a90c-a04f826f354d admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:37.353456 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 956/1897] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:52:37 2022] PUT /identity/v3/projects/fefec2eba64548449e3905f379426651/users/876475be58b74b9ab5712524d2cf083b/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:37.366170 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bf4b0-142d-4bdd-867f-521f85b60d9b None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:37.366454 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bf4b0-142d-4bdd-867f-521f85b60d9b None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:37.366728 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bf4b0-142d-4bdd-867f-521f85b60d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:37.398685 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-fc1bf4b0-142d-4bdd-867f-521f85b60d9b None None] MFA Rules not processed for user `876475be58b74b9ab5712524d2cf083b`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:37.399966 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-fc1bf4b0-142d-4bdd-867f-521f85b60d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:37.456463 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:52:37.487745 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 942/1898] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:37 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:37.500679 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0e47e-2308-4bd5-a90c-a04f826f354d admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:37.547471 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-4db0e47e-2308-4bd5-a90c-a04f826f354d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:37.598212 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1bf4b0-142d-4bdd-867f-521f85b60d9b None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:37.598537 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0e47e-2308-4bd5-a90c-a04f826f354d admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:37.599232 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-fc1bf4b0-142d-4bdd-867f-521f85b60d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:37.603948 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5587a-41af-4cfe-8b4f-a9b2fee34c78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:37.604708 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5587a-41af-4cfe-8b4f-a9b2fee34c78 service cinder] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:37.605160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5587a-41af-4cfe-8b4f-a9b2fee34c78 service cinder] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:37.605565 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5587a-41af-4cfe-8b4f-a9b2fee34c78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:37.616435 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd5587a-41af-4cfe-8b4f-a9b2fee34c78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:37.617968 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd5587a-41af-4cfe-8b4f-a9b2fee34c78 service cinder] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:37.628669 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 957/1899] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:37 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:52:37.667265 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1bf4b0-142d-4bdd-867f-521f85b60d9b None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:37.675434 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87fd579-889a-4260-a17f-4ed9f2f8c6da tempest-VolumeQuotaClassesTest-933179965 tempest-VolumeQuotaClassesTest-933179965-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dcc09172ce451d9be3d7071f354236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83609a80d1564fb09dd059b5914497e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:37.676074 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fd579-889a-4260-a17f-4ed9f2f8c6da tempest-VolumeQuotaClassesTest-933179965 tempest-VolumeQuotaClassesTest-933179965-project-admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:37.676365 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fd579-889a-4260-a17f-4ed9f2f8c6da tempest-VolumeQuotaClassesTest-933179965 tempest-VolumeQuotaClassesTest-933179965-project-admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:37.676643 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fd579-889a-4260-a17f-4ed9f2f8c6da tempest-VolumeQuotaClassesTest-933179965 tempest-VolumeQuotaClassesTest-933179965-project-admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:37.677443 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87fd579-889a-4260-a17f-4ed9f2f8c6da tempest-VolumeQuotaClassesTest-933179965 tempest-VolumeQuotaClassesTest-933179965-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:52:37.677750 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87fd579-889a-4260-a17f-4ed9f2f8c6da tempest-VolumeQuotaClassesTest-933179965 tempest-VolumeQuotaClassesTest-933179965-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:37.679428 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87fd579-889a-4260-a17f-4ed9f2f8c6da tempest-VolumeQuotaClassesTest-933179965 tempest-VolumeQuotaClassesTest-933179965-project-admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:37.681677 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5587a-41af-4cfe-8b4f-a9b2fee34c78 service cinder] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:37.683483 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-6fd5587a-41af-4cfe-8b4f-a9b2fee34c78 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:37.695188 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 943/1900] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:52:37.696167 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87fd579-889a-4260-a17f-4ed9f2f8c6da tempest-VolumeQuotaClassesTest-933179965 tempest-VolumeQuotaClassesTest-933179965-project-admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:37.696484 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5587a-41af-4cfe-8b4f-a9b2fee34c78 service cinder] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:37.700093 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c0dbe-5665-41cd-8d04-6a5d0bb8dbd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:37.701292 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c0dbe-5665-41cd-8d04-6a5d0bb8dbd5 service cinder] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:37.701629 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c0dbe-5665-41cd-8d04-6a5d0bb8dbd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:37.701985 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c0dbe-5665-41cd-8d04-6a5d0bb8dbd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:37.704303 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-7c0c0dbe-5665-41cd-8d04-6a5d0bb8dbd5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:37.707170 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87fd579-889a-4260-a17f-4ed9f2f8c6da tempest-VolumeQuotaClassesTest-933179965 tempest-VolumeQuotaClassesTest-933179965-project-admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:37.711873 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212fea09-1c00-4fd5-8ad2-9519d8332e29 tempest-VolumeQuotaClassesTest-933179965 tempest-VolumeQuotaClassesTest-933179965-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dcc09172ce451d9be3d7071f354236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83609a80d1564fb09dd059b5914497e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:37.715326 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212fea09-1c00-4fd5-8ad2-9519d8332e29 tempest-VolumeQuotaClassesTest-933179965 tempest-VolumeQuotaClassesTest-933179965-project-admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:37.715900 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212fea09-1c00-4fd5-8ad2-9519d8332e29 tempest-VolumeQuotaClassesTest-933179965 tempest-VolumeQuotaClassesTest-933179965-project-admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:37.716068 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212fea09-1c00-4fd5-8ad2-9519d8332e29 tempest-VolumeQuotaClassesTest-933179965 tempest-VolumeQuotaClassesTest-933179965-project-admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:37.716886 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212fea09-1c00-4fd5-8ad2-9519d8332e29 tempest-VolumeQuotaClassesTest-933179965 tempest-VolumeQuotaClassesTest-933179965-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:37.719324 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212fea09-1c00-4fd5-8ad2-9519d8332e29 tempest-VolumeQuotaClassesTest-933179965 tempest-VolumeQuotaClassesTest-933179965-project-admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:37.770581 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c0dbe-5665-41cd-8d04-6a5d0bb8dbd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:37.772172 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c0dbe-5665-41cd-8d04-6a5d0bb8dbd5 service cinder] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:37.783714 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 958/1901] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:37 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 07:52:38.810876 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c0dbe-5665-41cd-8d04-6a5d0bb8dbd5 service cinder] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:38.812729 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-7c0c0dbe-5665-41cd-8d04-6a5d0bb8dbd5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:38.819695 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 944/1902] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:52:37 2022] POST /identity/v3/projects => generated 355 bytes in 1124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:38.823904 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212fea09-1c00-4fd5-8ad2-9519d8332e29 tempest-VolumeQuotaClassesTest-933179965 tempest-VolumeQuotaClassesTest-933179965-project-admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:38.920587 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212fea09-1c00-4fd5-8ad2-9519d8332e29 tempest-VolumeQuotaClassesTest-933179965 tempest-VolumeQuotaClassesTest-933179965-project-admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:38.922459 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c0dbe-5665-41cd-8d04-6a5d0bb8dbd5 service cinder] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:38.925908 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c16b5-a83b-49f7-adcd-4b672bff03d2 tempest-VolumeQuotaClassesTest-933179965 tempest-VolumeQuotaClassesTest-933179965-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dcc09172ce451d9be3d7071f354236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83609a80d1564fb09dd059b5914497e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:38.926538 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c16b5-a83b-49f7-adcd-4b672bff03d2 tempest-VolumeQuotaClassesTest-933179965 tempest-VolumeQuotaClassesTest-933179965-project-admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:38.926824 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c16b5-a83b-49f7-adcd-4b672bff03d2 tempest-VolumeQuotaClassesTest-933179965 tempest-VolumeQuotaClassesTest-933179965-project-admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:38.927156 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c16b5-a83b-49f7-adcd-4b672bff03d2 tempest-VolumeQuotaClassesTest-933179965 tempest-VolumeQuotaClassesTest-933179965-project-admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:38.927822 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c16b5-a83b-49f7-adcd-4b672bff03d2 tempest-VolumeQuotaClassesTest-933179965 tempest-VolumeQuotaClassesTest-933179965-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:52:38.928132 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c16b5-a83b-49f7-adcd-4b672bff03d2 tempest-VolumeQuotaClassesTest-933179965 tempest-VolumeQuotaClassesTest-933179965-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:38.930114 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c16b5-a83b-49f7-adcd-4b672bff03d2 tempest-VolumeQuotaClassesTest-933179965 tempest-VolumeQuotaClassesTest-933179965-project-admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:38.947165 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 945/1903] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:52:38.999262 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013340f5-ea20-420b-b485-4207923a3dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:38.999921 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013340f5-ea20-420b-b485-4207923a3dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:39.000216 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013340f5-ea20-420b-b485-4207923a3dae admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:39.000471 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013340f5-ea20-420b-b485-4207923a3dae admin admin] PATH_INFO: `/v3/projects/54d02ecbf8c94d1ebda98ab8e7559c55` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:39.001674 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013340f5-ea20-420b-b485-4207923a3dae admin admin] RBAC: Authorizing `identity:delete_project(project_id=54d02ecbf8c94d1ebda98ab8e7559c55)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:39.003652 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013340f5-ea20-420b-b485-4207923a3dae admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:39.130491 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c16b5-a83b-49f7-adcd-4b672bff03d2 tempest-VolumeQuotaClassesTest-933179965 tempest-VolumeQuotaClassesTest-933179965-project-admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:39.147835 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c16b5-a83b-49f7-adcd-4b672bff03d2 tempest-VolumeQuotaClassesTest-933179965 tempest-VolumeQuotaClassesTest-933179965-project-admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:39.149109 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68bcd10-797f-4249-b04a-de9ee7d2b926 tempest-VolumeQuotaClassesTest-933179965 tempest-VolumeQuotaClassesTest-933179965-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4dcc09172ce451d9be3d7071f354236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83609a80d1564fb09dd059b5914497e6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:39.149763 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bcd10-797f-4249-b04a-de9ee7d2b926 tempest-VolumeQuotaClassesTest-933179965 tempest-VolumeQuotaClassesTest-933179965-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:39.150052 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bcd10-797f-4249-b04a-de9ee7d2b926 tempest-VolumeQuotaClassesTest-933179965 tempest-VolumeQuotaClassesTest-933179965-project-admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:39.150329 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bcd10-797f-4249-b04a-de9ee7d2b926 tempest-VolumeQuotaClassesTest-933179965 tempest-VolumeQuotaClassesTest-933179965-project-admin] PATH_INFO: `/v3/projects/51284172c1484eeabb83ffaa6ad63041` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:39.151678 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68bcd10-797f-4249-b04a-de9ee7d2b926 tempest-VolumeQuotaClassesTest-933179965 tempest-VolumeQuotaClassesTest-933179965-project-admin] RBAC: Authorizing `identity:delete_project(project_id=51284172c1484eeabb83ffaa6ad63041)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:39.161499 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68bcd10-797f-4249-b04a-de9ee7d2b926 tempest-VolumeQuotaClassesTest-933179965 tempest-VolumeQuotaClassesTest-933179965-project-admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:39.245175 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-013340f5-ea20-420b-b485-4207923a3dae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54d02ecbf8c94d1ebda98ab8e7559c55', 'request_id': 'req-013340f5-ea20-420b-b485-4207923a3dae'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:39.251947 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-013340f5-ea20-420b-b485-4207923a3dae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54d02ecbf8c94d1ebda98ab8e7559c55', 'request_id': 'req-013340f5-ea20-420b-b485-4207923a3dae'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:39.258838 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-013340f5-ea20-420b-b485-4207923a3dae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54d02ecbf8c94d1ebda98ab8e7559c55', 'request_id': 'req-013340f5-ea20-420b-b485-4207923a3dae'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:39.353364 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-b68bcd10-797f-4249-b04a-de9ee7d2b926 tempest-VolumeQuotaClassesTest-933179965 tempest-VolumeQuotaClassesTest-933179965-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51284172c1484eeabb83ffaa6ad63041', 'request_id': 'req-b68bcd10-797f-4249-b04a-de9ee7d2b926'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:39.365257 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-b68bcd10-797f-4249-b04a-de9ee7d2b926 tempest-VolumeQuotaClassesTest-933179965 tempest-VolumeQuotaClassesTest-933179965-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51284172c1484eeabb83ffaa6ad63041', 'request_id': 'req-b68bcd10-797f-4249-b04a-de9ee7d2b926'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:39.411408 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-013340f5-ea20-420b-b485-4207923a3dae admin admin] The token cache is being invalidate because project 54d02ecbf8c94d1ebda98ab8e7559c55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:52:39.411702 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-013340f5-ea20-420b-b485-4207923a3dae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:39.412729 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-013340f5-ea20-420b-b485-4207923a3dae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:39.414248 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 959/1904] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:52:38 2022] DELETE /identity/v3/projects/54d02ecbf8c94d1ebda98ab8e7559c55 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:39.415500 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96522181-1bff-49c0-9fc5-88f2c4938c86 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:39.415775 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96522181-1bff-49c0-9fc5-88f2c4938c86 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:39.416052 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96522181-1bff-49c0-9fc5-88f2c4938c86 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:39.417321 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 960/1905] 10.222.0.42 () {54 vars in 921 bytes} [Fri Aug 26 07:52:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:52:39.418775 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9f8c1-9781-433e-a5a2-ba34a2f547f7 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:39.419170 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9f8c1-9781-433e-a5a2-ba34a2f547f7 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:39.420151 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9f8c1-9781-433e-a5a2-ba34a2f547f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:39.440196 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-fff9f8c1-9781-433e-a5a2-ba34a2f547f7 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:39.441423 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-fff9f8c1-9781-433e-a5a2-ba34a2f547f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:39.503449 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 961/1906] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:39.504718 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1b732-fbc3-4bba-b5a1-a5becc181035 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:39.505009 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1b732-fbc3-4bba-b5a1-a5becc181035 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:39.505289 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1b732-fbc3-4bba-b5a1-a5becc181035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:39.512199 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-b68bcd10-797f-4249-b04a-de9ee7d2b926 tempest-VolumeQuotaClassesTest-933179965 tempest-VolumeQuotaClassesTest-933179965-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51284172c1484eeabb83ffaa6ad63041', 'request_id': 'req-b68bcd10-797f-4249-b04a-de9ee7d2b926'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:39.525233 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-b68bcd10-797f-4249-b04a-de9ee7d2b926 tempest-VolumeQuotaClassesTest-933179965 tempest-VolumeQuotaClassesTest-933179965-project-admin] The token cache is being invalidate because project 51284172c1484eeabb83ffaa6ad63041 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:52:39.525664 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-b68bcd10-797f-4249-b04a-de9ee7d2b926 tempest-VolumeQuotaClassesTest-933179965 tempest-VolumeQuotaClassesTest-933179965-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:39.526333 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-b68bcd10-797f-4249-b04a-de9ee7d2b926 tempest-VolumeQuotaClassesTest-933179965 tempest-VolumeQuotaClassesTest-933179965-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:39.528475 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 946/1907] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:52:39 2022] DELETE /identity/v3/projects/51284172c1484eeabb83ffaa6ad63041 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:39.529931 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-bbe1b732-fbc3-4bba-b5a1-a5becc181035 None None] MFA Rules not processed for user `bc92c0a0a2cc4722868e6877bac93ada`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:39.531789 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-bbe1b732-fbc3-4bba-b5a1-a5becc181035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:39.533407 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c254d9-45f9-46b2-a811-2c3f6f452c61 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:39.533707 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c254d9-45f9-46b2-a811-2c3f6f452c61 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:39.534036 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c254d9-45f9-46b2-a811-2c3f6f452c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:39.555492 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-62c254d9-45f9-46b2-a811-2c3f6f452c61 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:39.556851 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-62c254d9-45f9-46b2-a811-2c3f6f452c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:39.565065 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 947/1908] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:39.569285 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c254d9-45f9-46b2-a811-2c3f6f452c61 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:39.579353 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c254d9-45f9-46b2-a811-2c3f6f452c61 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:39.584415 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506ff0b-2dba-4699-bb80-29ef0c5f88d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:39.585054 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506ff0b-2dba-4699-bb80-29ef0c5f88d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:39.585337 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506ff0b-2dba-4699-bb80-29ef0c5f88d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:39.585623 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506ff0b-2dba-4699-bb80-29ef0c5f88d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:39.586364 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8506ff0b-2dba-4699-bb80-29ef0c5f88d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:52:39.586669 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8506ff0b-2dba-4699-bb80-29ef0c5f88d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:39.588318 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8506ff0b-2dba-4699-bb80-29ef0c5f88d5 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:39.607038 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 948/1909] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:52:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:52:39.607212 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 962/1910] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Aug 26 07:52:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:39.612375 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506ff0b-2dba-4699-bb80-29ef0c5f88d5 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:39.624308 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506ff0b-2dba-4699-bb80-29ef0c5f88d5 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:39.628757 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1b732-fbc3-4bba-b5a1-a5becc181035 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:39.629270 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce1ef28-93ae-4078-8af0-ddd1ab24536c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:39.629894 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1ef28-93ae-4078-8af0-ddd1ab24536c admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:39.630178 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1ef28-93ae-4078-8af0-ddd1ab24536c admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:39.630455 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1ef28-93ae-4078-8af0-ddd1ab24536c admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:39.630553 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-bbe1b732-fbc3-4bba-b5a1-a5becc181035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:39.631128 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce1ef28-93ae-4078-8af0-ddd1ab24536c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:39.633041 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce1ef28-93ae-4078-8af0-ddd1ab24536c admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:39.645723 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1b732-fbc3-4bba-b5a1-a5becc181035 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:39.670193 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888e7a8-398a-4b7c-b96b-79a4173d4d7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc92c0a0a2cc4722868e6877bac93ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:39.671009 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888e7a8-398a-4b7c-b96b-79a4173d4d7a service nova] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:39.671278 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888e7a8-398a-4b7c-b96b-79a4173d4d7a service nova] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:39.671546 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888e7a8-398a-4b7c-b96b-79a4173d4d7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:39.684120 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8888e7a8-398a-4b7c-b96b-79a4173d4d7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:39.687468 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8888e7a8-398a-4b7c-b96b-79a4173d4d7a service nova] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:39.699585 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 963/1911] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:52:39.816415 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 949/1912] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:52:39 2022] POST /identity/v3/projects => generated 385 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:39.820994 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888e7a8-398a-4b7c-b96b-79a4173d4d7a service nova] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:39.844206 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888e7a8-398a-4b7c-b96b-79a4173d4d7a service nova] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:39.980957 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076611ee-b8a4-49a4-9816-9007ffdb8df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:39.981660 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076611ee-b8a4-49a4-9816-9007ffdb8df7 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:39.982000 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076611ee-b8a4-49a4-9816-9007ffdb8df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:39.982278 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076611ee-b8a4-49a4-9816-9007ffdb8df7 admin admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:39.983310 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076611ee-b8a4-49a4-9816-9007ffdb8df7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:39.986948 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076611ee-b8a4-49a4-9816-9007ffdb8df7 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:40.178548 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 964/1913] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:52:39 2022] POST /identity/v3/users => generated 293 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 07:52:40.191131 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce1ef28-93ae-4078-8af0-ddd1ab24536c admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:40.207645 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce1ef28-93ae-4078-8af0-ddd1ab24536c admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:40.215067 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622fdf3-0908-4736-9fef-83e296a9a8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:40.226713 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622fdf3-0908-4736-9fef-83e296a9a8bb admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:40.227269 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622fdf3-0908-4736-9fef-83e296a9a8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:40.227551 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622fdf3-0908-4736-9fef-83e296a9a8bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:40.228231 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8622fdf3-0908-4736-9fef-83e296a9a8bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:40.229876 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8622fdf3-0908-4736-9fef-83e296a9a8bb admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:40.249586 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 950/1914] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:40.254006 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076611ee-b8a4-49a4-9816-9007ffdb8df7 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:40.264344 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076611ee-b8a4-49a4-9816-9007ffdb8df7 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:40.269026 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f747796-05ba-499b-a063-064d2f7c33cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:40.269636 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f747796-05ba-499b-a063-064d2f7c33cb admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:40.269915 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f747796-05ba-499b-a063-064d2f7c33cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:40.270185 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f747796-05ba-499b-a063-064d2f7c33cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:40.270828 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f747796-05ba-499b-a063-064d2f7c33cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:40.272682 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f747796-05ba-499b-a063-064d2f7c33cb admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:40.284390 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 965/1915] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:40.294935 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622fdf3-0908-4736-9fef-83e296a9a8bb admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:40.304927 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622fdf3-0908-4736-9fef-83e296a9a8bb admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:40.310648 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6270aa73-0195-4428-be76-f8663d817a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:40.311417 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270aa73-0195-4428-be76-f8663d817a4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:40.311721 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270aa73-0195-4428-be76-f8663d817a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:40.315214 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270aa73-0195-4428-be76-f8663d817a4c admin admin] PATH_INFO: `/v3/projects/d78dbdcb568342559c2792156caa2008/users/d48725709fcd45ea9f09e27eb134d042/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:40.337201 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6270aa73-0195-4428-be76-f8663d817a4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d78dbdcb568342559c2792156caa2008, user_id=d48725709fcd45ea9f09e27eb134d042, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:40.340009 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6270aa73-0195-4428-be76-f8663d817a4c admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:40.484635 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 951/1916] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:52:40 2022] PUT /identity/v3/projects/d78dbdcb568342559c2792156caa2008/users/d48725709fcd45ea9f09e27eb134d042/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:40.495191 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a447432-c9a5-4449-b1de-dedac9d8e765 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:40.496019 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a447432-c9a5-4449-b1de-dedac9d8e765 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:40.496395 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a447432-c9a5-4449-b1de-dedac9d8e765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:40.535230 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-1a447432-c9a5-4449-b1de-dedac9d8e765 None None] MFA Rules not processed for user `d48725709fcd45ea9f09e27eb134d042`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:40.535230 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-1a447432-c9a5-4449-b1de-dedac9d8e765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:40.547318 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6270aa73-0195-4428-be76-f8663d817a4c admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:40.551349 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-6270aa73-0195-4428-be76-f8663d817a4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:40.633318 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 966/1917] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:40.638574 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a447432-c9a5-4449-b1de-dedac9d8e765 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:40.652293 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6270aa73-0195-4428-be76-f8663d817a4c admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:40.659577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074e99c-f6e9-4e37-8a1b-c88a34b7ecda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:40.660363 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074e99c-f6e9-4e37-8a1b-c88a34b7ecda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:40.660705 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074e99c-f6e9-4e37-8a1b-c88a34b7ecda admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:40.661486 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074e99c-f6e9-4e37-8a1b-c88a34b7ecda admin admin] PATH_INFO: `/v3/users/e81b67cc01d34a0aac9d32f3be8099af` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:40.662307 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074e99c-f6e9-4e37-8a1b-c88a34b7ecda admin admin] RBAC: Authorizing `identity:delete_user(user_id=e81b67cc01d34a0aac9d32f3be8099af)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:40.664836 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074e99c-f6e9-4e37-8a1b-c88a34b7ecda admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:40.711092 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a447432-c9a5-4449-b1de-dedac9d8e765 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:40.715709 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c49c6ed-4c92-4e69-9ce3-523c6e181b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:40.716362 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49c6ed-4c92-4e69-9ce3-523c6e181b14 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:40.717602 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49c6ed-4c92-4e69-9ce3-523c6e181b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:40.717602 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49c6ed-4c92-4e69-9ce3-523c6e181b14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:40.717792 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c49c6ed-4c92-4e69-9ce3-523c6e181b14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:40.720203 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c49c6ed-4c92-4e69-9ce3-523c6e181b14 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:40.876365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 967/1918] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:52:40 2022] POST /identity/v3/projects => generated 387 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 07:52:40.890093 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-a074e99c-f6e9-4e37-8a1b-c88a34b7ecda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e81b67cc01d34a0aac9d32f3be8099af'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:40.891005 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-a074e99c-f6e9-4e37-8a1b-c88a34b7ecda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e81b67cc01d34a0aac9d32f3be8099af'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:40.894326 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c49c6ed-4c92-4e69-9ce3-523c6e181b14 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:40.973687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c49c6ed-4c92-4e69-9ce3-523c6e181b14 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:40.978882 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085b89e-ca50-4759-88ef-aff3efee741c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:40.979733 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085b89e-ca50-4759-88ef-aff3efee741c admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:40.980791 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085b89e-ca50-4759-88ef-aff3efee741c admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:40.980791 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085b89e-ca50-4759-88ef-aff3efee741c admin admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:40.981430 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7085b89e-ca50-4759-88ef-aff3efee741c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:40.984896 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7085b89e-ca50-4759-88ef-aff3efee741c admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:41.025095 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-a074e99c-f6e9-4e37-8a1b-c88a34b7ecda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e81b67cc01d34a0aac9d32f3be8099af'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:41.026032 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-a074e99c-f6e9-4e37-8a1b-c88a34b7ecda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e81b67cc01d34a0aac9d32f3be8099af'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:41.037335 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-a074e99c-f6e9-4e37-8a1b-c88a34b7ecda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e81b67cc01d34a0aac9d32f3be8099af'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:41.065229 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 952/1919] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:52:40 2022] DELETE /identity/v3/users/e81b67cc01d34a0aac9d32f3be8099af => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:41.067762 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a80d0f-7f2b-44e6-9703-c80a3e4ab3e9 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:41.068603 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a80d0f-7f2b-44e6-9703-c80a3e4ab3e9 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:41.069363 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a80d0f-7f2b-44e6-9703-c80a3e4ab3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:41.094161 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 968/1920] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:52:40 2022] POST /identity/v3/users => generated 300 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:41.098574 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085b89e-ca50-4759-88ef-aff3efee741c admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:41.105039 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-7085b89e-ca50-4759-88ef-aff3efee741c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:41.114693 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-34a80d0f-7f2b-44e6-9703-c80a3e4ab3e9 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:41.116673 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-34a80d0f-7f2b-44e6-9703-c80a3e4ab3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:41.121508 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085b89e-ca50-4759-88ef-aff3efee741c admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:41.203289 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 953/1921] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:41.216730 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3872c0-4ad2-4a27-9be2-faa0aef601e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:41.219340 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a80d0f-7f2b-44e6-9703-c80a3e4ab3e9 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:41.221014 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-34a80d0f-7f2b-44e6-9703-c80a3e4ab3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:41.221972 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3872c0-4ad2-4a27-9be2-faa0aef601e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:41.222401 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3872c0-4ad2-4a27-9be2-faa0aef601e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:41.223431 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3872c0-4ad2-4a27-9be2-faa0aef601e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:41.225761 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3872c0-4ad2-4a27-9be2-faa0aef601e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:41.227695 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3872c0-4ad2-4a27-9be2-faa0aef601e8 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:41.242780 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 969/1922] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:41.248209 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3872c0-4ad2-4a27-9be2-faa0aef601e8 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:41.260693 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3872c0-4ad2-4a27-9be2-faa0aef601e8 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:41.266111 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9080590-f1be-4e5f-8da3-98967f93fd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:41.266913 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9080590-f1be-4e5f-8da3-98967f93fd45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:41.267265 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9080590-f1be-4e5f-8da3-98967f93fd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:41.267563 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9080590-f1be-4e5f-8da3-98967f93fd45 admin admin] PATH_INFO: `/v3/projects/9c599661968541cc98194cebab10f157/users/c4003cad44634fd0914d8c4551b33adb/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:41.282954 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9080590-f1be-4e5f-8da3-98967f93fd45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c599661968541cc98194cebab10f157, user_id=c4003cad44634fd0914d8c4551b33adb, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:41.285740 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9080590-f1be-4e5f-8da3-98967f93fd45 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:41.296610 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a80d0f-7f2b-44e6-9703-c80a3e4ab3e9 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:41.300287 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce284f-d626-4227-a6d6-c0fdf1802366 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:41.300921 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce284f-d626-4227-a6d6-c0fdf1802366 service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:41.301196 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce284f-d626-4227-a6d6-c0fdf1802366 service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:41.301468 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce284f-d626-4227-a6d6-c0fdf1802366 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:41.311314 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce284f-d626-4227-a6d6-c0fdf1802366 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:41.312808 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce284f-d626-4227-a6d6-c0fdf1802366 service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:41.322555 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 954/1923] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 07:52:41.370781 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:52:41.468164 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 970/1924] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:52:41 2022] PUT /identity/v3/projects/9c599661968541cc98194cebab10f157/users/c4003cad44634fd0914d8c4551b33adb/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:41.472765 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce284f-d626-4227-a6d6-c0fdf1802366 service neutron] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:41.483146 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce284f-d626-4227-a6d6-c0fdf1802366 service neutron] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:41.538481 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82b1e4-237c-49d6-aa1d-845737cb6913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:41.539121 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82b1e4-237c-49d6-aa1d-845737cb6913 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:41.539403 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82b1e4-237c-49d6-aa1d-845737cb6913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:41.539675 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82b1e4-237c-49d6-aa1d-845737cb6913 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:41.540316 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da82b1e4-237c-49d6-aa1d-845737cb6913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:41.541915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da82b1e4-237c-49d6-aa1d-845737cb6913 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:41.552582 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 955/1925] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:41.556989 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9080590-f1be-4e5f-8da3-98967f93fd45 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:41.567243 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9080590-f1be-4e5f-8da3-98967f93fd45 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:41.571762 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9211c7ea-fcc3-4cda-b4df-187e3d933512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:41.572415 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211c7ea-fcc3-4cda-b4df-187e3d933512 admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:41.572813 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211c7ea-fcc3-4cda-b4df-187e3d933512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:41.573136 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211c7ea-fcc3-4cda-b4df-187e3d933512 admin admin] PATH_INFO: `/v3/projects/9c599661968541cc98194cebab10f157/users/c4003cad44634fd0914d8c4551b33adb/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:41.575103 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9211c7ea-fcc3-4cda-b4df-187e3d933512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c599661968541cc98194cebab10f157, user_id=c4003cad44634fd0914d8c4551b33adb, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:41.577728 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9211c7ea-fcc3-4cda-b4df-187e3d933512 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:41.588630 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 971/1926] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:52:41 2022] PUT /identity/v3/projects/9c599661968541cc98194cebab10f157/users/c4003cad44634fd0914d8c4551b33adb/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:41.600836 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963aada-8626-4666-b492-22dd317b355e None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:41.601121 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963aada-8626-4666-b492-22dd317b355e None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:41.601393 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963aada-8626-4666-b492-22dd317b355e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:41.644622 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-8963aada-8626-4666-b492-22dd317b355e None None] MFA Rules not processed for user `c4003cad44634fd0914d8c4551b33adb`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:41.645422 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-8963aada-8626-4666-b492-22dd317b355e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:41.737900 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 956/1927] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:41 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:52:41.778296 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9211c7ea-fcc3-4cda-b4df-187e3d933512 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:41.781198 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-9211c7ea-fcc3-4cda-b4df-187e3d933512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:41.852065 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9211c7ea-fcc3-4cda-b4df-187e3d933512 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:41.856013 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26acd809-7e72-441d-85b2-0e9ee54abb26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:41.857390 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acd809-7e72-441d-85b2-0e9ee54abb26 service cinder] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:41.858030 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acd809-7e72-441d-85b2-0e9ee54abb26 service cinder] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:41.858414 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acd809-7e72-441d-85b2-0e9ee54abb26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:41.868072 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26acd809-7e72-441d-85b2-0e9ee54abb26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:41.869512 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26acd809-7e72-441d-85b2-0e9ee54abb26 service cinder] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:41.880694 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 972/1928] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:41 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 07:52:41.911330 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963aada-8626-4666-b492-22dd317b355e None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:41.939581 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26acd809-7e72-441d-85b2-0e9ee54abb26 service cinder] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:41.941502 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-26acd809-7e72-441d-85b2-0e9ee54abb26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:42.023451 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963aada-8626-4666-b492-22dd317b355e None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:42.028999 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf927258-1576-45b4-9750-a46525078e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:42.029586 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf927258-1576-45b4-9750-a46525078e6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:42.029884 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf927258-1576-45b4-9750-a46525078e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:42.030256 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf927258-1576-45b4-9750-a46525078e6b admin admin] PATH_INFO: `/v3/users/d48725709fcd45ea9f09e27eb134d042` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:42.031795 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf927258-1576-45b4-9750-a46525078e6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d48725709fcd45ea9f09e27eb134d042)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:42.033829 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf927258-1576-45b4-9750-a46525078e6b admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:42.072367 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26acd809-7e72-441d-85b2-0e9ee54abb26 service cinder] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:42.078074 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41175db-cff6-436b-a07d-762578379ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:42.078722 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41175db-cff6-436b-a07d-762578379ebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:42.079031 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41175db-cff6-436b-a07d-762578379ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:42.079305 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41175db-cff6-436b-a07d-762578379ebc admin admin] PATH_INFO: `/v3/projects/b06d3c8ddbe7491782f34a3c2af519aa` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:42.080516 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41175db-cff6-436b-a07d-762578379ebc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b06d3c8ddbe7491782f34a3c2af519aa)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:42.082615 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41175db-cff6-436b-a07d-762578379ebc admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:42.113668 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:52:42.338814 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-bf927258-1576-45b4-9750-a46525078e6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd48725709fcd45ea9f09e27eb134d042'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:42.339557 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-bf927258-1576-45b4-9750-a46525078e6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd48725709fcd45ea9f09e27eb134d042'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:42.340397 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-d41175db-cff6-436b-a07d-762578379ebc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b06d3c8ddbe7491782f34a3c2af519aa', 'request_id': 'req-d41175db-cff6-436b-a07d-762578379ebc'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:42.346890 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-d41175db-cff6-436b-a07d-762578379ebc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b06d3c8ddbe7491782f34a3c2af519aa', 'request_id': 'req-d41175db-cff6-436b-a07d-762578379ebc'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:42.353359 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-d41175db-cff6-436b-a07d-762578379ebc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b06d3c8ddbe7491782f34a3c2af519aa', 'request_id': 'req-d41175db-cff6-436b-a07d-762578379ebc'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:42.438697 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-bf927258-1576-45b4-9750-a46525078e6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd48725709fcd45ea9f09e27eb134d042'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:42.443455 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-bf927258-1576-45b4-9750-a46525078e6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd48725709fcd45ea9f09e27eb134d042'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:42.446853 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-bf927258-1576-45b4-9750-a46525078e6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd48725709fcd45ea9f09e27eb134d042'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:42.464719 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 957/1929] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:52:41 2022] DELETE /identity/v3/users/d48725709fcd45ea9f09e27eb134d042 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:42.465528 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf927258-1576-45b4-9750-a46525078e6b admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:42.467760 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-bf927258-1576-45b4-9750-a46525078e6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:42.531327 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf927258-1576-45b4-9750-a46525078e6b admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:42.535830 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ac5a5-4cfa-4f4b-84f5-b4ce0178782d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:42.536459 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ac5a5-4cfa-4f4b-84f5-b4ce0178782d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:42.536733 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ac5a5-4cfa-4f4b-84f5-b4ce0178782d admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:42.537007 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ac5a5-4cfa-4f4b-84f5-b4ce0178782d admin admin] PATH_INFO: `/v3/users/fee0ea68a41348939d2965f3abbdb7b4` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:42.538172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ac5a5-4cfa-4f4b-84f5-b4ce0178782d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fee0ea68a41348939d2965f3abbdb7b4)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:42.540107 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ac5a5-4cfa-4f4b-84f5-b4ce0178782d admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:42.565363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-d41175db-cff6-436b-a07d-762578379ebc admin admin] The token cache is being invalidate because project b06d3c8ddbe7491782f34a3c2af519aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:52:42.565656 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-d41175db-cff6-436b-a07d-762578379ebc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:42.566356 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-d41175db-cff6-436b-a07d-762578379ebc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:42.568152 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 973/1930] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:52:41 2022] DELETE /identity/v3/projects/b06d3c8ddbe7491782f34a3c2af519aa => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:52:42.569411 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad6166-243e-4c5f-b78f-df8ca2096c0f None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:42.569696 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad6166-243e-4c5f-b78f-df8ca2096c0f None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:42.569977 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad6166-243e-4c5f-b78f-df8ca2096c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:42.590329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-eaad6166-243e-4c5f-b78f-df8ca2096c0f None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:42.592612 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-eaad6166-243e-4c5f-b78f-df8ca2096c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:42.600254 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 974/1931] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:42.601035 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad6166-243e-4c5f-b78f-df8ca2096c0f None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:42.602243 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-eaad6166-243e-4c5f-b78f-df8ca2096c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:42.614391 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad6166-243e-4c5f-b78f-df8ca2096c0f None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:42.620081 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386005d-8dbb-47a2-b568-d16279419b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:42.620719 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386005d-8dbb-47a2-b568-d16279419b66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:42.621087 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386005d-8dbb-47a2-b568-d16279419b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:42.621415 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386005d-8dbb-47a2-b568-d16279419b66 admin admin] PATH_INFO: `/v3/users/c4dcc09172ce451d9be3d7071f354236` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:42.622562 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d386005d-8dbb-47a2-b568-d16279419b66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4dcc09172ce451d9be3d7071f354236)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:42.624511 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d386005d-8dbb-47a2-b568-d16279419b66 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:42.928090 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-d386005d-8dbb-47a2-b568-d16279419b66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4dcc09172ce451d9be3d7071f354236'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:42.935712 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-691ac5a5-4cfa-4f4b-84f5-b4ce0178782d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fee0ea68a41348939d2965f3abbdb7b4'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:42.936427 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-691ac5a5-4cfa-4f4b-84f5-b4ce0178782d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fee0ea68a41348939d2965f3abbdb7b4'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:42.938884 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-d386005d-8dbb-47a2-b568-d16279419b66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4dcc09172ce451d9be3d7071f354236'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:43.023067 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-d386005d-8dbb-47a2-b568-d16279419b66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4dcc09172ce451d9be3d7071f354236'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:43.024547 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-d386005d-8dbb-47a2-b568-d16279419b66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4dcc09172ce451d9be3d7071f354236'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:43.044935 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-d386005d-8dbb-47a2-b568-d16279419b66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4dcc09172ce451d9be3d7071f354236'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:43.056814 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 975/1932] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:52:42 2022] DELETE /identity/v3/users/c4dcc09172ce451d9be3d7071f354236 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:43.058097 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386005d-8dbb-47a2-b568-d16279419b66 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:43.059626 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-d386005d-8dbb-47a2-b568-d16279419b66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:43.129683 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386005d-8dbb-47a2-b568-d16279419b66 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:43.133469 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82c3d1-8d20-4662-bb89-3c7aba25c641 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:43.134381 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82c3d1-8d20-4662-bb89-3c7aba25c641 service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:43.134381 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82c3d1-8d20-4662-bb89-3c7aba25c641 service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:43.136063 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82c3d1-8d20-4662-bb89-3c7aba25c641 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:43.136393 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-8c82c3d1-8d20-4662-bb89-3c7aba25c641 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:43.153306 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-691ac5a5-4cfa-4f4b-84f5-b4ce0178782d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fee0ea68a41348939d2965f3abbdb7b4'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:43.154426 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-691ac5a5-4cfa-4f4b-84f5-b4ce0178782d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fee0ea68a41348939d2965f3abbdb7b4'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:43.167999 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-691ac5a5-4cfa-4f4b-84f5-b4ce0178782d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fee0ea68a41348939d2965f3abbdb7b4'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:43.202265 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 958/1933] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:52:42 2022] DELETE /identity/v3/users/fee0ea68a41348939d2965f3abbdb7b4 => generated 0 bytes in 737 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:43.207340 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b53bb-7072-4bfe-9daa-eda2bedd2d7c None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:43.207837 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b53bb-7072-4bfe-9daa-eda2bedd2d7c None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:43.208273 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82c3d1-8d20-4662-bb89-3c7aba25c641 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:43.208474 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b53bb-7072-4bfe-9daa-eda2bedd2d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:43.210419 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82c3d1-8d20-4662-bb89-3c7aba25c641 service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:43.222006 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 976/1934] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:52:43.232953 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-bb3b53bb-7072-4bfe-9daa-eda2bedd2d7c None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:43.233997 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-bb3b53bb-7072-4bfe-9daa-eda2bedd2d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:43.304843 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 959/1935] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:43.315763 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82c3d1-8d20-4662-bb89-3c7aba25c641 service neutron] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:43.317628 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-8c82c3d1-8d20-4662-bb89-3c7aba25c641 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:43.337401 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82c3d1-8d20-4662-bb89-3c7aba25c641 service neutron] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:43.396884 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfcbade-9eb0-4128-9f5b-47a45419e463 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:43.397561 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfcbade-9eb0-4128-9f5b-47a45419e463 service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:43.397844 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfcbade-9eb0-4128-9f5b-47a45419e463 service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:43.398115 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfcbade-9eb0-4128-9f5b-47a45419e463 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:43.408576 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfcbade-9eb0-4128-9f5b-47a45419e463 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:43.410221 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfcbade-9eb0-4128-9f5b-47a45419e463 service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:43.421739 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 977/1936] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:52:43.438624 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:52:43.878249 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b53bb-7072-4bfe-9daa-eda2bedd2d7c None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:43.878249 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-bb3b53bb-7072-4bfe-9daa-eda2bedd2d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:43.878721 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfcbade-9eb0-4128-9f5b-47a45419e463 service neutron] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:43.880382 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-2cfcbade-9eb0-4128-9f5b-47a45419e463 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:43.896373 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfcbade-9eb0-4128-9f5b-47a45419e463 service neutron] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:43.898374 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b53bb-7072-4bfe-9daa-eda2bedd2d7c None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:43.907336 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edfdce5-b3d8-401a-b6f0-9d81b42831a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:43.909026 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edfdce5-b3d8-401a-b6f0-9d81b42831a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:43.909358 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edfdce5-b3d8-401a-b6f0-9d81b42831a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:43.910538 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edfdce5-b3d8-401a-b6f0-9d81b42831a8 admin admin] PATH_INFO: `/v3/projects/83609a80d1564fb09dd059b5914497e6` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:43.910861 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab333854-e61b-4dd8-a2b2-db69f803bad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:43.912273 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edfdce5-b3d8-401a-b6f0-9d81b42831a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83609a80d1564fb09dd059b5914497e6)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:43.912477 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab333854-e61b-4dd8-a2b2-db69f803bad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:43.912842 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab333854-e61b-4dd8-a2b2-db69f803bad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:43.913319 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab333854-e61b-4dd8-a2b2-db69f803bad9 admin admin] PATH_INFO: `/v3/projects/d78dbdcb568342559c2792156caa2008` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:43.914630 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab333854-e61b-4dd8-a2b2-db69f803bad9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d78dbdcb568342559c2792156caa2008)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:43.914857 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edfdce5-b3d8-401a-b6f0-9d81b42831a8 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:43.924941 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab333854-e61b-4dd8-a2b2-db69f803bad9 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:44.098057 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-ab333854-e61b-4dd8-a2b2-db69f803bad9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd78dbdcb568342559c2792156caa2008', 'request_id': 'req-ab333854-e61b-4dd8-a2b2-db69f803bad9'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:44.101623 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-4edfdce5-b3d8-401a-b6f0-9d81b42831a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83609a80d1564fb09dd059b5914497e6', 'request_id': 'req-4edfdce5-b3d8-401a-b6f0-9d81b42831a8'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:44.112775 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-ab333854-e61b-4dd8-a2b2-db69f803bad9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd78dbdcb568342559c2792156caa2008', 'request_id': 'req-ab333854-e61b-4dd8-a2b2-db69f803bad9'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:44.119511 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-4edfdce5-b3d8-401a-b6f0-9d81b42831a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83609a80d1564fb09dd059b5914497e6', 'request_id': 'req-4edfdce5-b3d8-401a-b6f0-9d81b42831a8'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:44.127951 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-4edfdce5-b3d8-401a-b6f0-9d81b42831a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83609a80d1564fb09dd059b5914497e6', 'request_id': 'req-4edfdce5-b3d8-401a-b6f0-9d81b42831a8'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:44.234467 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-ab333854-e61b-4dd8-a2b2-db69f803bad9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd78dbdcb568342559c2792156caa2008', 'request_id': 'req-ab333854-e61b-4dd8-a2b2-db69f803bad9'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:44.250138 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-ab333854-e61b-4dd8-a2b2-db69f803bad9 admin admin] The token cache is being invalidate because project d78dbdcb568342559c2792156caa2008 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:52:44.250505 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-ab333854-e61b-4dd8-a2b2-db69f803bad9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:44.252043 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-ab333854-e61b-4dd8-a2b2-db69f803bad9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:44.257488 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 960/1937] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:52:43 2022] DELETE /identity/v3/projects/d78dbdcb568342559c2792156caa2008 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:44.258450 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab333854-e61b-4dd8-a2b2-db69f803bad9 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:44.259988 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-ab333854-e61b-4dd8-a2b2-db69f803bad9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:44.344390 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab333854-e61b-4dd8-a2b2-db69f803bad9 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:44.349285 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0441a1-478a-4c5f-b6f3-e9f054389775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:44.349913 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0441a1-478a-4c5f-b6f3-e9f054389775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:44.350243 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0441a1-478a-4c5f-b6f3-e9f054389775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:44.350519 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0441a1-478a-4c5f-b6f3-e9f054389775 admin admin] PATH_INFO: `/v3/users/c4003cad44634fd0914d8c4551b33adb` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:44.351904 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0441a1-478a-4c5f-b6f3-e9f054389775 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4003cad44634fd0914d8c4551b33adb)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:44.353026 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-4edfdce5-b3d8-401a-b6f0-9d81b42831a8 admin admin] The token cache is being invalidate because project 83609a80d1564fb09dd059b5914497e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:52:44.364269 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-4edfdce5-b3d8-401a-b6f0-9d81b42831a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:44.364403 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0441a1-478a-4c5f-b6f3-e9f054389775 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:44.364484 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-4edfdce5-b3d8-401a-b6f0-9d81b42831a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:44.364484 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 978/1938] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:52:43 2022] DELETE /identity/v3/projects/83609a80d1564fb09dd059b5914497e6 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:44.364484 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7c039-aac8-4f82-b406-8dc684fd8220 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:44.364484 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7c039-aac8-4f82-b406-8dc684fd8220 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:44.364484 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7c039-aac8-4f82-b406-8dc684fd8220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:44.384414 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-6cf7c039-aac8-4f82-b406-8dc684fd8220 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:44.385803 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-6cf7c039-aac8-4f82-b406-8dc684fd8220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:44.394304 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 979/1939] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:44.402853 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39030e92-4f28-4b42-9b98-a1e0c2e76e93 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:44.404355 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39030e92-4f28-4b42-9b98-a1e0c2e76e93 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:44.410488 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39030e92-4f28-4b42-9b98-a1e0c2e76e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:44.430140 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-39030e92-4f28-4b42-9b98-a1e0c2e76e93 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:44.437149 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-39030e92-4f28-4b42-9b98-a1e0c2e76e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:44.445775 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 980/1940] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:44.448016 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39030e92-4f28-4b42-9b98-a1e0c2e76e93 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:44.449382 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-39030e92-4f28-4b42-9b98-a1e0c2e76e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:44.461614 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39030e92-4f28-4b42-9b98-a1e0c2e76e93 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:44.466339 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db22a0f-e8c9-466c-a5fa-57f2bfa52fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:44.467081 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db22a0f-e8c9-466c-a5fa-57f2bfa52fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:44.467364 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db22a0f-e8c9-466c-a5fa-57f2bfa52fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:44.467637 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db22a0f-e8c9-466c-a5fa-57f2bfa52fd7 admin admin] PATH_INFO: `/v3/projects/9c121375ac1548e18d6416217b28136d` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:44.468749 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db22a0f-e8c9-466c-a5fa-57f2bfa52fd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c121375ac1548e18d6416217b28136d)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:44.470640 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db22a0f-e8c9-466c-a5fa-57f2bfa52fd7 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:44.707160 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-8e0441a1-478a-4c5f-b6f3-e9f054389775 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4003cad44634fd0914d8c4551b33adb'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:44.707825 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-8e0441a1-478a-4c5f-b6f3-e9f054389775 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4003cad44634fd0914d8c4551b33adb'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:44.715861 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-2db22a0f-e8c9-466c-a5fa-57f2bfa52fd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c121375ac1548e18d6416217b28136d', 'request_id': 'req-2db22a0f-e8c9-466c-a5fa-57f2bfa52fd7'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:44.726979 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-2db22a0f-e8c9-466c-a5fa-57f2bfa52fd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c121375ac1548e18d6416217b28136d', 'request_id': 'req-2db22a0f-e8c9-466c-a5fa-57f2bfa52fd7'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:44.734505 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-2db22a0f-e8c9-466c-a5fa-57f2bfa52fd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c121375ac1548e18d6416217b28136d', 'request_id': 'req-2db22a0f-e8c9-466c-a5fa-57f2bfa52fd7'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:44.838855 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-8e0441a1-478a-4c5f-b6f3-e9f054389775 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4003cad44634fd0914d8c4551b33adb'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:44.839449 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-8e0441a1-478a-4c5f-b6f3-e9f054389775 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4003cad44634fd0914d8c4551b33adb'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:44.848114 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-8e0441a1-478a-4c5f-b6f3-e9f054389775 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4003cad44634fd0914d8c4551b33adb'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:44.866209 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 961/1941] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:52:44 2022] DELETE /identity/v3/users/c4003cad44634fd0914d8c4551b33adb => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:44.867743 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0441a1-478a-4c5f-b6f3-e9f054389775 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:44.869214 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-8e0441a1-478a-4c5f-b6f3-e9f054389775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:44.939674 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0441a1-478a-4c5f-b6f3-e9f054389775 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:44.945495 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70049e-a0d2-4704-af79-f38ddb1188ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:44.946564 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70049e-a0d2-4704-af79-f38ddb1188ad admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:44.946952 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70049e-a0d2-4704-af79-f38ddb1188ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:44.947352 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70049e-a0d2-4704-af79-f38ddb1188ad admin admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:44.948168 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd70049e-a0d2-4704-af79-f38ddb1188ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:52:44.948568 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd70049e-a0d2-4704-af79-f38ddb1188ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:44.950848 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd70049e-a0d2-4704-af79-f38ddb1188ad admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:44.952862 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-2db22a0f-e8c9-466c-a5fa-57f2bfa52fd7 admin admin] The token cache is being invalidate because project 9c121375ac1548e18d6416217b28136d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:52:44.953512 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-2db22a0f-e8c9-466c-a5fa-57f2bfa52fd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:44.956523 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-2db22a0f-e8c9-466c-a5fa-57f2bfa52fd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:44.961610 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 981/1942] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:52:44 2022] DELETE /identity/v3/projects/9c121375ac1548e18d6416217b28136d => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:44.965546 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db22a0f-e8c9-466c-a5fa-57f2bfa52fd7 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:44.969724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 962/1943] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:52:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:52:44.974207 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-2db22a0f-e8c9-466c-a5fa-57f2bfa52fd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:44.975752 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70049e-a0d2-4704-af79-f38ddb1188ad admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:44.977961 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-cd70049e-a0d2-4704-af79-f38ddb1188ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:44.995387 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70049e-a0d2-4704-af79-f38ddb1188ad admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:45.015463 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0589f-53f6-43a4-86ab-87f93ecb4c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:45.015463 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0589f-53f6-43a4-86ab-87f93ecb4c41 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:45.015463 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0589f-53f6-43a4-86ab-87f93ecb4c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:45.015463 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0589f-53f6-43a4-86ab-87f93ecb4c41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:45.015750 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be0589f-53f6-43a4-86ab-87f93ecb4c41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:45.015750 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be0589f-53f6-43a4-86ab-87f93ecb4c41 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:45.058160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db22a0f-e8c9-466c-a5fa-57f2bfa52fd7 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:45.064904 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2bc57-25d0-4711-b448-7524d202c195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:45.065619 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2bc57-25d0-4711-b448-7524d202c195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:45.065905 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2bc57-25d0-4711-b448-7524d202c195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:45.066185 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2bc57-25d0-4711-b448-7524d202c195 admin admin] PATH_INFO: `/v3/users/df75ca2b0fc64801abe1d61ded0b0762` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:45.067610 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df2bc57-25d0-4711-b448-7524d202c195 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df75ca2b0fc64801abe1d61ded0b0762)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:45.069792 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df2bc57-25d0-4711-b448-7524d202c195 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:45.107827 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:52:45.143224 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 963/1944] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:52:44 2022] POST /identity/v3/projects => generated 407 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 07:52:45.143913 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0589f-53f6-43a4-86ab-87f93ecb4c41 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:45.146368 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-1be0589f-53f6-43a4-86ab-87f93ecb4c41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:45.304964 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0589f-53f6-43a4-86ab-87f93ecb4c41 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:45.310482 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0a947-3669-45b3-aec1-d968861eda6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:45.321620 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0a947-3669-45b3-aec1-d968861eda6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:45.323805 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0a947-3669-45b3-aec1-d968861eda6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:45.323805 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0a947-3669-45b3-aec1-d968861eda6b admin admin] PATH_INFO: `/v3/users/48895a681ad94a6db93a85c1d5ced7dc` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:45.324357 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f0a947-3669-45b3-aec1-d968861eda6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=48895a681ad94a6db93a85c1d5ced7dc)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:45.327304 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f0a947-3669-45b3-aec1-d968861eda6b admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:45.378727 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-2df2bc57-25d0-4711-b448-7524d202c195 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df75ca2b0fc64801abe1d61ded0b0762'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:45.387687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-2df2bc57-25d0-4711-b448-7524d202c195 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df75ca2b0fc64801abe1d61ded0b0762'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:45.570483 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-2df2bc57-25d0-4711-b448-7524d202c195 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df75ca2b0fc64801abe1d61ded0b0762'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:45.571142 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-2df2bc57-25d0-4711-b448-7524d202c195 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df75ca2b0fc64801abe1d61ded0b0762'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:45.585592 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-2df2bc57-25d0-4711-b448-7524d202c195 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df75ca2b0fc64801abe1d61ded0b0762'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:45.592334 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 982/1945] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:52:44 2022] DELETE /identity/v3/users/df75ca2b0fc64801abe1d61ded0b0762 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:45.593298 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2bc57-25d0-4711-b448-7524d202c195 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:45.594707 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-2df2bc57-25d0-4711-b448-7524d202c195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:45.623023 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-f0f0a947-3669-45b3-aec1-d968861eda6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48895a681ad94a6db93a85c1d5ced7dc'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:45.624091 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-f0f0a947-3669-45b3-aec1-d968861eda6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48895a681ad94a6db93a85c1d5ced7dc'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:45.680279 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2bc57-25d0-4711-b448-7524d202c195 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:45.687151 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0450eaf-4a4c-4759-8dbb-99daa50ed97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:45.687803 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0450eaf-4a4c-4759-8dbb-99daa50ed97d admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:45.688086 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0450eaf-4a4c-4759-8dbb-99daa50ed97d admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:45.688400 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0450eaf-4a4c-4759-8dbb-99daa50ed97d admin admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:45.689034 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0450eaf-4a4c-4759-8dbb-99daa50ed97d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:45.691052 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0450eaf-4a4c-4759-8dbb-99daa50ed97d admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:45.708048 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-f0f0a947-3669-45b3-aec1-d968861eda6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48895a681ad94a6db93a85c1d5ced7dc'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:45.709165 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-f0f0a947-3669-45b3-aec1-d968861eda6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48895a681ad94a6db93a85c1d5ced7dc'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:45.717267 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-f0f0a947-3669-45b3-aec1-d968861eda6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48895a681ad94a6db93a85c1d5ced7dc'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:45.735132 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 964/1946] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:52:45 2022] DELETE /identity/v3/users/48895a681ad94a6db93a85c1d5ced7dc => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:45.736056 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0a947-3669-45b3-aec1-d968861eda6b admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:45.737423 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-f0f0a947-3669-45b3-aec1-d968861eda6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:45.801685 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 983/1947] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:52:45 2022] POST /identity/v3/users => generated 304 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:45.806065 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16f777-14ce-40aa-b2a8-1cb0bb115f6a None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:45.806348 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16f777-14ce-40aa-b2a8-1cb0bb115f6a None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:45.806875 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16f777-14ce-40aa-b2a8-1cb0bb115f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:45.827552 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0a947-3669-45b3-aec1-d968861eda6b admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:45.832650 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc80b1-4737-410b-9a88-4b94e5ceea8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:45.833032 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-ca16f777-14ce-40aa-b2a8-1cb0bb115f6a None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:45.833143 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc80b1-4737-410b-9a88-4b94e5ceea8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:45.833357 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc80b1-4737-410b-9a88-4b94e5ceea8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:45.833631 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc80b1-4737-410b-9a88-4b94e5ceea8c admin admin] PATH_INFO: `/v3/projects/9c599661968541cc98194cebab10f157` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:45.834566 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-ca16f777-14ce-40aa-b2a8-1cb0bb115f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:45.834757 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc80b1-4737-410b-9a88-4b94e5ceea8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c599661968541cc98194cebab10f157)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:45.836743 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc80b1-4737-410b-9a88-4b94e5ceea8c admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:45.843385 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 984/1948] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:45.844490 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16f777-14ce-40aa-b2a8-1cb0bb115f6a None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:45.846155 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-ca16f777-14ce-40aa-b2a8-1cb0bb115f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:45.859972 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16f777-14ce-40aa-b2a8-1cb0bb115f6a None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:45.865261 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b214a8-3f3c-43ca-86f5-0a998bc47e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:45.865877 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b214a8-3f3c-43ca-86f5-0a998bc47e9c admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:45.866152 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b214a8-3f3c-43ca-86f5-0a998bc47e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:45.866419 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b214a8-3f3c-43ca-86f5-0a998bc47e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:45.867211 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b214a8-3f3c-43ca-86f5-0a998bc47e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:45.868993 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b214a8-3f3c-43ca-86f5-0a998bc47e9c admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:45.880823 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 985/1949] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:45.881495 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b214a8-3f3c-43ca-86f5-0a998bc47e9c admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:45.884464 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-37b214a8-3f3c-43ca-86f5-0a998bc47e9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:45.967906 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b214a8-3f3c-43ca-86f5-0a998bc47e9c admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:45.972032 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174c1b8-8c41-4792-9361-ff4241a0bb00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:45.975505 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174c1b8-8c41-4792-9361-ff4241a0bb00 service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:45.975505 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174c1b8-8c41-4792-9361-ff4241a0bb00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:45.975505 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174c1b8-8c41-4792-9361-ff4241a0bb00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:45.988943 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-defc80b1-4737-410b-9a88-4b94e5ceea8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c599661968541cc98194cebab10f157', 'request_id': 'req-defc80b1-4737-410b-9a88-4b94e5ceea8c'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:45.997333 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7174c1b8-8c41-4792-9361-ff4241a0bb00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:45.998842 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7174c1b8-8c41-4792-9361-ff4241a0bb00 service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:46.006611 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-defc80b1-4737-410b-9a88-4b94e5ceea8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c599661968541cc98194cebab10f157', 'request_id': 'req-defc80b1-4737-410b-9a88-4b94e5ceea8c'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:46.011056 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 986/1950] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:52:46.012063 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174c1b8-8c41-4792-9361-ff4241a0bb00 service neutron] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:46.026005 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174c1b8-8c41-4792-9361-ff4241a0bb00 service neutron] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:46.087181 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-defc80b1-4737-410b-9a88-4b94e5ceea8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c599661968541cc98194cebab10f157', 'request_id': 'req-defc80b1-4737-410b-9a88-4b94e5ceea8c'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:46.091680 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2025fe-f5f8-44a7-b9ce-2ef7c8e1e419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:46.092381 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2025fe-f5f8-44a7-b9ce-2ef7c8e1e419 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:46.092865 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2025fe-f5f8-44a7-b9ce-2ef7c8e1e419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:46.093347 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2025fe-f5f8-44a7-b9ce-2ef7c8e1e419 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:46.093859 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2025fe-f5f8-44a7-b9ce-2ef7c8e1e419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:46.096670 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2025fe-f5f8-44a7-b9ce-2ef7c8e1e419 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:46.102300 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-defc80b1-4737-410b-9a88-4b94e5ceea8c admin admin] The token cache is being invalidate because project 9c599661968541cc98194cebab10f157 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:52:46.102941 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-defc80b1-4737-410b-9a88-4b94e5ceea8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:46.104162 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-defc80b1-4737-410b-9a88-4b94e5ceea8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:46.107671 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 965/1951] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:52:45 2022] DELETE /identity/v3/projects/9c599661968541cc98194cebab10f157 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:46.111387 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 987/1952] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:46.115200 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a5171-7c8a-47e3-b486-5cfa0bd847c0 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:46.115341 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2025fe-f5f8-44a7-b9ce-2ef7c8e1e419 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:46.115857 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a5171-7c8a-47e3-b486-5cfa0bd847c0 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:46.116350 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a5171-7c8a-47e3-b486-5cfa0bd847c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:46.117669 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-7b2025fe-f5f8-44a7-b9ce-2ef7c8e1e419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:46.135324 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2025fe-f5f8-44a7-b9ce-2ef7c8e1e419 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:46.138946 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-099a5171-7c8a-47e3-b486-5cfa0bd847c0 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:46.140486 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-099a5171-7c8a-47e3-b486-5cfa0bd847c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:46.143861 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84857468-27d0-4afd-b833-c08964bf1a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:46.144851 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84857468-27d0-4afd-b833-c08964bf1a1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:46.145276 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84857468-27d0-4afd-b833-c08964bf1a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:46.145908 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84857468-27d0-4afd-b833-c08964bf1a1b admin admin] PATH_INFO: `/v3/projects/0b935f03e3494158894711cd3fc2e40d/users/cddee0903c9a46909498fdc9cefbb78d/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:46.148866 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 966/1953] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:46.157977 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be058f0-b8a8-47d0-beb5-1659a52308bb None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:46.158419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be058f0-b8a8-47d0-beb5-1659a52308bb None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:46.158793 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be058f0-b8a8-47d0-beb5-1659a52308bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:46.169907 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84857468-27d0-4afd-b833-c08964bf1a1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b935f03e3494158894711cd3fc2e40d, user_id=cddee0903c9a46909498fdc9cefbb78d, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:46.172979 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84857468-27d0-4afd-b833-c08964bf1a1b admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:46.184295 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-0be058f0-b8a8-47d0-beb5-1659a52308bb None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:46.187108 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-0be058f0-b8a8-47d0-beb5-1659a52308bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:46.189094 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:52:46.197269 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 967/1954] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:46.202686 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be058f0-b8a8-47d0-beb5-1659a52308bb None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:46.212059 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be058f0-b8a8-47d0-beb5-1659a52308bb None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:46.217894 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd357547-0af1-4047-b76c-fa789a1c1045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:46.218500 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd357547-0af1-4047-b76c-fa789a1c1045 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:46.218781 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd357547-0af1-4047-b76c-fa789a1c1045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:46.219097 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd357547-0af1-4047-b76c-fa789a1c1045 admin admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:46.219842 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd357547-0af1-4047-b76c-fa789a1c1045 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:52:46.220215 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd357547-0af1-4047-b76c-fa789a1c1045 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:46.221843 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd357547-0af1-4047-b76c-fa789a1c1045 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:46.234126 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 968/1955] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:52:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:52:46.238298 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd357547-0af1-4047-b76c-fa789a1c1045 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:46.248791 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd357547-0af1-4047-b76c-fa789a1c1045 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:46.253478 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200ea6f-436e-4767-9029-1cd627b32778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:46.254076 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200ea6f-436e-4767-9029-1cd627b32778 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:46.254348 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200ea6f-436e-4767-9029-1cd627b32778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:46.254616 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200ea6f-436e-4767-9029-1cd627b32778 admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:46.255316 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9200ea6f-436e-4767-9029-1cd627b32778 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:46.257121 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9200ea6f-436e-4767-9029-1cd627b32778 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:46.281957 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 988/1956] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:52:46 2022] PUT /identity/v3/projects/0b935f03e3494158894711cd3fc2e40d/users/cddee0903c9a46909498fdc9cefbb78d/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:46.292501 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d839109-499a-4a7a-ba9c-81ef7264c0ef None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:46.292785 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d839109-499a-4a7a-ba9c-81ef7264c0ef None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:46.293138 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d839109-499a-4a7a-ba9c-81ef7264c0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:46.324555 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-6d839109-499a-4a7a-ba9c-81ef7264c0ef None None] MFA Rules not processed for user `cddee0903c9a46909498fdc9cefbb78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:46.326695 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-6d839109-499a-4a7a-ba9c-81ef7264c0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:46.406328 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 989/1957] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:46 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:52:46.407367 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d839109-499a-4a7a-ba9c-81ef7264c0ef None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:46.408804 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-6d839109-499a-4a7a-ba9c-81ef7264c0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:46.479176 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:52:46.487635 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d839109-499a-4a7a-ba9c-81ef7264c0ef None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:46.494213 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 969/1958] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:52:46 2022] POST /identity/v3/projects => generated 401 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 07:52:46.495394 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200ea6f-436e-4767-9029-1cd627b32778 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:46.504632 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99292d09-281f-4f8a-b6aa-8ae6ac8c803c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:46.505539 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99292d09-281f-4f8a-b6aa-8ae6ac8c803c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:46.505970 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99292d09-281f-4f8a-b6aa-8ae6ac8c803c admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:46.506393 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99292d09-281f-4f8a-b6aa-8ae6ac8c803c admin admin] PATH_INFO: `/v3/projects/d0887e2dd8ec49deab33716babd69cd4` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:46.507735 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99292d09-281f-4f8a-b6aa-8ae6ac8c803c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0887e2dd8ec49deab33716babd69cd4)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:46.512943 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99292d09-281f-4f8a-b6aa-8ae6ac8c803c admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:46.595766 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200ea6f-436e-4767-9029-1cd627b32778 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:46.600913 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28256564-2808-4b35-816b-9142a1bed1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:46.601535 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28256564-2808-4b35-816b-9142a1bed1e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:46.601889 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28256564-2808-4b35-816b-9142a1bed1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:46.602167 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28256564-2808-4b35-816b-9142a1bed1e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:46.602805 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28256564-2808-4b35-816b-9142a1bed1e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:46.604839 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28256564-2808-4b35-816b-9142a1bed1e5 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:46.690579 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-99292d09-281f-4f8a-b6aa-8ae6ac8c803c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0887e2dd8ec49deab33716babd69cd4', 'request_id': 'req-99292d09-281f-4f8a-b6aa-8ae6ac8c803c'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:46.697348 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-99292d09-281f-4f8a-b6aa-8ae6ac8c803c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0887e2dd8ec49deab33716babd69cd4', 'request_id': 'req-99292d09-281f-4f8a-b6aa-8ae6ac8c803c'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:46.704099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-99292d09-281f-4f8a-b6aa-8ae6ac8c803c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0887e2dd8ec49deab33716babd69cd4', 'request_id': 'req-99292d09-281f-4f8a-b6aa-8ae6ac8c803c'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:46.777459 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 970/1959] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:52:46 2022] POST /identity/v3/projects => generated 407 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:46.778395 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28256564-2808-4b35-816b-9142a1bed1e5 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:46.804961 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-99292d09-281f-4f8a-b6aa-8ae6ac8c803c admin admin] The token cache is being invalidate because project d0887e2dd8ec49deab33716babd69cd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:52:46.804961 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-99292d09-281f-4f8a-b6aa-8ae6ac8c803c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:46.805743 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-99292d09-281f-4f8a-b6aa-8ae6ac8c803c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:46.807451 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 990/1960] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:52:46 2022] DELETE /identity/v3/projects/d0887e2dd8ec49deab33716babd69cd4 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:46.808284 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99292d09-281f-4f8a-b6aa-8ae6ac8c803c admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:46.810685 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-99292d09-281f-4f8a-b6aa-8ae6ac8c803c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:46.849155 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28256564-2808-4b35-816b-9142a1bed1e5 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:46.853999 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e86856-c63e-459f-9fe3-4c9ef65b6ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:46.854612 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e86856-c63e-459f-9fe3-4c9ef65b6ad9 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:46.854895 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e86856-c63e-459f-9fe3-4c9ef65b6ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:46.855200 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e86856-c63e-459f-9fe3-4c9ef65b6ad9 admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:46.855828 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e86856-c63e-459f-9fe3-4c9ef65b6ad9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:46.858280 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e86856-c63e-459f-9fe3-4c9ef65b6ad9 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:46.880020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99292d09-281f-4f8a-b6aa-8ae6ac8c803c admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:46.885258 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e9d2a-aefd-4fb5-a952-bc646871f604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:46.885908 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e9d2a-aefd-4fb5-a952-bc646871f604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:46.889691 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e9d2a-aefd-4fb5-a952-bc646871f604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:46.889691 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e9d2a-aefd-4fb5-a952-bc646871f604 admin admin] PATH_INFO: `/v3/projects/33b178342c9c4e60a0189507a1038ac6` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:46.889691 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e9d2a-aefd-4fb5-a952-bc646871f604 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33b178342c9c4e60a0189507a1038ac6)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:46.889691 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e9d2a-aefd-4fb5-a952-bc646871f604 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:46.975475 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 971/1961] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:52:46 2022] POST /identity/v3/users => generated 301 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:46.976465 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e86856-c63e-459f-9fe3-4c9ef65b6ad9 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:46.978483 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-89e86856-c63e-459f-9fe3-4c9ef65b6ad9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:46.992880 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e86856-c63e-459f-9fe3-4c9ef65b6ad9 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:47.001163 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddca138-e8b3-4980-813b-766164ebd252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:47.001807 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddca138-e8b3-4980-813b-766164ebd252 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:47.002093 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddca138-e8b3-4980-813b-766164ebd252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:47.009862 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddca138-e8b3-4980-813b-766164ebd252 admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:47.009862 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddca138-e8b3-4980-813b-766164ebd252 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:47.009862 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddca138-e8b3-4980-813b-766164ebd252 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:47.102847 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-842e9d2a-aefd-4fb5-a952-bc646871f604 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33b178342c9c4e60a0189507a1038ac6', 'request_id': 'req-842e9d2a-aefd-4fb5-a952-bc646871f604'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:47.109184 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-842e9d2a-aefd-4fb5-a952-bc646871f604 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33b178342c9c4e60a0189507a1038ac6', 'request_id': 'req-842e9d2a-aefd-4fb5-a952-bc646871f604'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:47.115341 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-842e9d2a-aefd-4fb5-a952-bc646871f604 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33b178342c9c4e60a0189507a1038ac6', 'request_id': 'req-842e9d2a-aefd-4fb5-a952-bc646871f604'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:47.136399 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 972/1962] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:52:46 2022] POST /identity/v3/users => generated 310 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:47.136399 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccece03c-25c9-444a-a4c1-434aa19bd7b3 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:47.136399 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccece03c-25c9-444a-a4c1-434aa19bd7b3 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:47.136399 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccece03c-25c9-444a-a4c1-434aa19bd7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:47.158795 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-ccece03c-25c9-444a-a4c1-434aa19bd7b3 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:47.160296 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-ccece03c-25c9-444a-a4c1-434aa19bd7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:47.223662 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 973/1963] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:47.224531 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccece03c-25c9-444a-a4c1-434aa19bd7b3 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:47.226097 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-ccece03c-25c9-444a-a4c1-434aa19bd7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:47.239018 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccece03c-25c9-444a-a4c1-434aa19bd7b3 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:47.243628 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab3abf4-df1c-4416-86d4-077ebc74c21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:47.244239 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3abf4-df1c-4416-86d4-077ebc74c21c admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:47.244513 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3abf4-df1c-4416-86d4-077ebc74c21c admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:47.244780 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3abf4-df1c-4416-86d4-077ebc74c21c admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:47.245812 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab3abf4-df1c-4416-86d4-077ebc74c21c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:47.248404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab3abf4-df1c-4416-86d4-077ebc74c21c admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:47.258234 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 974/1964] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:47.259249 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab3abf4-df1c-4416-86d4-077ebc74c21c admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:47.268531 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-842e9d2a-aefd-4fb5-a952-bc646871f604 admin admin] The token cache is being invalidate because project 33b178342c9c4e60a0189507a1038ac6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:52:47.268946 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-842e9d2a-aefd-4fb5-a952-bc646871f604 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:47.269667 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-842e9d2a-aefd-4fb5-a952-bc646871f604 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:47.269905 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab3abf4-df1c-4416-86d4-077ebc74c21c admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:47.272007 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 991/1965] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:52:46 2022] DELETE /identity/v3/projects/33b178342c9c4e60a0189507a1038ac6 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:47.273515 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571dc13-28e4-41b9-b598-3200dab6e7aa None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:47.273891 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571dc13-28e4-41b9-b598-3200dab6e7aa None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:47.274461 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571dc13-28e4-41b9-b598-3200dab6e7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:47.275238 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7179649-944e-4560-9185-93a4a984386a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:47.275853 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7179649-944e-4560-9185-93a4a984386a admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:47.276216 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7179649-944e-4560-9185-93a4a984386a admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:47.276637 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7179649-944e-4560-9185-93a4a984386a admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:47.277522 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7179649-944e-4560-9185-93a4a984386a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:47.279800 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7179649-944e-4560-9185-93a4a984386a admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:47.291389 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 975/1966] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:47.292246 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7179649-944e-4560-9185-93a4a984386a admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:47.296930 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-a7179649-944e-4560-9185-93a4a984386a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:47.298949 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-9571dc13-28e4-41b9-b598-3200dab6e7aa None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:47.300291 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-9571dc13-28e4-41b9-b598-3200dab6e7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:47.312060 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 992/1967] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:47.315454 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7179649-944e-4560-9185-93a4a984386a admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:47.316596 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9571dc13-28e4-41b9-b598-3200dab6e7aa None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:47.318865 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-9571dc13-28e4-41b9-b598-3200dab6e7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:47.321053 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f9628-f569-451d-9143-65f075a4b37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:47.338219 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f9628-f569-451d-9143-65f075a4b37b admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:47.338219 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f9628-f569-451d-9143-65f075a4b37b admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:47.338219 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f9628-f569-451d-9143-65f075a4b37b admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:47.338219 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f9628-f569-451d-9143-65f075a4b37b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:47.338219 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f9628-f569-451d-9143-65f075a4b37b admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:47.338738 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9571dc13-28e4-41b9-b598-3200dab6e7aa None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:47.338738 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de096b8c-6c26-4868-bcf0-8e6a73eea012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:47.338892 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 976/1968] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:47.338963 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de096b8c-6c26-4868-bcf0-8e6a73eea012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:47.338963 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de096b8c-6c26-4868-bcf0-8e6a73eea012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:47.339114 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f9628-f569-451d-9143-65f075a4b37b admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:47.339197 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de096b8c-6c26-4868-bcf0-8e6a73eea012 admin admin] PATH_INFO: `/v3/users/876475be58b74b9ab5712524d2cf083b` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:47.340511 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de096b8c-6c26-4868-bcf0-8e6a73eea012 admin admin] RBAC: Authorizing `identity:delete_user(user_id=876475be58b74b9ab5712524d2cf083b)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:47.342348 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-ff3f9628-f569-451d-9143-65f075a4b37b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:47.342794 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de096b8c-6c26-4868-bcf0-8e6a73eea012 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:47.356105 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f9628-f569-451d-9143-65f075a4b37b admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:47.361783 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e69e4-9b42-4c66-abb1-fe0cd6c95071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:47.362899 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e69e4-9b42-4c66-abb1-fe0cd6c95071 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:47.363349 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e69e4-9b42-4c66-abb1-fe0cd6c95071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:47.363702 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e69e4-9b42-4c66-abb1-fe0cd6c95071 admin admin] PATH_INFO: `/v3/projects/2427b02be5fb427ba7b880f95535a3f7/users/b62028320c474bde875bb5f6fcebc0d8/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:47.382236 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e69e4-9b42-4c66-abb1-fe0cd6c95071 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2427b02be5fb427ba7b880f95535a3f7, user_id=b62028320c474bde875bb5f6fcebc0d8, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:47.384942 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e69e4-9b42-4c66-abb1-fe0cd6c95071 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:47.519030 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 977/1969] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:52:47 2022] PUT /identity/v3/projects/2427b02be5fb427ba7b880f95535a3f7/users/b62028320c474bde875bb5f6fcebc0d8/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:47.522077 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e69e4-9b42-4c66-abb1-fe0cd6c95071 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:47.581621 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e69e4-9b42-4c66-abb1-fe0cd6c95071 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:47.586416 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cda8b6-42d1-476c-9592-3db969f919b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:47.587239 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cda8b6-42d1-476c-9592-3db969f919b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:47.587521 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cda8b6-42d1-476c-9592-3db969f919b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:47.587790 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cda8b6-42d1-476c-9592-3db969f919b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:47.588454 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cda8b6-42d1-476c-9592-3db969f919b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:52:47.588736 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cda8b6-42d1-476c-9592-3db969f919b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:47.590455 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cda8b6-42d1-476c-9592-3db969f919b7 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:47.603085 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 978/1970] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:52:47.603953 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cda8b6-42d1-476c-9592-3db969f919b7 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:47.614697 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cda8b6-42d1-476c-9592-3db969f919b7 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:47.619517 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b862e1c-02f1-4b61-b5fa-0c44caeae092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:47.620144 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b862e1c-02f1-4b61-b5fa-0c44caeae092 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:47.620422 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b862e1c-02f1-4b61-b5fa-0c44caeae092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:47.620696 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b862e1c-02f1-4b61-b5fa-0c44caeae092 admin admin] PATH_INFO: `/v3/projects/1371d2d2819042beaa73ab5144147893/users/b14367ef1a4648188de7303c8bc4cd4a/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:47.635479 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b862e1c-02f1-4b61-b5fa-0c44caeae092 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1371d2d2819042beaa73ab5144147893, user_id=b14367ef1a4648188de7303c8bc4cd4a, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:47.644065 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b862e1c-02f1-4b61-b5fa-0c44caeae092 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:47.660288 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-de096b8c-6c26-4868-bcf0-8e6a73eea012 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '876475be58b74b9ab5712524d2cf083b'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:47.667520 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-de096b8c-6c26-4868-bcf0-8e6a73eea012 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '876475be58b74b9ab5712524d2cf083b'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:47.792019 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-de096b8c-6c26-4868-bcf0-8e6a73eea012 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '876475be58b74b9ab5712524d2cf083b'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:47.793396 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-de096b8c-6c26-4868-bcf0-8e6a73eea012 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '876475be58b74b9ab5712524d2cf083b'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:47.804419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 979/1971] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:52:47 2022] PUT /identity/v3/projects/1371d2d2819042beaa73ab5144147893/users/b14367ef1a4648188de7303c8bc4cd4a/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:47.804419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b862e1c-02f1-4b61-b5fa-0c44caeae092 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:47.804419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-5b862e1c-02f1-4b61-b5fa-0c44caeae092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:47.814032 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-de096b8c-6c26-4868-bcf0-8e6a73eea012 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '876475be58b74b9ab5712524d2cf083b'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:47.820863 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 993/1972] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:52:47 2022] DELETE /identity/v3/users/876475be58b74b9ab5712524d2cf083b => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:47.821998 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de096b8c-6c26-4868-bcf0-8e6a73eea012 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:47.823718 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-de096b8c-6c26-4868-bcf0-8e6a73eea012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:47.888419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b862e1c-02f1-4b61-b5fa-0c44caeae092 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:47.893953 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adadf8cc-8bc5-40f6-8d91-2a8691341648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:47.894761 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadf8cc-8bc5-40f6-8d91-2a8691341648 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:47.895059 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadf8cc-8bc5-40f6-8d91-2a8691341648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:47.895600 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadf8cc-8bc5-40f6-8d91-2a8691341648 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:47.896038 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adadf8cc-8bc5-40f6-8d91-2a8691341648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:47.896957 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de096b8c-6c26-4868-bcf0-8e6a73eea012 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:47.897644 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adadf8cc-8bc5-40f6-8d91-2a8691341648 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:47.902015 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e8016-f8e4-4d54-af34-22adbc655696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:47.902701 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e8016-f8e4-4d54-af34-22adbc655696 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:47.903368 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e8016-f8e4-4d54-af34-22adbc655696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:47.903368 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e8016-f8e4-4d54-af34-22adbc655696 admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:47.904295 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e8016-f8e4-4d54-af34-22adbc655696 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:47.906478 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e8016-f8e4-4d54-af34-22adbc655696 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:47.909791 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 980/1973] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:47.912357 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adef3ed-e966-431e-a906-77c7cb2abd08 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:47.912826 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adef3ed-e966-431e-a906-77c7cb2abd08 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:47.913327 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adef3ed-e966-431e-a906-77c7cb2abd08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:47.944439 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-3adef3ed-e966-431e-a906-77c7cb2abd08 None None] MFA Rules not processed for user `b14367ef1a4648188de7303c8bc4cd4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:47.945718 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-3adef3ed-e966-431e-a906-77c7cb2abd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:48.022248 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 981/1974] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:47 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:48.024120 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adef3ed-e966-431e-a906-77c7cb2abd08 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:48.036324 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adef3ed-e966-431e-a906-77c7cb2abd08 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:48.038897 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 994/1975] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:52:47 2022] POST /identity/v3/projects => generated 367 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:48.039834 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e8016-f8e4-4d54-af34-22adbc655696 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:48.044451 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-086e8016-f8e4-4d54-af34-22adbc655696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:48.044815 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5023a62-3631-46a5-80e0-cecb8b585595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:48.044815 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5023a62-3631-46a5-80e0-cecb8b585595 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:48.044815 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5023a62-3631-46a5-80e0-cecb8b585595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:48.044815 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5023a62-3631-46a5-80e0-cecb8b585595 admin admin] PATH_INFO: `/v3/projects/2427b02be5fb427ba7b880f95535a3f7/users/b62028320c474bde875bb5f6fcebc0d8/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:48.047278 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5023a62-3631-46a5-80e0-cecb8b585595 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2427b02be5fb427ba7b880f95535a3f7, user_id=b62028320c474bde875bb5f6fcebc0d8, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:48.050059 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5023a62-3631-46a5-80e0-cecb8b585595 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:48.067197 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 982/1976] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:52:48 2022] PUT /identity/v3/projects/2427b02be5fb427ba7b880f95535a3f7/users/b62028320c474bde875bb5f6fcebc0d8/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:48.067197 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5023a62-3631-46a5-80e0-cecb8b585595 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:48.161175 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e8016-f8e4-4d54-af34-22adbc655696 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:48.210693 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5023a62-3631-46a5-80e0-cecb8b585595 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:48.216720 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa47e5-bfad-4339-bceb-202309c0d4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:48.217669 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa47e5-bfad-4339-bceb-202309c0d4c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:48.217959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa47e5-bfad-4339-bceb-202309c0d4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:48.218238 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa47e5-bfad-4339-bceb-202309c0d4c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:48.218889 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa47e5-bfad-4339-bceb-202309c0d4c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:48.220885 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa47e5-bfad-4339-bceb-202309c0d4c1 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:48.235302 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489b898-8a40-4d27-bd69-696581c272f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:48.235925 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489b898-8a40-4d27-bd69-696581c272f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:48.236273 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489b898-8a40-4d27-bd69-696581c272f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:48.236554 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489b898-8a40-4d27-bd69-696581c272f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:48.237194 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489b898-8a40-4d27-bd69-696581c272f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:48.239179 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489b898-8a40-4d27-bd69-696581c272f9 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:48.383850 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 983/1977] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:52:48 2022] POST /identity/v3/users => generated 284 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:48.385417 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50009812-2a6a-4286-a613-bb4442e575e6 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:48.385707 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50009812-2a6a-4286-a613-bb4442e575e6 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:48.385982 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50009812-2a6a-4286-a613-bb4442e575e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:48.421101 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 995/1978] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:52:48 2022] POST /identity/v3/projects => generated 399 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:48.423378 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489b898-8a40-4d27-bd69-696581c272f9 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:48.424436 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-50009812-2a6a-4286-a613-bb4442e575e6 None None] MFA Rules not processed for user `b62028320c474bde875bb5f6fcebc0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:48.425569 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-50009812-2a6a-4286-a613-bb4442e575e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:48.501577 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489b898-8a40-4d27-bd69-696581c272f9 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:48.507152 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7d5c8-4be7-498a-ac08-40a9e541e707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:48.507778 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7d5c8-4be7-498a-ac08-40a9e541e707 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:48.508246 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7d5c8-4be7-498a-ac08-40a9e541e707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:48.508748 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7d5c8-4be7-498a-ac08-40a9e541e707 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:48.509324 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e7d5c8-4be7-498a-ac08-40a9e541e707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:48.511091 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e7d5c8-4be7-498a-ac08-40a9e541e707 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:48.522441 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 996/1979] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:48.524396 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7d5c8-4be7-498a-ac08-40a9e541e707 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:48.525082 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-70e7d5c8-4be7-498a-ac08-40a9e541e707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:48.540125 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7d5c8-4be7-498a-ac08-40a9e541e707 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:48.541371 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 984/1980] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:48 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:48.542271 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50009812-2a6a-4286-a613-bb4442e575e6 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:48.560479 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50009812-2a6a-4286-a613-bb4442e575e6 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:48.574320 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e77c831-a001-4e9c-90ab-adbc9caf694c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:48.575066 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77c831-a001-4e9c-90ab-adbc9caf694c admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:48.576878 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77c831-a001-4e9c-90ab-adbc9caf694c admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:48.577163 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77c831-a001-4e9c-90ab-adbc9caf694c admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:48.577804 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e77c831-a001-4e9c-90ab-adbc9caf694c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:48.580036 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e77c831-a001-4e9c-90ab-adbc9caf694c admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:48.583194 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8e81d-8315-4000-8a7e-153f4447d6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:48.588161 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8e81d-8315-4000-8a7e-153f4447d6a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:48.589706 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8e81d-8315-4000-8a7e-153f4447d6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:48.591209 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8e81d-8315-4000-8a7e-153f4447d6a2 admin admin] PATH_INFO: `/v3/projects/fefec2eba64548449e3905f379426651` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:48.598358 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf8e81d-8315-4000-8a7e-153f4447d6a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fefec2eba64548449e3905f379426651)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:48.604305 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf8e81d-8315-4000-8a7e-153f4447d6a2 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:48.741969 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 985/1981] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:52:48 2022] POST /identity/v3/users => generated 306 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:48.741969 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e77c831-a001-4e9c-90ab-adbc9caf694c admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:48.755877 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e77c831-a001-4e9c-90ab-adbc9caf694c admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:48.766054 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7fb1a-6697-4097-ba55-ca95113d5dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:48.766699 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7fb1a-6697-4097-ba55-ca95113d5dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:48.767004 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7fb1a-6697-4097-ba55-ca95113d5dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:48.767306 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7fb1a-6697-4097-ba55-ca95113d5dc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:48.767969 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd7fb1a-6697-4097-ba55-ca95113d5dc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:48.769635 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd7fb1a-6697-4097-ba55-ca95113d5dc4 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:48.783115 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 986/1982] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:48.784128 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7fb1a-6697-4097-ba55-ca95113d5dc4 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:48.786131 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-1bd7fb1a-6697-4097-ba55-ca95113d5dc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:48.839420 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-fdf8e81d-8315-4000-8a7e-153f4447d6a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fefec2eba64548449e3905f379426651', 'request_id': 'req-fdf8e81d-8315-4000-8a7e-153f4447d6a2'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:48.855843 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-fdf8e81d-8315-4000-8a7e-153f4447d6a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fefec2eba64548449e3905f379426651', 'request_id': 'req-fdf8e81d-8315-4000-8a7e-153f4447d6a2'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:48.860074 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7fb1a-6697-4097-ba55-ca95113d5dc4 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:48.875336 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-fdf8e81d-8315-4000-8a7e-153f4447d6a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fefec2eba64548449e3905f379426651', 'request_id': 'req-fdf8e81d-8315-4000-8a7e-153f4447d6a2'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:48.934063 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2cad4-b24b-48ed-ab0f-e811ae37be6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:48.935312 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2cad4-b24b-48ed-ab0f-e811ae37be6e service cinder] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:48.935653 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2cad4-b24b-48ed-ab0f-e811ae37be6e service cinder] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:48.935964 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2cad4-b24b-48ed-ab0f-e811ae37be6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:49.009292 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-fdf8e81d-8315-4000-8a7e-153f4447d6a2 admin admin] The token cache is being invalidate because project fefec2eba64548449e3905f379426651 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:52:49.011249 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-fdf8e81d-8315-4000-8a7e-153f4447d6a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:49.013644 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-fdf8e81d-8315-4000-8a7e-153f4447d6a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:49.020744 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 997/1983] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:52:48 2022] DELETE /identity/v3/projects/fefec2eba64548449e3905f379426651 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:49.022442 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8e81d-8315-4000-8a7e-153f4447d6a2 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:49.023891 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-fdf8e81d-8315-4000-8a7e-153f4447d6a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:49.050521 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e2cad4-b24b-48ed-ab0f-e811ae37be6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:49.052170 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e2cad4-b24b-48ed-ab0f-e811ae37be6e service cinder] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:49.075772 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 987/1984] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:48 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:52:49.077111 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2cad4-b24b-48ed-ab0f-e811ae37be6e service cinder] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:49.150668 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8e81d-8315-4000-8a7e-153f4447d6a2 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:49.156348 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53272579-f65e-4850-96bb-f1c269d6ae55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:49.156977 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53272579-f65e-4850-96bb-f1c269d6ae55 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:49.157252 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53272579-f65e-4850-96bb-f1c269d6ae55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:49.157525 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53272579-f65e-4850-96bb-f1c269d6ae55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:49.158232 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53272579-f65e-4850-96bb-f1c269d6ae55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:49.159810 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53272579-f65e-4850-96bb-f1c269d6ae55 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:49.164701 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:52:49.173834 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 998/1985] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:49.175243 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46c230-79e6-42fa-b78c-d96e3291df2f None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:49.175530 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46c230-79e6-42fa-b78c-d96e3291df2f None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:49.175801 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46c230-79e6-42fa-b78c-d96e3291df2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:49.191797 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2cad4-b24b-48ed-ab0f-e811ae37be6e service cinder] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:49.197681 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-5b46c230-79e6-42fa-b78c-d96e3291df2f None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:49.198899 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-5b46c230-79e6-42fa-b78c-d96e3291df2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:49.204563 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09981f7-372e-4201-968b-6b4e844c4180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:49.204563 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09981f7-372e-4201-968b-6b4e844c4180 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:49.204563 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09981f7-372e-4201-968b-6b4e844c4180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:49.204563 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09981f7-372e-4201-968b-6b4e844c4180 admin admin] PATH_INFO: `/v3/projects/8c310027952545f390fa7bbc4fdaa09c/users/6cd8ee4acee54342af52a953ddbbd5aa/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:49.211403 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 999/1986] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:49.212406 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46c230-79e6-42fa-b78c-d96e3291df2f None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:49.226658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46c230-79e6-42fa-b78c-d96e3291df2f None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:49.229532 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09981f7-372e-4201-968b-6b4e844c4180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c310027952545f390fa7bbc4fdaa09c, user_id=6cd8ee4acee54342af52a953ddbbd5aa, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:49.233441 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda15ee-4d52-49df-af4f-22bc4047f236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:49.234092 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09981f7-372e-4201-968b-6b4e844c4180 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:49.234482 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda15ee-4d52-49df-af4f-22bc4047f236 admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:49.234911 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda15ee-4d52-49df-af4f-22bc4047f236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:49.239261 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda15ee-4d52-49df-af4f-22bc4047f236 admin admin] PATH_INFO: `/v3/projects/8085d3294b3e4f1fb093d61e60a0f2f6/users/0326e3b1341649bea03b0f5c654b34e6/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:49.257140 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda15ee-4d52-49df-af4f-22bc4047f236 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8085d3294b3e4f1fb093d61e60a0f2f6, user_id=0326e3b1341649bea03b0f5c654b34e6, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:49.260494 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda15ee-4d52-49df-af4f-22bc4047f236 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:49.342923 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 988/1987] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:52:49 2022] PUT /identity/v3/projects/8c310027952545f390fa7bbc4fdaa09c/users/6cd8ee4acee54342af52a953ddbbd5aa/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:49.344779 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b39ffe-1f9e-4572-8b87-a92071048634 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:49.345127 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b39ffe-1f9e-4572-8b87-a92071048634 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:49.345468 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b39ffe-1f9e-4572-8b87-a92071048634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:49.367605 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-31b39ffe-1f9e-4572-8b87-a92071048634 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:49.369062 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-31b39ffe-1f9e-4572-8b87-a92071048634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:49.378748 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1000/1988] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:52:49 2022] PUT /identity/v3/projects/8085d3294b3e4f1fb093d61e60a0f2f6/users/0326e3b1341649bea03b0f5c654b34e6/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:49.379964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb51c7-db2f-4bdb-b1dc-7afce37cec16 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:49.382530 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb51c7-db2f-4bdb-b1dc-7afce37cec16 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:49.382530 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb51c7-db2f-4bdb-b1dc-7afce37cec16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:49.414602 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-fdbb51c7-db2f-4bdb-b1dc-7afce37cec16 None None] MFA Rules not processed for user `6cd8ee4acee54342af52a953ddbbd5aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:49.416089 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-fdbb51c7-db2f-4bdb-b1dc-7afce37cec16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:49.442644 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 989/1989] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:49.442644 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b39ffe-1f9e-4572-8b87-a92071048634 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:49.450749 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b39ffe-1f9e-4572-8b87-a92071048634 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:49.493311 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1001/1990] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:49.494247 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb51c7-db2f-4bdb-b1dc-7afce37cec16 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:49.515999 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a84b5-0086-40fc-9086-ba1310e6d092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:49.516548 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a84b5-0086-40fc-9086-ba1310e6d092 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:49.516818 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a84b5-0086-40fc-9086-ba1310e6d092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:49.517234 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a84b5-0086-40fc-9086-ba1310e6d092 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:49.517959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a84b5-0086-40fc-9086-ba1310e6d092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:49.519848 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a84b5-0086-40fc-9086-ba1310e6d092 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:49.533753 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 990/1991] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:49.533753 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a84b5-0086-40fc-9086-ba1310e6d092 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:49.533753 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-878a84b5-0086-40fc-9086-ba1310e6d092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:49.549345 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a84b5-0086-40fc-9086-ba1310e6d092 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:49.554602 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc563c-b3af-4015-aeb9-ad663008c2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:49.555428 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc563c-b3af-4015-aeb9-ad663008c2ef admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:49.555542 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc563c-b3af-4015-aeb9-ad663008c2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:49.555785 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc563c-b3af-4015-aeb9-ad663008c2ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:49.556410 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc563c-b3af-4015-aeb9-ad663008c2ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:49.565964 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc563c-b3af-4015-aeb9-ad663008c2ef admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:49.571901 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb51c7-db2f-4bdb-b1dc-7afce37cec16 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:49.577772 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810ef9c-49ad-40f2-99c4-d31cd9d95f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:49.578885 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810ef9c-49ad-40f2-99c4-d31cd9d95f38 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:49.578885 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810ef9c-49ad-40f2-99c4-d31cd9d95f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:49.579124 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810ef9c-49ad-40f2-99c4-d31cd9d95f38 admin admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:49.580336 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8810ef9c-49ad-40f2-99c4-d31cd9d95f38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:52:49.580336 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8810ef9c-49ad-40f2-99c4-d31cd9d95f38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:49.582337 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8810ef9c-49ad-40f2-99c4-d31cd9d95f38 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:49.598300 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1002/1992] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:52:49.598300 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810ef9c-49ad-40f2-99c4-d31cd9d95f38 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:49.609027 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810ef9c-49ad-40f2-99c4-d31cd9d95f38 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:49.613653 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c4801-9ad2-43b9-a44d-3f94dc935dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:49.614305 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c4801-9ad2-43b9-a44d-3f94dc935dcf admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:49.614582 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c4801-9ad2-43b9-a44d-3f94dc935dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:49.614858 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c4801-9ad2-43b9-a44d-3f94dc935dcf admin admin] PATH_INFO: `/v3/projects/8085d3294b3e4f1fb093d61e60a0f2f6/users/0326e3b1341649bea03b0f5c654b34e6/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:49.616782 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c4801-9ad2-43b9-a44d-3f94dc935dcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8085d3294b3e4f1fb093d61e60a0f2f6, user_id=0326e3b1341649bea03b0f5c654b34e6, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:49.619442 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c4801-9ad2-43b9-a44d-3f94dc935dcf admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:49.631076 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1003/1993] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:52:49 2022] PUT /identity/v3/projects/8085d3294b3e4f1fb093d61e60a0f2f6/users/0326e3b1341649bea03b0f5c654b34e6/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:49.631944 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c4801-9ad2-43b9-a44d-3f94dc935dcf admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:49.685767 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 991/1994] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:52:49 2022] POST /identity/v3/projects => generated 365 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:49.687811 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cfff7-25e0-4832-b0d9-928f7e16d118 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:49.688704 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cfff7-25e0-4832-b0d9-928f7e16d118 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:49.688894 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cfff7-25e0-4832-b0d9-928f7e16d118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:49.709566 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c4801-9ad2-43b9-a44d-3f94dc935dcf admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:49.728458 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-673cfff7-25e0-4832-b0d9-928f7e16d118 None None] MFA Rules not processed for user `0326e3b1341649bea03b0f5c654b34e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:49.730232 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-673cfff7-25e0-4832-b0d9-928f7e16d118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:49.799689 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803a28c-443a-4c00-ab62-af285fa0286f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:49.800301 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803a28c-443a-4c00-ab62-af285fa0286f admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:49.800581 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803a28c-443a-4c00-ab62-af285fa0286f admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:49.800854 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803a28c-443a-4c00-ab62-af285fa0286f admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:49.801485 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6803a28c-443a-4c00-ab62-af285fa0286f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:49.803509 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6803a28c-443a-4c00-ab62-af285fa0286f admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:49.821296 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 992/1995] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:49 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:49.822132 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673cfff7-25e0-4832-b0d9-928f7e16d118 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:49.833505 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673cfff7-25e0-4832-b0d9-928f7e16d118 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:49.838238 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c3c59-318b-4e5b-b101-2931f6a08486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:49.838853 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c3c59-318b-4e5b-b101-2931f6a08486 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:49.839170 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c3c59-318b-4e5b-b101-2931f6a08486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:49.839478 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c3c59-318b-4e5b-b101-2931f6a08486 admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:49.840107 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c3c59-318b-4e5b-b101-2931f6a08486 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:49.842791 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c3c59-318b-4e5b-b101-2931f6a08486 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:49.928565 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1004/1996] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:52:49 2022] POST /identity/v3/projects => generated 387 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:49.928565 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803a28c-443a-4c00-ab62-af285fa0286f admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:49.931791 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-6803a28c-443a-4c00-ab62-af285fa0286f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:49.978293 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 993/1997] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:52:49 2022] POST /identity/v3/users => generated 289 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:49.979808 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c3c59-318b-4e5b-b101-2931f6a08486 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:50.004681 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c3c59-318b-4e5b-b101-2931f6a08486 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:50.007562 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803a28c-443a-4c00-ab62-af285fa0286f admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:50.014052 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f58892-cfde-4884-a2e9-74c84be40e09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:50.014728 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f58892-cfde-4884-a2e9-74c84be40e09 service cinder] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:50.015038 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f58892-cfde-4884-a2e9-74c84be40e09 service cinder] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:50.015328 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f58892-cfde-4884-a2e9-74c84be40e09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:50.018144 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-96f58892-cfde-4884-a2e9-74c84be40e09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:50.081037 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173db08-7999-4588-91e9-3ef184f8e2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:50.086564 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173db08-7999-4588-91e9-3ef184f8e2c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:50.086564 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173db08-7999-4588-91e9-3ef184f8e2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:50.086564 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173db08-7999-4588-91e9-3ef184f8e2c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:50.086564 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7173db08-7999-4588-91e9-3ef184f8e2c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:50.086564 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7173db08-7999-4588-91e9-3ef184f8e2c0 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:50.092224 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f58892-cfde-4884-a2e9-74c84be40e09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:50.093730 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f58892-cfde-4884-a2e9-74c84be40e09 service cinder] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:50.109478 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1005/1998] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:49 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:52:50.110287 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f58892-cfde-4884-a2e9-74c84be40e09 service cinder] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:50.132513 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f58892-cfde-4884-a2e9-74c84be40e09 service cinder] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:50.133875 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f49c50-4d93-456f-a688-555a32655f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:50.134623 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f49c50-4d93-456f-a688-555a32655f0f admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:50.134893 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f49c50-4d93-456f-a688-555a32655f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:50.135216 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f49c50-4d93-456f-a688-555a32655f0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:50.135861 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f49c50-4d93-456f-a688-555a32655f0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:50.137607 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f49c50-4d93-456f-a688-555a32655f0f admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:50.149353 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1006/1999] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:50.153455 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f49c50-4d93-456f-a688-555a32655f0f admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:50.163781 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:52:50.178334 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f49c50-4d93-456f-a688-555a32655f0f admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:50.178334 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cae099-f030-430a-bee8-bc19c972a0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:50.178334 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cae099-f030-430a-bee8-bc19c972a0bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:50.178334 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cae099-f030-430a-bee8-bc19c972a0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:50.179252 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cae099-f030-430a-bee8-bc19c972a0bc admin admin] PATH_INFO: `/v3/projects/bbdeec4b9603489a9f75b0a55cfd2e1d/users/106ae90479674d9eb519d7d6736263ad/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:50.190649 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cae099-f030-430a-bee8-bc19c972a0bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbdeec4b9603489a9f75b0a55cfd2e1d, user_id=106ae90479674d9eb519d7d6736263ad, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:50.193488 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cae099-f030-430a-bee8-bc19c972a0bc admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:50.256779 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 994/2000] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:52:49 2022] POST /identity/v3/users => generated 294 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:50.261590 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173db08-7999-4588-91e9-3ef184f8e2c0 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:50.272014 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173db08-7999-4588-91e9-3ef184f8e2c0 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:50.276883 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e7179-5786-43f2-8b4f-f3462c9aec19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:50.277495 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e7179-5786-43f2-8b4f-f3462c9aec19 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:50.277777 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e7179-5786-43f2-8b4f-f3462c9aec19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:50.278053 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e7179-5786-43f2-8b4f-f3462c9aec19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:50.279035 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66e7179-5786-43f2-8b4f-f3462c9aec19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:50.280879 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66e7179-5786-43f2-8b4f-f3462c9aec19 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:50.291693 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 995/2001] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 07:52:50.296565 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e7179-5786-43f2-8b4f-f3462c9aec19 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:50.303704 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1007/2002] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:52:50 2022] PUT /identity/v3/projects/bbdeec4b9603489a9f75b0a55cfd2e1d/users/106ae90479674d9eb519d7d6736263ad/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:52:50.310802 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e7179-5786-43f2-8b4f-f3462c9aec19 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:50.313195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cae099-f030-430a-bee8-bc19c972a0bc admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:50.373299 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5c968-69bd-4175-85e2-682813046cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:50.374092 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5c968-69bd-4175-85e2-682813046cdc admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:50.374630 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5c968-69bd-4175-85e2-682813046cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:50.375155 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5c968-69bd-4175-85e2-682813046cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:50.376261 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5c968-69bd-4175-85e2-682813046cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:50.378200 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5c968-69bd-4175-85e2-682813046cdc admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:50.389168 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cae099-f030-430a-bee8-bc19c972a0bc admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:50.390191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 996/2003] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:50.393944 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5c968-69bd-4175-85e2-682813046cdc admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:50.395140 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de5519-b1cd-4e07-8d8e-33bcd898a016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:50.395895 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de5519-b1cd-4e07-8d8e-33bcd898a016 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:50.396184 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de5519-b1cd-4e07-8d8e-33bcd898a016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:50.396458 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de5519-b1cd-4e07-8d8e-33bcd898a016 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:50.397107 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de5519-b1cd-4e07-8d8e-33bcd898a016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:50.398865 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de5519-b1cd-4e07-8d8e-33bcd898a016 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:50.404696 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5c968-69bd-4175-85e2-682813046cdc admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:50.409966 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d80ed-e753-4f42-adb2-11d587a70fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:50.410703 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d80ed-e753-4f42-adb2-11d587a70fb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:50.411006 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d80ed-e753-4f42-adb2-11d587a70fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:50.411294 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d80ed-e753-4f42-adb2-11d587a70fb8 admin admin] PATH_INFO: `/v3/projects/284defaa239544ff9ec12694c414c38f/users/38930d36447a48f39dac64c40c1d9aab/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:50.415354 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1008/2004] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 07:52:50.420387 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de5519-b1cd-4e07-8d8e-33bcd898a016 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:50.432977 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6d80ed-e753-4f42-adb2-11d587a70fb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=284defaa239544ff9ec12694c414c38f, user_id=38930d36447a48f39dac64c40c1d9aab, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:50.436827 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6d80ed-e753-4f42-adb2-11d587a70fb8 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:50.439616 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de5519-b1cd-4e07-8d8e-33bcd898a016 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:50.448204 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8703d7-4251-477e-b0fb-def91c10983a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:50.449065 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8703d7-4251-477e-b0fb-def91c10983a admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:50.449355 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8703d7-4251-477e-b0fb-def91c10983a admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:50.449632 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8703d7-4251-477e-b0fb-def91c10983a admin admin] PATH_INFO: `/v3/projects/bbdeec4b9603489a9f75b0a55cfd2e1d/users/106ae90479674d9eb519d7d6736263ad/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:50.451875 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8703d7-4251-477e-b0fb-def91c10983a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbdeec4b9603489a9f75b0a55cfd2e1d, user_id=106ae90479674d9eb519d7d6736263ad, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:50.454679 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8703d7-4251-477e-b0fb-def91c10983a admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:50.469037 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1009/2005] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:52:50 2022] PUT /identity/v3/projects/bbdeec4b9603489a9f75b0a55cfd2e1d/users/106ae90479674d9eb519d7d6736263ad/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:52:50.480249 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3956bab-87e4-4a2a-90fd-d0eda042b0ec None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:50.480547 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3956bab-87e4-4a2a-90fd-d0eda042b0ec None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:50.480821 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3956bab-87e4-4a2a-90fd-d0eda042b0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:50.521203 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-d3956bab-87e4-4a2a-90fd-d0eda042b0ec None None] MFA Rules not processed for user `106ae90479674d9eb519d7d6736263ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:50.522317 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-d3956bab-87e4-4a2a-90fd-d0eda042b0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:50.596768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 997/2006] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:52:50 2022] PUT /identity/v3/projects/284defaa239544ff9ec12694c414c38f/users/38930d36447a48f39dac64c40c1d9aab/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:50.597960 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d80ed-e753-4f42-adb2-11d587a70fb8 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:50.607774 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-fe6d80ed-e753-4f42-adb2-11d587a70fb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:50.610049 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1010/2007] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:50 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:50.611342 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa25c9-5907-4a75-b7db-969b36984a1a None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:50.611691 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa25c9-5907-4a75-b7db-969b36984a1a None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:50.612543 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa25c9-5907-4a75-b7db-969b36984a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:50.653251 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-4cfa25c9-5907-4a75-b7db-969b36984a1a None None] MFA Rules not processed for user `38930d36447a48f39dac64c40c1d9aab`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:50.656718 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-4cfa25c9-5907-4a75-b7db-969b36984a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:50.697097 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d80ed-e753-4f42-adb2-11d587a70fb8 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:50.703370 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9f6d4-6c82-41f2-b926-297764b9d5a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:50.704205 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9f6d4-6c82-41f2-b926-297764b9d5a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:50.704492 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9f6d4-6c82-41f2-b926-297764b9d5a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:50.704766 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9f6d4-6c82-41f2-b926-297764b9d5a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:50.791141 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1011/2008] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:50.796696 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa25c9-5907-4a75-b7db-969b36984a1a None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:50.812969 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c9f6d4-6c82-41f2-b926-297764b9d5a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:50.814414 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c9f6d4-6c82-41f2-b926-297764b9d5a8 service cinder] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:50.829686 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 998/2009] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:50 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:52:50.891856 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa25c9-5907-4a75-b7db-969b36984a1a None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:50.897445 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300b3ac-4a51-4dc2-8e14-20cc08bdda4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:50.897555 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300b3ac-4a51-4dc2-8e14-20cc08bdda4f admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:50.897831 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300b3ac-4a51-4dc2-8e14-20cc08bdda4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:50.898105 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300b3ac-4a51-4dc2-8e14-20cc08bdda4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:50.898810 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7300b3ac-4a51-4dc2-8e14-20cc08bdda4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:50.900723 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7300b3ac-4a51-4dc2-8e14-20cc08bdda4f admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:51.012285 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1012/2010] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:52:50 2022] POST /identity/v3/projects => generated 389 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:51.020496 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9f6d4-6c82-41f2-b926-297764b9d5a8 service cinder] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:51.035406 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9f6d4-6c82-41f2-b926-297764b9d5a8 service cinder] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:51.057623 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300b3ac-4a51-4dc2-8e14-20cc08bdda4f admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:51.106449 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:52:51.157544 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f641229-fc4e-4a12-aad0-160bd525a48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:51.158884 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f641229-fc4e-4a12-aad0-160bd525a48d admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:51.159548 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f641229-fc4e-4a12-aad0-160bd525a48d admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:51.160051 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f641229-fc4e-4a12-aad0-160bd525a48d admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:51.161427 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f641229-fc4e-4a12-aad0-160bd525a48d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:51.166269 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f641229-fc4e-4a12-aad0-160bd525a48d admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:51.190538 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300b3ac-4a51-4dc2-8e14-20cc08bdda4f admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:51.194744 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec164bc-fff6-45f6-81d3-7b303af193ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:51.195891 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec164bc-fff6-45f6-81d3-7b303af193ea service cinder] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:51.195891 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec164bc-fff6-45f6-81d3-7b303af193ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:51.196088 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec164bc-fff6-45f6-81d3-7b303af193ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:51.304233 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec164bc-fff6-45f6-81d3-7b303af193ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:51.306458 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec164bc-fff6-45f6-81d3-7b303af193ea service cinder] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:51.319582 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1013/2011] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:51 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:52:51.339824 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 999/2012] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:52:51 2022] POST /identity/v3/users => generated 301 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:51.344481 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec164bc-fff6-45f6-81d3-7b303af193ea service cinder] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:51.357538 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec164bc-fff6-45f6-81d3-7b303af193ea service cinder] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:51.370294 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe904e1-250a-45ba-b258-6571a5ad9eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:51.371131 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe904e1-250a-45ba-b258-6571a5ad9eea admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:51.371480 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe904e1-250a-45ba-b258-6571a5ad9eea admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:51.371805 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe904e1-250a-45ba-b258-6571a5ad9eea admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:51.374232 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe904e1-250a-45ba-b258-6571a5ad9eea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:51.380884 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe904e1-250a-45ba-b258-6571a5ad9eea admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:51.392623 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1014/2013] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 07:52:51.397148 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f641229-fc4e-4a12-aad0-160bd525a48d admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:51.407669 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f641229-fc4e-4a12-aad0-160bd525a48d admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:51.413019 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd328e-57a0-4c7e-abba-f79bd5da31da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:51.413694 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd328e-57a0-4c7e-abba-f79bd5da31da admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:51.413973 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd328e-57a0-4c7e-abba-f79bd5da31da admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:51.414257 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd328e-57a0-4c7e-abba-f79bd5da31da admin admin] PATH_INFO: `/v3/projects/7108320c413a475e91f4740a7b9425fc/users/36ea23c6333a41b0be02e4bfb87b4bb9/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:51.431358 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cd328e-57a0-4c7e-abba-f79bd5da31da admin admin] RBAC: Authorizing `identity:create_grant(project_id=7108320c413a475e91f4740a7b9425fc, user_id=36ea23c6333a41b0be02e4bfb87b4bb9, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:51.434065 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cd328e-57a0-4c7e-abba-f79bd5da31da admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:51.516224 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe904e1-250a-45ba-b258-6571a5ad9eea admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:51.533490 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe904e1-250a-45ba-b258-6571a5ad9eea admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:51.538350 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21510c-58d2-4fac-a03d-3ee14c691975 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:51.539059 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21510c-58d2-4fac-a03d-3ee14c691975 service cinder] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:51.539342 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21510c-58d2-4fac-a03d-3ee14c691975 service cinder] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:51.539636 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21510c-58d2-4fac-a03d-3ee14c691975 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:51.541405 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-7f21510c-58d2-4fac-a03d-3ee14c691975 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:51.563549 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1000/2014] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:52:51 2022] PUT /identity/v3/projects/7108320c413a475e91f4740a7b9425fc/users/36ea23c6333a41b0be02e4bfb87b4bb9/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:52:51.567260 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd328e-57a0-4c7e-abba-f79bd5da31da admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:51.605151 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f21510c-58d2-4fac-a03d-3ee14c691975 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:51.608320 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f21510c-58d2-4fac-a03d-3ee14c691975 service cinder] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:51.623125 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1015/2015] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:51 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 07:52:51.633214 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21510c-58d2-4fac-a03d-3ee14c691975 service cinder] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:51.643340 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21510c-58d2-4fac-a03d-3ee14c691975 service cinder] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:51.658352 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd328e-57a0-4c7e-abba-f79bd5da31da admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:51.663351 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf9ac31-ec12-480c-ad46-ce230a50fbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:51.664003 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9ac31-ec12-480c-ad46-ce230a50fbb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:51.664424 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9ac31-ec12-480c-ad46-ce230a50fbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:51.664904 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9ac31-ec12-480c-ad46-ce230a50fbb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:51.665558 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf9ac31-ec12-480c-ad46-ce230a50fbb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:51.667398 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf9ac31-ec12-480c-ad46-ce230a50fbb9 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:51.683778 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1001/2016] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 07:52:51.689003 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf9ac31-ec12-480c-ad46-ce230a50fbb9 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:51.703189 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf9ac31-ec12-480c-ad46-ce230a50fbb9 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:51.708540 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d49df-3021-437a-9d46-e1e5551168f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:51.710176 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d49df-3021-437a-9d46-e1e5551168f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:51.710176 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d49df-3021-437a-9d46-e1e5551168f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:51.710176 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d49df-3021-437a-9d46-e1e5551168f3 admin admin] PATH_INFO: `/v3/projects/7108320c413a475e91f4740a7b9425fc/users/36ea23c6333a41b0be02e4bfb87b4bb9/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:51.711864 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3d49df-3021-437a-9d46-e1e5551168f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7108320c413a475e91f4740a7b9425fc, user_id=36ea23c6333a41b0be02e4bfb87b4bb9, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:51.713784 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4cda8-4268-48f1-9eb8-6a5db6712db5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:51.714522 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3d49df-3021-437a-9d46-e1e5551168f3 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:51.714651 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4cda8-4268-48f1-9eb8-6a5db6712db5 service cinder] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:51.715092 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4cda8-4268-48f1-9eb8-6a5db6712db5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:51.715394 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4cda8-4268-48f1-9eb8-6a5db6712db5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:51.738804 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1002/2017] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:52:51 2022] PUT /identity/v3/projects/7108320c413a475e91f4740a7b9425fc/users/36ea23c6333a41b0be02e4bfb87b4bb9/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:51.750733 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018d58d-69c3-480d-9df8-ce6da8252d89 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:51.751665 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018d58d-69c3-480d-9df8-ce6da8252d89 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:51.751665 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018d58d-69c3-480d-9df8-ce6da8252d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:51.788454 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-9018d58d-69c3-480d-9df8-ce6da8252d89 None None] MFA Rules not processed for user `36ea23c6333a41b0be02e4bfb87b4bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:51.790257 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-9018d58d-69c3-480d-9df8-ce6da8252d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:51.811929 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4cda8-4268-48f1-9eb8-6a5db6712db5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:51.813515 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4cda8-4268-48f1-9eb8-6a5db6712db5 service cinder] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:51.823451 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1016/2018] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 07:52:51.868526 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1003/2019] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:51 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:51.975964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:52:52.516701 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4cda8-4268-48f1-9eb8-6a5db6712db5 service cinder] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:52.526815 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4cda8-4268-48f1-9eb8-6a5db6712db5 service cinder] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:52.577857 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463370e1-e20b-4af5-a419-94cbb0e055a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:52.578501 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463370e1-e20b-4af5-a419-94cbb0e055a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:52.578780 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463370e1-e20b-4af5-a419-94cbb0e055a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:52.579089 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463370e1-e20b-4af5-a419-94cbb0e055a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:52.589063 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463370e1-e20b-4af5-a419-94cbb0e055a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:52.590513 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463370e1-e20b-4af5-a419-94cbb0e055a5 service cinder] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:52.601648 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1017/2020] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:52 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:52:53.034408 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018d58d-69c3-480d-9df8-ce6da8252d89 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:53.101841 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018d58d-69c3-480d-9df8-ce6da8252d89 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:53.107449 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e705f99e-b090-4924-96ca-878bd2a0e19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:53.108095 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705f99e-b090-4924-96ca-878bd2a0e19a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:53.108371 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705f99e-b090-4924-96ca-878bd2a0e19a admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:53.108647 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705f99e-b090-4924-96ca-878bd2a0e19a admin admin] PATH_INFO: `/v3/users/38930d36447a48f39dac64c40c1d9aab` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:53.110079 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e705f99e-b090-4924-96ca-878bd2a0e19a admin admin] RBAC: Authorizing `identity:delete_user(user_id=38930d36447a48f39dac64c40c1d9aab)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:53.112047 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e705f99e-b090-4924-96ca-878bd2a0e19a admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:53.415713 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-e705f99e-b090-4924-96ca-878bd2a0e19a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38930d36447a48f39dac64c40c1d9aab'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:53.416428 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-e705f99e-b090-4924-96ca-878bd2a0e19a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38930d36447a48f39dac64c40c1d9aab'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:53.570611 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-e705f99e-b090-4924-96ca-878bd2a0e19a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38930d36447a48f39dac64c40c1d9aab'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:53.571363 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-e705f99e-b090-4924-96ca-878bd2a0e19a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38930d36447a48f39dac64c40c1d9aab'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:53.579347 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-e705f99e-b090-4924-96ca-878bd2a0e19a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38930d36447a48f39dac64c40c1d9aab'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:53.597148 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1004/2021] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:52:53 2022] DELETE /identity/v3/users/38930d36447a48f39dac64c40c1d9aab => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:53.601855 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dda7d7-4ede-4239-a046-451233c05a73 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:53.602321 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dda7d7-4ede-4239-a046-451233c05a73 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:53.602424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dda7d7-4ede-4239-a046-451233c05a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:53.622773 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-b3dda7d7-4ede-4239-a046-451233c05a73 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:53.624084 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-b3dda7d7-4ede-4239-a046-451233c05a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:53.686718 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1018/2022] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:53.694005 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:52:53.697860 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e705f99e-b090-4924-96ca-878bd2a0e19a admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:53.699998 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-e705f99e-b090-4924-96ca-878bd2a0e19a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:53.799514 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e705f99e-b090-4924-96ca-878bd2a0e19a admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:53.820027 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff64d91-9c0a-496d-ad79-ec1e24f81f61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:53.821152 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff64d91-9c0a-496d-ad79-ec1e24f81f61 service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:53.821615 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff64d91-9c0a-496d-ad79-ec1e24f81f61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:53.822708 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff64d91-9c0a-496d-ad79-ec1e24f81f61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:53.843681 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff64d91-9c0a-496d-ad79-ec1e24f81f61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:53.845956 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff64d91-9c0a-496d-ad79-ec1e24f81f61 service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:53.866796 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1005/2023] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:52:54.550176 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dda7d7-4ede-4239-a046-451233c05a73 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:54.551242 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-b3dda7d7-4ede-4239-a046-451233c05a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:54.563905 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dda7d7-4ede-4239-a046-451233c05a73 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:54.569645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa9845-0572-4fdb-9d7b-7176112d67d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:54.569645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa9845-0572-4fdb-9d7b-7176112d67d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:54.570159 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa9845-0572-4fdb-9d7b-7176112d67d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:54.570159 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa9845-0572-4fdb-9d7b-7176112d67d1 admin admin] PATH_INFO: `/v3/projects/284defaa239544ff9ec12694c414c38f` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:54.571392 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa9845-0572-4fdb-9d7b-7176112d67d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=284defaa239544ff9ec12694c414c38f)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:54.573678 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa9845-0572-4fdb-9d7b-7176112d67d1 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:54.671867 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:52:54.765379 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-36fa9845-0572-4fdb-9d7b-7176112d67d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '284defaa239544ff9ec12694c414c38f', 'request_id': 'req-36fa9845-0572-4fdb-9d7b-7176112d67d1'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:54.773568 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-36fa9845-0572-4fdb-9d7b-7176112d67d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '284defaa239544ff9ec12694c414c38f', 'request_id': 'req-36fa9845-0572-4fdb-9d7b-7176112d67d1'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:54.780990 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-36fa9845-0572-4fdb-9d7b-7176112d67d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '284defaa239544ff9ec12694c414c38f', 'request_id': 'req-36fa9845-0572-4fdb-9d7b-7176112d67d1'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:54.992391 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-36fa9845-0572-4fdb-9d7b-7176112d67d1 admin admin] The token cache is being invalidate because project 284defaa239544ff9ec12694c414c38f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:52:54.992687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-36fa9845-0572-4fdb-9d7b-7176112d67d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:54.993318 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-36fa9845-0572-4fdb-9d7b-7176112d67d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:54.994845 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1019/2024] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:52:54 2022] DELETE /identity/v3/projects/284defaa239544ff9ec12694c414c38f => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:54.999814 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff64d91-9c0a-496d-ad79-ec1e24f81f61 service neutron] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:55.009836 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff64d91-9c0a-496d-ad79-ec1e24f81f61 service neutron] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:55.070612 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641be6b-66f9-4eff-81e2-9a7c9dc887a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:55.071290 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641be6b-66f9-4eff-81e2-9a7c9dc887a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:55.071576 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641be6b-66f9-4eff-81e2-9a7c9dc887a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:55.071873 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641be6b-66f9-4eff-81e2-9a7c9dc887a6 admin admin] PATH_INFO: `/v3/users/36ea23c6333a41b0be02e4bfb87b4bb9` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:55.073022 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641be6b-66f9-4eff-81e2-9a7c9dc887a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36ea23c6333a41b0be02e4bfb87b4bb9)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:55.075015 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641be6b-66f9-4eff-81e2-9a7c9dc887a6 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:55.551274 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-f641be6b-66f9-4eff-81e2-9a7c9dc887a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36ea23c6333a41b0be02e4bfb87b4bb9'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:55.551940 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-f641be6b-66f9-4eff-81e2-9a7c9dc887a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36ea23c6333a41b0be02e4bfb87b4bb9'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:55.945901 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-f641be6b-66f9-4eff-81e2-9a7c9dc887a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36ea23c6333a41b0be02e4bfb87b4bb9'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:55.947601 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-f641be6b-66f9-4eff-81e2-9a7c9dc887a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36ea23c6333a41b0be02e4bfb87b4bb9'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:55.957075 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-f641be6b-66f9-4eff-81e2-9a7c9dc887a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36ea23c6333a41b0be02e4bfb87b4bb9'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:55.974471 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1006/2025] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:52:54 2022] DELETE /identity/v3/users/36ea23c6333a41b0be02e4bfb87b4bb9 => generated 0 bytes in 975 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:52:56.608011 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa9845-0572-4fdb-9d7b-7176112d67d1 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:56.610972 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-36fa9845-0572-4fdb-9d7b-7176112d67d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:56.635548 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa9845-0572-4fdb-9d7b-7176112d67d1 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:56.698034 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc555ae1-e119-4dd2-8ece-fe721721719f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:56.698674 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc555ae1-e119-4dd2-8ece-fe721721719f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:56.698949 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc555ae1-e119-4dd2-8ece-fe721721719f admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:56.699258 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc555ae1-e119-4dd2-8ece-fe721721719f admin admin] PATH_INFO: `/v3/projects/7108320c413a475e91f4740a7b9425fc` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:56.700397 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc555ae1-e119-4dd2-8ece-fe721721719f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7108320c413a475e91f4740a7b9425fc)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:56.702383 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc555ae1-e119-4dd2-8ece-fe721721719f admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:56.833628 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-dc555ae1-e119-4dd2-8ece-fe721721719f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7108320c413a475e91f4740a7b9425fc', 'request_id': 'req-dc555ae1-e119-4dd2-8ece-fe721721719f'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:56.839106 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-dc555ae1-e119-4dd2-8ece-fe721721719f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7108320c413a475e91f4740a7b9425fc', 'request_id': 'req-dc555ae1-e119-4dd2-8ece-fe721721719f'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:56.846186 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-dc555ae1-e119-4dd2-8ece-fe721721719f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7108320c413a475e91f4740a7b9425fc', 'request_id': 'req-dc555ae1-e119-4dd2-8ece-fe721721719f'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:56.987946 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:52:56.992724 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-dc555ae1-e119-4dd2-8ece-fe721721719f admin admin] The token cache is being invalidate because project 7108320c413a475e91f4740a7b9425fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:52:56.993023 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-dc555ae1-e119-4dd2-8ece-fe721721719f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:56.993664 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-dc555ae1-e119-4dd2-8ece-fe721721719f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:56.995290 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1020/2026] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:52:56 2022] DELETE /identity/v3/projects/7108320c413a475e91f4740a7b9425fc => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:57.000588 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fad7f9-2f49-46f9-8303-ae7528547324 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:57.000879 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fad7f9-2f49-46f9-8303-ae7528547324 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:57.001163 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fad7f9-2f49-46f9-8303-ae7528547324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:57.022023 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-42fad7f9-2f49-46f9-8303-ae7528547324 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:57.023299 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-42fad7f9-2f49-46f9-8303-ae7528547324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:57.092903 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1007/2027] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:57.102207 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c801f6-803c-4fff-8830-84f887c3c582 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:57.105907 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c801f6-803c-4fff-8830-84f887c3c582 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:57.105907 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c801f6-803c-4fff-8830-84f887c3c582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:57.123594 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-c3c801f6-803c-4fff-8830-84f887c3c582 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:57.124792 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-c3c801f6-803c-4fff-8830-84f887c3c582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:57.132730 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1021/2028] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:57.137652 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fad7f9-2f49-46f9-8303-ae7528547324 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:57.153381 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fad7f9-2f49-46f9-8303-ae7528547324 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:57.158437 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f646ce-6c36-450e-ab82-b72bdd3ed1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:57.159091 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f646ce-6c36-450e-ab82-b72bdd3ed1ca admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:57.159373 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f646ce-6c36-450e-ab82-b72bdd3ed1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:57.159651 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f646ce-6c36-450e-ab82-b72bdd3ed1ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:57.160317 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f646ce-6c36-450e-ab82-b72bdd3ed1ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:52:57.160621 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f646ce-6c36-450e-ab82-b72bdd3ed1ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:57.162227 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f646ce-6c36-450e-ab82-b72bdd3ed1ca admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:57.175902 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1008/2029] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:52:57.180842 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c801f6-803c-4fff-8830-84f887c3c582 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:57.190644 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c801f6-803c-4fff-8830-84f887c3c582 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:57.195866 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225c35f-abfa-4c17-bfa9-e58d034c073e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:57.203387 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225c35f-abfa-4c17-bfa9-e58d034c073e admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:57.203387 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225c35f-abfa-4c17-bfa9-e58d034c073e admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:57.203387 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225c35f-abfa-4c17-bfa9-e58d034c073e admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:57.203387 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a225c35f-abfa-4c17-bfa9-e58d034c073e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:57.203387 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a225c35f-abfa-4c17-bfa9-e58d034c073e admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:57.355455 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1022/2030] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:52:57 2022] POST /identity/v3/projects => generated 381 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:57.358193 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f646ce-6c36-450e-ab82-b72bdd3ed1ca admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:57.369901 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f646ce-6c36-450e-ab82-b72bdd3ed1ca admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:57.427144 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7841d0ff-a4a5-41a2-be4f-ebb35f96f6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:57.427764 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841d0ff-a4a5-41a2-be4f-ebb35f96f6fd admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:57.428044 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841d0ff-a4a5-41a2-be4f-ebb35f96f6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:57.428321 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841d0ff-a4a5-41a2-be4f-ebb35f96f6fd admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:57.428949 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7841d0ff-a4a5-41a2-be4f-ebb35f96f6fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:57.430871 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7841d0ff-a4a5-41a2-be4f-ebb35f96f6fd admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:57.537809 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1009/2031] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:52:57 2022] POST /identity/v3/users => generated 291 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:57.540750 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225c35f-abfa-4c17-bfa9-e58d034c073e admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:57.554074 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225c35f-abfa-4c17-bfa9-e58d034c073e admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:57.559833 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f75af4-5b12-4e57-9730-f05e6ffbe4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:57.560544 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f75af4-5b12-4e57-9730-f05e6ffbe4c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:57.560971 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f75af4-5b12-4e57-9730-f05e6ffbe4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:57.568153 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f75af4-5b12-4e57-9730-f05e6ffbe4c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:57.568153 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f75af4-5b12-4e57-9730-f05e6ffbe4c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:57.568153 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f75af4-5b12-4e57-9730-f05e6ffbe4c0 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:57.575244 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1023/2032] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:57.579354 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7841d0ff-a4a5-41a2-be4f-ebb35f96f6fd admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:57.589733 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7841d0ff-a4a5-41a2-be4f-ebb35f96f6fd admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:57.596822 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f83a2d4-4f16-4aa1-a7a0-c54bc628ebe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:57.597436 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83a2d4-4f16-4aa1-a7a0-c54bc628ebe3 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:57.597758 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83a2d4-4f16-4aa1-a7a0-c54bc628ebe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:57.597981 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83a2d4-4f16-4aa1-a7a0-c54bc628ebe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:57.598671 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f83a2d4-4f16-4aa1-a7a0-c54bc628ebe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:57.600370 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f83a2d4-4f16-4aa1-a7a0-c54bc628ebe3 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:57.611906 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1010/2033] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:57.616792 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f75af4-5b12-4e57-9730-f05e6ffbe4c0 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:57.627921 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f75af4-5b12-4e57-9730-f05e6ffbe4c0 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:57.633112 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964dc77f-f3ca-4f9b-a1ca-56e72e6f9887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:57.633804 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dc77f-f3ca-4f9b-a1ca-56e72e6f9887 admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:57.634085 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dc77f-f3ca-4f9b-a1ca-56e72e6f9887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:57.635151 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dc77f-f3ca-4f9b-a1ca-56e72e6f9887 admin admin] PATH_INFO: `/v3/projects/3d1e3b422fc645ccb3a38737b3cd0261/users/368ed86289ad4b5b86b2164e61b93190/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:57.662749 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964dc77f-f3ca-4f9b-a1ca-56e72e6f9887 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d1e3b422fc645ccb3a38737b3cd0261, user_id=368ed86289ad4b5b86b2164e61b93190, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:57.668156 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964dc77f-f3ca-4f9b-a1ca-56e72e6f9887 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:57.850381 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1024/2034] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:52:57 2022] PUT /identity/v3/projects/3d1e3b422fc645ccb3a38737b3cd0261/users/368ed86289ad4b5b86b2164e61b93190/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:52:57.860716 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5ea98-9c3e-46ed-bb32-6fcf942823d1 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:57.865677 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5ea98-9c3e-46ed-bb32-6fcf942823d1 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:57.865677 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5ea98-9c3e-46ed-bb32-6fcf942823d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:57.897114 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-d4f5ea98-9c3e-46ed-bb32-6fcf942823d1 None None] MFA Rules not processed for user `368ed86289ad4b5b86b2164e61b93190`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:57.898581 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-d4f5ea98-9c3e-46ed-bb32-6fcf942823d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:57.966847 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1011/2035] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:57.971539 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964dc77f-f3ca-4f9b-a1ca-56e72e6f9887 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:57.981886 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:52:58.041112 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964dc77f-f3ca-4f9b-a1ca-56e72e6f9887 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:58.046096 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab3ba6-95e0-4ab1-81c4-c6daba65adb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:58.046824 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab3ba6-95e0-4ab1-81c4-c6daba65adb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:58.047149 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab3ba6-95e0-4ab1-81c4-c6daba65adb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:58.047422 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab3ba6-95e0-4ab1-81c4-c6daba65adb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:58.048056 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab3ba6-95e0-4ab1-81c4-c6daba65adb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:58.049945 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab3ba6-95e0-4ab1-81c4-c6daba65adb1 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:58.167542 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5ea98-9c3e-46ed-bb32-6fcf942823d1 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:58.170318 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-d4f5ea98-9c3e-46ed-bb32-6fcf942823d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:58.179922 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1025/2036] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:52:57 2022] POST /identity/v3/projects => generated 383 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:58.183890 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab3ba6-95e0-4ab1-81c4-c6daba65adb1 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:58.185389 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5ea98-9c3e-46ed-bb32-6fcf942823d1 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:58.262639 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab3ba6-95e0-4ab1-81c4-c6daba65adb1 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:58.262843 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50fddd8-2cbd-4335-b819-2972f30eeac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:58.263402 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50fddd8-2cbd-4335-b819-2972f30eeac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:58.263857 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50fddd8-2cbd-4335-b819-2972f30eeac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:58.264289 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50fddd8-2cbd-4335-b819-2972f30eeac6 admin admin] PATH_INFO: `/v3/users/b14367ef1a4648188de7303c8bc4cd4a` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:58.265457 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50fddd8-2cbd-4335-b819-2972f30eeac6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b14367ef1a4648188de7303c8bc4cd4a)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:58.267459 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50fddd8-2cbd-4335-b819-2972f30eeac6 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:58.267590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0001bb4-0a88-4cb2-b834-b3ecd60cf532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:58.268119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0001bb4-0a88-4cb2-b834-b3ecd60cf532 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:58.268400 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0001bb4-0a88-4cb2-b834-b3ecd60cf532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:58.268673 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0001bb4-0a88-4cb2-b834-b3ecd60cf532 admin admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:58.269298 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0001bb4-0a88-4cb2-b834-b3ecd60cf532 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:58.271263 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0001bb4-0a88-4cb2-b834-b3ecd60cf532 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:58.500021 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1026/2037] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:52:58 2022] POST /identity/v3/users => generated 298 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:52:58.502079 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0001bb4-0a88-4cb2-b834-b3ecd60cf532 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:58.513113 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0001bb4-0a88-4cb2-b834-b3ecd60cf532 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:58.519193 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4cc667-1a42-405d-b198-78ce7f2bc102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:58.519913 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4cc667-1a42-405d-b198-78ce7f2bc102 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:58.520280 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4cc667-1a42-405d-b198-78ce7f2bc102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:58.520460 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4cc667-1a42-405d-b198-78ce7f2bc102 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:58.521110 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4cc667-1a42-405d-b198-78ce7f2bc102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:58.522755 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4cc667-1a42-405d-b198-78ce7f2bc102 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:58.534005 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1027/2038] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:58.538505 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4cc667-1a42-405d-b198-78ce7f2bc102 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:58.550763 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4cc667-1a42-405d-b198-78ce7f2bc102 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:58.555682 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444b308-8df2-4c91-8c24-aecc8a7e079d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:58.556321 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444b308-8df2-4c91-8c24-aecc8a7e079d admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:58.556599 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444b308-8df2-4c91-8c24-aecc8a7e079d admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:58.556916 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444b308-8df2-4c91-8c24-aecc8a7e079d admin admin] PATH_INFO: `/v3/projects/8f1db7ec6b1c456ea1c9f5b84f914a7a/users/17a2f75c487943f6a0cab45b4ecce11d/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:58.572297 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8444b308-8df2-4c91-8c24-aecc8a7e079d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f1db7ec6b1c456ea1c9f5b84f914a7a, user_id=17a2f75c487943f6a0cab45b4ecce11d, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:58.575074 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8444b308-8df2-4c91-8c24-aecc8a7e079d admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:58.651454 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-e50fddd8-2cbd-4335-b819-2972f30eeac6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b14367ef1a4648188de7303c8bc4cd4a'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:58.652706 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-e50fddd8-2cbd-4335-b819-2972f30eeac6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b14367ef1a4648188de7303c8bc4cd4a'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:58.670450 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1028/2039] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:52:58 2022] PUT /identity/v3/projects/8f1db7ec6b1c456ea1c9f5b84f914a7a/users/17a2f75c487943f6a0cab45b4ecce11d/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:52:58.674450 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444b308-8df2-4c91-8c24-aecc8a7e079d admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:58.730766 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:52:58.733146 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-e50fddd8-2cbd-4335-b819-2972f30eeac6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b14367ef1a4648188de7303c8bc4cd4a'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:58.734349 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-e50fddd8-2cbd-4335-b819-2972f30eeac6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b14367ef1a4648188de7303c8bc4cd4a'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:58.746259 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-e50fddd8-2cbd-4335-b819-2972f30eeac6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b14367ef1a4648188de7303c8bc4cd4a'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:52:58.760552 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444b308-8df2-4c91-8c24-aecc8a7e079d admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:58.771485 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9955f4-6308-4d46-8494-b0e0ea8a6ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:58.772173 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9955f4-6308-4d46-8494-b0e0ea8a6ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:58.772459 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9955f4-6308-4d46-8494-b0e0ea8a6ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:58.772848 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1012/2040] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:52:58 2022] DELETE /identity/v3/users/b14367ef1a4648188de7303c8bc4cd4a => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:52:58.772985 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9955f4-6308-4d46-8494-b0e0ea8a6ab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:58.773526 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9955f4-6308-4d46-8494-b0e0ea8a6ab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:58.775417 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9955f4-6308-4d46-8494-b0e0ea8a6ab9 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:58.779302 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699e45e-efaf-46f9-bb7d-c4b2c68f522c None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:58.779755 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699e45e-efaf-46f9-bb7d-c4b2c68f522c None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:58.780036 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699e45e-efaf-46f9-bb7d-c4b2c68f522c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:58.787280 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1029/2041] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:52:58.802027 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9955f4-6308-4d46-8494-b0e0ea8a6ab9 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:58.804016 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-cc9955f4-6308-4d46-8494-b0e0ea8a6ab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:58.806041 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-e699e45e-efaf-46f9-bb7d-c4b2c68f522c None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:58.807548 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-e699e45e-efaf-46f9-bb7d-c4b2c68f522c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:58.823770 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9955f4-6308-4d46-8494-b0e0ea8a6ab9 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:58.884130 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1013/2042] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:52:58.894381 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e699e45e-efaf-46f9-bb7d-c4b2c68f522c None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:58.895927 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-e699e45e-efaf-46f9-bb7d-c4b2c68f522c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:58.898555 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2597c8-4bb4-4db1-9110-6565b9751909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:58.899287 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2597c8-4bb4-4db1-9110-6565b9751909 admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:58.899569 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2597c8-4bb4-4db1-9110-6565b9751909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:58.899839 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2597c8-4bb4-4db1-9110-6565b9751909 admin admin] PATH_INFO: `/v3/projects/8f1db7ec6b1c456ea1c9f5b84f914a7a/users/17a2f75c487943f6a0cab45b4ecce11d/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:58.902349 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2597c8-4bb4-4db1-9110-6565b9751909 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f1db7ec6b1c456ea1c9f5b84f914a7a, user_id=17a2f75c487943f6a0cab45b4ecce11d, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:58.911326 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2597c8-4bb4-4db1-9110-6565b9751909 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:58.916896 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1030/2043] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:52:58 2022] PUT /identity/v3/projects/8f1db7ec6b1c456ea1c9f5b84f914a7a/users/17a2f75c487943f6a0cab45b4ecce11d/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:52:58.929675 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203bda3-0204-47bf-9438-73e926487859 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:58.929966 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203bda3-0204-47bf-9438-73e926487859 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:58.930241 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203bda3-0204-47bf-9438-73e926487859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:58.957700 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e699e45e-efaf-46f9-bb7d-c4b2c68f522c None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:58.964232 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-7203bda3-0204-47bf-9438-73e926487859 None None] MFA Rules not processed for user `17a2f75c487943f6a0cab45b4ecce11d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:52:58.966303 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-7203bda3-0204-47bf-9438-73e926487859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:59.021789 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2185e-fe90-4fc7-b13b-4c7474bb381d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:59.022485 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2185e-fe90-4fc7-b13b-4c7474bb381d service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:59.023104 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2185e-fe90-4fc7-b13b-4c7474bb381d service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:59.023382 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2185e-fe90-4fc7-b13b-4c7474bb381d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:59.093586 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1031/2044] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:52:58 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:52:59.104732 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7203bda3-0204-47bf-9438-73e926487859 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:59.107126 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-7203bda3-0204-47bf-9438-73e926487859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:59.147352 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d2185e-fe90-4fc7-b13b-4c7474bb381d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:59.149318 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d2185e-fe90-4fc7-b13b-4c7474bb381d service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:59.160803 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1014/2045] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:52:59.183240 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7203bda3-0204-47bf-9438-73e926487859 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:59.187309 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e628f-9704-4e69-8288-b266b1e628eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:59.187984 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e628f-9704-4e69-8288-b266b1e628eb service cinder] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:59.188265 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e628f-9704-4e69-8288-b266b1e628eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:59.188538 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e628f-9704-4e69-8288-b266b1e628eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:59.198038 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e628f-9704-4e69-8288-b266b1e628eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:59.199541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e628f-9704-4e69-8288-b266b1e628eb service cinder] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:52:59.210758 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1032/2046] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:52:59 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:52:59.700436 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:DELETE=14,keystone:SELECT=81,keystone:INSERT=5 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:52:59.777042 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2185e-fe90-4fc7-b13b-4c7474bb381d service neutron] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:52:59.779609 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-a4d2185e-fe90-4fc7-b13b-4c7474bb381d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:52:59.792919 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2185e-fe90-4fc7-b13b-4c7474bb381d service neutron] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:52:59.797740 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a25ad-6784-412e-ba90-d9de7cde51da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:52:59.798386 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a25ad-6784-412e-ba90-d9de7cde51da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:52:59.798662 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a25ad-6784-412e-ba90-d9de7cde51da admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:52:59.798956 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a25ad-6784-412e-ba90-d9de7cde51da admin admin] PATH_INFO: `/v3/projects/1371d2d2819042beaa73ab5144147893` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:52:59.800122 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a25ad-6784-412e-ba90-d9de7cde51da admin admin] RBAC: Authorizing `identity:delete_project(project_id=1371d2d2819042beaa73ab5144147893)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:52:59.802078 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a25ad-6784-412e-ba90-d9de7cde51da admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:00.022409 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-c06a25ad-6784-412e-ba90-d9de7cde51da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1371d2d2819042beaa73ab5144147893', 'request_id': 'req-c06a25ad-6784-412e-ba90-d9de7cde51da'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:00.035494 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-c06a25ad-6784-412e-ba90-d9de7cde51da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1371d2d2819042beaa73ab5144147893', 'request_id': 'req-c06a25ad-6784-412e-ba90-d9de7cde51da'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:00.072963 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e628f-9704-4e69-8288-b266b1e628eb service cinder] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:00.084937 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e628f-9704-4e69-8288-b266b1e628eb service cinder] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:00.141114 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856eaf28-766b-47eb-9705-e753a5cce808 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:00.141371 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-c06a25ad-6784-412e-ba90-d9de7cde51da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1371d2d2819042beaa73ab5144147893', 'request_id': 'req-c06a25ad-6784-412e-ba90-d9de7cde51da'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:00.141979 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856eaf28-766b-47eb-9705-e753a5cce808 service cinder] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:00.142545 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856eaf28-766b-47eb-9705-e753a5cce808 service cinder] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:00.142833 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856eaf28-766b-47eb-9705-e753a5cce808 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:00.145105 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-856eaf28-766b-47eb-9705-e753a5cce808 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:00.156952 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-c06a25ad-6784-412e-ba90-d9de7cde51da admin admin] The token cache is being invalidate because project 1371d2d2819042beaa73ab5144147893 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:53:00.157423 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-c06a25ad-6784-412e-ba90-d9de7cde51da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:00.158513 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-c06a25ad-6784-412e-ba90-d9de7cde51da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:00.163272 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1015/2047] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:52:59 2022] DELETE /identity/v3/projects/1371d2d2819042beaa73ab5144147893 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:53:00.164355 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a25ad-6784-412e-ba90-d9de7cde51da admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:00.166165 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-c06a25ad-6784-412e-ba90-d9de7cde51da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:00.222004 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856eaf28-766b-47eb-9705-e753a5cce808 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:00.223549 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856eaf28-766b-47eb-9705-e753a5cce808 service cinder] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:00.233733 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1033/2048] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:53:00 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 07:53:00.241833 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a25ad-6784-412e-ba90-d9de7cde51da admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:00.247579 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076ed80-d503-49d2-8f3f-57a44c174225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:00.248466 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076ed80-d503-49d2-8f3f-57a44c174225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:00.248742 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076ed80-d503-49d2-8f3f-57a44c174225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:00.249040 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076ed80-d503-49d2-8f3f-57a44c174225 admin admin] PATH_INFO: `/v3/users/0326e3b1341649bea03b0f5c654b34e6` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:00.250175 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4076ed80-d503-49d2-8f3f-57a44c174225 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0326e3b1341649bea03b0f5c654b34e6)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:00.252126 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4076ed80-d503-49d2-8f3f-57a44c174225 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:00.600329 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-4076ed80-d503-49d2-8f3f-57a44c174225 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0326e3b1341649bea03b0f5c654b34e6'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:00.601004 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-4076ed80-d503-49d2-8f3f-57a44c174225 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0326e3b1341649bea03b0f5c654b34e6'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:00.758565 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-4076ed80-d503-49d2-8f3f-57a44c174225 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0326e3b1341649bea03b0f5c654b34e6'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:00.759198 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-4076ed80-d503-49d2-8f3f-57a44c174225 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0326e3b1341649bea03b0f5c654b34e6'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:00.770729 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-4076ed80-d503-49d2-8f3f-57a44c174225 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0326e3b1341649bea03b0f5c654b34e6'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:00.790128 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1016/2049] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:53:00 2022] DELETE /identity/v3/users/0326e3b1341649bea03b0f5c654b34e6 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:53:00.881377 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856eaf28-766b-47eb-9705-e753a5cce808 service cinder] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:00.882924 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-856eaf28-766b-47eb-9705-e753a5cce808 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:00.898240 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856eaf28-766b-47eb-9705-e753a5cce808 service cinder] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:00.958486 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07fd2b-71c4-4da8-b906-69a7baffc5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:00.959880 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07fd2b-71c4-4da8-b906-69a7baffc5c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:00.960168 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07fd2b-71c4-4da8-b906-69a7baffc5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:00.960445 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07fd2b-71c4-4da8-b906-69a7baffc5c6 admin admin] PATH_INFO: `/v3/users/6cd8ee4acee54342af52a953ddbbd5aa` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:00.962388 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de07fd2b-71c4-4da8-b906-69a7baffc5c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cd8ee4acee54342af52a953ddbbd5aa)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:00.977245 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de07fd2b-71c4-4da8-b906-69a7baffc5c6 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:01.172302 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076ed80-d503-49d2-8f3f-57a44c174225 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:01.174236 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-4076ed80-d503-49d2-8f3f-57a44c174225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:01.188516 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076ed80-d503-49d2-8f3f-57a44c174225 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:01.193945 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea435f8-8c4c-42e1-8de5-b30e967452cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:01.194506 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea435f8-8c4c-42e1-8de5-b30e967452cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:01.194785 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea435f8-8c4c-42e1-8de5-b30e967452cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:01.195082 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea435f8-8c4c-42e1-8de5-b30e967452cb admin admin] PATH_INFO: `/v3/users/368ed86289ad4b5b86b2164e61b93190` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:01.196811 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea435f8-8c4c-42e1-8de5-b30e967452cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=368ed86289ad4b5b86b2164e61b93190)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:01.203963 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea435f8-8c4c-42e1-8de5-b30e967452cb admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:01.218625 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-de07fd2b-71c4-4da8-b906-69a7baffc5c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cd8ee4acee54342af52a953ddbbd5aa'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:01.227340 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-de07fd2b-71c4-4da8-b906-69a7baffc5c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cd8ee4acee54342af52a953ddbbd5aa'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:01.388844 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-de07fd2b-71c4-4da8-b906-69a7baffc5c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cd8ee4acee54342af52a953ddbbd5aa'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:01.388844 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-de07fd2b-71c4-4da8-b906-69a7baffc5c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cd8ee4acee54342af52a953ddbbd5aa'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:01.406589 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-de07fd2b-71c4-4da8-b906-69a7baffc5c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cd8ee4acee54342af52a953ddbbd5aa'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:01.413035 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1034/2050] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:53:00 2022] DELETE /identity/v3/users/6cd8ee4acee54342af52a953ddbbd5aa => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:53:01.416762 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07fd2b-71c4-4da8-b906-69a7baffc5c6 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:01.418166 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-de07fd2b-71c4-4da8-b906-69a7baffc5c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:01.485847 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07fd2b-71c4-4da8-b906-69a7baffc5c6 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:01.490438 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d4bae-e15c-4d49-a4a8-35df16e3894c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:01.491105 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d4bae-e15c-4d49-a4a8-35df16e3894c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:01.491388 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d4bae-e15c-4d49-a4a8-35df16e3894c admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:01.491661 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d4bae-e15c-4d49-a4a8-35df16e3894c admin admin] PATH_INFO: `/v3/projects/8085d3294b3e4f1fb093d61e60a0f2f6` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:01.492894 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d4bae-e15c-4d49-a4a8-35df16e3894c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8085d3294b3e4f1fb093d61e60a0f2f6)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:01.494901 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d4bae-e15c-4d49-a4a8-35df16e3894c admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:01.528593 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-1ea435f8-8c4c-42e1-8de5-b30e967452cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '368ed86289ad4b5b86b2164e61b93190'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:01.532979 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-1ea435f8-8c4c-42e1-8de5-b30e967452cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '368ed86289ad4b5b86b2164e61b93190'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:01.650210 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-653d4bae-e15c-4d49-a4a8-35df16e3894c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8085d3294b3e4f1fb093d61e60a0f2f6', 'request_id': 'req-653d4bae-e15c-4d49-a4a8-35df16e3894c'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:01.655590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-653d4bae-e15c-4d49-a4a8-35df16e3894c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8085d3294b3e4f1fb093d61e60a0f2f6', 'request_id': 'req-653d4bae-e15c-4d49-a4a8-35df16e3894c'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:01.661793 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-653d4bae-e15c-4d49-a4a8-35df16e3894c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8085d3294b3e4f1fb093d61e60a0f2f6', 'request_id': 'req-653d4bae-e15c-4d49-a4a8-35df16e3894c'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:01.689912 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-1ea435f8-8c4c-42e1-8de5-b30e967452cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '368ed86289ad4b5b86b2164e61b93190'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:01.691397 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:53:01.692020 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-1ea435f8-8c4c-42e1-8de5-b30e967452cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '368ed86289ad4b5b86b2164e61b93190'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:01.699229 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-1ea435f8-8c4c-42e1-8de5-b30e967452cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '368ed86289ad4b5b86b2164e61b93190'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:01.717370 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1017/2051] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:53:01 2022] DELETE /identity/v3/users/368ed86289ad4b5b86b2164e61b93190 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:53:01.720480 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c92b99-9970-45e9-9bac-1831ad42f37e None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:01.720480 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c92b99-9970-45e9-9bac-1831ad42f37e None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:01.720480 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c92b99-9970-45e9-9bac-1831ad42f37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:01.738300 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-03c92b99-9970-45e9-9bac-1831ad42f37e None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:01.739586 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-03c92b99-9970-45e9-9bac-1831ad42f37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:01.810899 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-653d4bae-e15c-4d49-a4a8-35df16e3894c admin admin] The token cache is being invalidate because project 8085d3294b3e4f1fb093d61e60a0f2f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:53:01.811153 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-653d4bae-e15c-4d49-a4a8-35df16e3894c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:01.811793 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-653d4bae-e15c-4d49-a4a8-35df16e3894c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:01.813312 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1035/2052] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:53:01 2022] DELETE /identity/v3/projects/8085d3294b3e4f1fb093d61e60a0f2f6 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:53:01.818080 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b00adb-70a3-4ebd-8b43-ffb0b727d6ce None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:01.818193 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1018/2053] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:53:01.818639 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b00adb-70a3-4ebd-8b43-ffb0b727d6ce None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:01.818639 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b00adb-70a3-4ebd-8b43-ffb0b727d6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:01.819256 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1b2bc-12fa-4558-934c-7797fbdfa110 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:01.819536 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1b2bc-12fa-4558-934c-7797fbdfa110 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:01.819807 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1b2bc-12fa-4558-934c-7797fbdfa110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:01.840052 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-16b00adb-70a3-4ebd-8b43-ffb0b727d6ce None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:01.848804 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-13c1b2bc-12fa-4558-934c-7797fbdfa110 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:01.848926 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-16b00adb-70a3-4ebd-8b43-ffb0b727d6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:01.849006 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-13c1b2bc-12fa-4558-934c-7797fbdfa110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:01.850124 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1019/2054] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:53:01.851101 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1036/2055] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:53:01.851300 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1b2bc-12fa-4558-934c-7797fbdfa110 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:01.852423 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-13c1b2bc-12fa-4558-934c-7797fbdfa110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:01.860741 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248c039-e668-40bf-8bef-5a40d4144edc None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:01.861219 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248c039-e668-40bf-8bef-5a40d4144edc None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:01.861330 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248c039-e668-40bf-8bef-5a40d4144edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:01.881889 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-3248c039-e668-40bf-8bef-5a40d4144edc None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:01.883122 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-3248c039-e668-40bf-8bef-5a40d4144edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:01.892618 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1037/2056] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:53:01.893532 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248c039-e668-40bf-8bef-5a40d4144edc None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:01.894813 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-3248c039-e668-40bf-8bef-5a40d4144edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:01.913394 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1b2bc-12fa-4558-934c-7797fbdfa110 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:01.917113 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a367b13-706b-4e10-bb4d-0b7c8df3d8e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:01.917730 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a367b13-706b-4e10-bb4d-0b7c8df3d8e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:01.918012 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a367b13-706b-4e10-bb4d-0b7c8df3d8e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:01.918435 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a367b13-706b-4e10-bb4d-0b7c8df3d8e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:01.921410 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-0a367b13-706b-4e10-bb4d-0b7c8df3d8e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:01.933428 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a367b13-706b-4e10-bb4d-0b7c8df3d8e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:01.935759 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a367b13-706b-4e10-bb4d-0b7c8df3d8e7 service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:01.945415 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1020/2057] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:53:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:53:01.951092 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a367b13-706b-4e10-bb4d-0b7c8df3d8e7 service neutron] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:01.952437 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248c039-e668-40bf-8bef-5a40d4144edc None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:01.956138 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a8ab1-48ad-4d27-a6e6-49e7867a5695 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:01.956846 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a367b13-706b-4e10-bb4d-0b7c8df3d8e7 service neutron] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:01.957025 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a8ab1-48ad-4d27-a6e6-49e7867a5695 service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:01.957272 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a8ab1-48ad-4d27-a6e6-49e7867a5695 service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:01.957539 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a8ab1-48ad-4d27-a6e6-49e7867a5695 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:01.961541 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9e151-db8e-47ba-a5f0-26f1275f42a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:01.962151 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9e151-db8e-47ba-a5f0-26f1275f42a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:01.962504 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9e151-db8e-47ba-a5f0-26f1275f42a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:01.962752 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9e151-db8e-47ba-a5f0-26f1275f42a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:01.963442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9e151-db8e-47ba-a5f0-26f1275f42a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:53:01.963751 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9e151-db8e-47ba-a5f0-26f1275f42a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:01.966528 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9e151-db8e-47ba-a5f0-26f1275f42a4 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:01.968094 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9a8ab1-48ad-4d27-a6e6-49e7867a5695 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:01.969420 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9a8ab1-48ad-4d27-a6e6-49e7867a5695 service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:01.978826 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1021/2058] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:53:01.980052 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1038/2059] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:53:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:53:01.984612 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9e151-db8e-47ba-a5f0-26f1275f42a4 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:02.001210 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9e151-db8e-47ba-a5f0-26f1275f42a4 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:02.007976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f01b12-f897-42d2-9063-8c55e0eb981a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:02.008648 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f01b12-f897-42d2-9063-8c55e0eb981a admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:02.008930 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f01b12-f897-42d2-9063-8c55e0eb981a admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:02.009203 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f01b12-f897-42d2-9063-8c55e0eb981a admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:02.014959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f01b12-f897-42d2-9063-8c55e0eb981a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:02.014959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f01b12-f897-42d2-9063-8c55e0eb981a admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:02.181014 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1022/2060] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:53:01 2022] POST /identity/v3/projects => generated 369 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:53:02.185317 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a8ab1-48ad-4d27-a6e6-49e7867a5695 service neutron] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:02.194909 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a8ab1-48ad-4d27-a6e6-49e7867a5695 service neutron] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:02.275626 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e36ca-4718-4657-ad4b-2671c33c314d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:02.276356 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e36ca-4718-4657-ad4b-2671c33c314d admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:02.276570 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e36ca-4718-4657-ad4b-2671c33c314d admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:02.276935 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e36ca-4718-4657-ad4b-2671c33c314d admin admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:02.277906 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e36ca-4718-4657-ad4b-2671c33c314d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:02.280529 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e36ca-4718-4657-ad4b-2671c33c314d admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:02.427208 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1039/2061] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:53:02 2022] POST /identity/v3/users => generated 285 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 07:53:02.431216 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f01b12-f897-42d2-9063-8c55e0eb981a admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:02.444168 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f01b12-f897-42d2-9063-8c55e0eb981a admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:02.451659 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ea86a-b182-490a-994e-37fa21a8e943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:02.452680 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ea86a-b182-490a-994e-37fa21a8e943 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:02.453164 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ea86a-b182-490a-994e-37fa21a8e943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:02.453852 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ea86a-b182-490a-994e-37fa21a8e943 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:02.454942 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ea86a-b182-490a-994e-37fa21a8e943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:02.456918 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ea86a-b182-490a-994e-37fa21a8e943 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:02.470127 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1023/2062] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 07:53:02.481762 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e36ca-4718-4657-ad4b-2671c33c314d admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:02.492102 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e36ca-4718-4657-ad4b-2671c33c314d admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:02.497465 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961323a-db74-45bb-85cd-59896895fc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:02.498065 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961323a-db74-45bb-85cd-59896895fc06 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:02.498340 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961323a-db74-45bb-85cd-59896895fc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:02.498729 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961323a-db74-45bb-85cd-59896895fc06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:02.499404 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c961323a-db74-45bb-85cd-59896895fc06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:02.501084 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c961323a-db74-45bb-85cd-59896895fc06 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:02.511147 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1040/2063] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:53:02.521535 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ea86a-b182-490a-994e-37fa21a8e943 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:02.531790 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ea86a-b182-490a-994e-37fa21a8e943 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:02.536459 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a185d-a5b7-4226-924d-97e46a7bb306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:02.537120 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a185d-a5b7-4226-924d-97e46a7bb306 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:02.537403 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a185d-a5b7-4226-924d-97e46a7bb306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:02.537679 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a185d-a5b7-4226-924d-97e46a7bb306 admin admin] PATH_INFO: `/v3/projects/40dff7f366c7469ba1771f140618a07e/users/5cae4fc8e2634f6caaefc89b19f4f087/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:02.552578 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a185d-a5b7-4226-924d-97e46a7bb306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40dff7f366c7469ba1771f140618a07e, user_id=5cae4fc8e2634f6caaefc89b19f4f087, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:02.555312 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a185d-a5b7-4226-924d-97e46a7bb306 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:02.600460 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961323a-db74-45bb-85cd-59896895fc06 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:02.602299 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-c961323a-db74-45bb-85cd-59896895fc06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:02.616832 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961323a-db74-45bb-85cd-59896895fc06 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:02.621495 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc1cf6-8fea-4121-93e2-a2c2035692eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:02.622195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc1cf6-8fea-4121-93e2-a2c2035692eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:02.622681 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc1cf6-8fea-4121-93e2-a2c2035692eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:02.623335 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc1cf6-8fea-4121-93e2-a2c2035692eb admin admin] PATH_INFO: `/v3/projects/3d1e3b422fc645ccb3a38737b3cd0261` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:02.625210 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc1cf6-8fea-4121-93e2-a2c2035692eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d1e3b422fc645ccb3a38737b3cd0261)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:02.630444 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc1cf6-8fea-4121-93e2-a2c2035692eb admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:02.737142 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1024/2064] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:53:02 2022] PUT /identity/v3/projects/40dff7f366c7469ba1771f140618a07e/users/5cae4fc8e2634f6caaefc89b19f4f087/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:53:02.737978 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a185d-a5b7-4226-924d-97e46a7bb306 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:02.739687 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-200a185d-a5b7-4226-924d-97e46a7bb306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:02.795583 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-98dc1cf6-8fea-4121-93e2-a2c2035692eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d1e3b422fc645ccb3a38737b3cd0261', 'request_id': 'req-98dc1cf6-8fea-4121-93e2-a2c2035692eb'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:02.800923 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-98dc1cf6-8fea-4121-93e2-a2c2035692eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d1e3b422fc645ccb3a38737b3cd0261', 'request_id': 'req-98dc1cf6-8fea-4121-93e2-a2c2035692eb'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:02.806812 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a185d-a5b7-4226-924d-97e46a7bb306 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:02.808132 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-98dc1cf6-8fea-4121-93e2-a2c2035692eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d1e3b422fc645ccb3a38737b3cd0261', 'request_id': 'req-98dc1cf6-8fea-4121-93e2-a2c2035692eb'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:02.865506 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f26bd1-7bcd-42b7-9cbb-628a317d4b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:02.866136 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f26bd1-7bcd-42b7-9cbb-628a317d4b37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:02.866445 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f26bd1-7bcd-42b7-9cbb-628a317d4b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:02.866720 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f26bd1-7bcd-42b7-9cbb-628a317d4b37 admin admin] PATH_INFO: `/v3/projects/8c310027952545f390fa7bbc4fdaa09c` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:02.867868 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f26bd1-7bcd-42b7-9cbb-628a317d4b37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c310027952545f390fa7bbc4fdaa09c)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:02.869761 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f26bd1-7bcd-42b7-9cbb-628a317d4b37 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:02.917687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-98dc1cf6-8fea-4121-93e2-a2c2035692eb admin admin] The token cache is being invalidate because project 3d1e3b422fc645ccb3a38737b3cd0261 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:53:02.918345 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-98dc1cf6-8fea-4121-93e2-a2c2035692eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:02.918662 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-98dc1cf6-8fea-4121-93e2-a2c2035692eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:02.920393 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1041/2065] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:53:02 2022] DELETE /identity/v3/projects/3d1e3b422fc645ccb3a38737b3cd0261 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:53:02.922130 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24490c-89ee-4c65-ad2f-7eb601043af0 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:02.922639 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24490c-89ee-4c65-ad2f-7eb601043af0 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:02.922834 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24490c-89ee-4c65-ad2f-7eb601043af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:02.951429 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-0d24490c-89ee-4c65-ad2f-7eb601043af0 None None] MFA Rules not processed for user `5cae4fc8e2634f6caaefc89b19f4f087`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:02.952637 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-0d24490c-89ee-4c65-ad2f-7eb601043af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:02.998483 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-23f26bd1-7bcd-42b7-9cbb-628a317d4b37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c310027952545f390fa7bbc4fdaa09c', 'request_id': 'req-23f26bd1-7bcd-42b7-9cbb-628a317d4b37'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:03.004112 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-23f26bd1-7bcd-42b7-9cbb-628a317d4b37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c310027952545f390fa7bbc4fdaa09c', 'request_id': 'req-23f26bd1-7bcd-42b7-9cbb-628a317d4b37'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:03.018156 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1042/2066] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:53:03.019195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24490c-89ee-4c65-ad2f-7eb601043af0 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:03.020826 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-0d24490c-89ee-4c65-ad2f-7eb601043af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:03.035393 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24490c-89ee-4c65-ad2f-7eb601043af0 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:03.077927 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-23f26bd1-7bcd-42b7-9cbb-628a317d4b37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c310027952545f390fa7bbc4fdaa09c', 'request_id': 'req-23f26bd1-7bcd-42b7-9cbb-628a317d4b37'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:03.090355 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-23f26bd1-7bcd-42b7-9cbb-628a317d4b37 admin admin] The token cache is being invalidate because project 8c310027952545f390fa7bbc4fdaa09c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:53:03.090648 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-23f26bd1-7bcd-42b7-9cbb-628a317d4b37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:03.091938 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f63264-dde4-4d3f-821a-54ea9cd2899e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:03.092070 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-23f26bd1-7bcd-42b7-9cbb-628a317d4b37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:03.092575 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f63264-dde4-4d3f-821a-54ea9cd2899e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:03.092915 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f63264-dde4-4d3f-821a-54ea9cd2899e admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:03.093194 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f63264-dde4-4d3f-821a-54ea9cd2899e admin admin] PATH_INFO: `/v3/users/17a2f75c487943f6a0cab45b4ecce11d` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:03.093496 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1025/2067] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:53:02 2022] DELETE /identity/v3/projects/8c310027952545f390fa7bbc4fdaa09c => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:53:03.094288 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f26bd1-7bcd-42b7-9cbb-628a317d4b37 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:03.095589 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-23f26bd1-7bcd-42b7-9cbb-628a317d4b37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:03.097474 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f63264-dde4-4d3f-821a-54ea9cd2899e admin admin] RBAC: Authorizing `identity:delete_user(user_id=17a2f75c487943f6a0cab45b4ecce11d)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:03.099500 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f63264-dde4-4d3f-821a-54ea9cd2899e admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:03.182297 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f26bd1-7bcd-42b7-9cbb-628a317d4b37 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:03.186779 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700fab3f-55bb-4eeb-99e6-ee1361e0383a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df7725203304d8fbe3a768656cabf23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:03.187423 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fab3f-55bb-4eeb-99e6-ee1361e0383a service glance] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:03.187703 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fab3f-55bb-4eeb-99e6-ee1361e0383a service glance] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:03.187973 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fab3f-55bb-4eeb-99e6-ee1361e0383a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:03.189783 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-700fab3f-55bb-4eeb-99e6-ee1361e0383a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:03.193133 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:53:03.258722 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700fab3f-55bb-4eeb-99e6-ee1361e0383a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:03.260598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700fab3f-55bb-4eeb-99e6-ee1361e0383a service glance] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:03.272788 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1026/2068] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:53:03 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:53:03.273630 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700fab3f-55bb-4eeb-99e6-ee1361e0383a service glance] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:03.274892 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-700fab3f-55bb-4eeb-99e6-ee1361e0383a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:03.287990 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700fab3f-55bb-4eeb-99e6-ee1361e0383a service glance] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:03.292831 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede086aa-774e-4135-ac88-c412249f59b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:03.293994 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede086aa-774e-4135-ac88-c412249f59b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:03.293994 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede086aa-774e-4135-ac88-c412249f59b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:03.293994 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede086aa-774e-4135-ac88-c412249f59b2 admin admin] PATH_INFO: `/v3/users/106ae90479674d9eb519d7d6736263ad` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:03.296906 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede086aa-774e-4135-ac88-c412249f59b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=106ae90479674d9eb519d7d6736263ad)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:03.298831 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede086aa-774e-4135-ac88-c412249f59b2 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:03.379457 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-43f63264-dde4-4d3f-821a-54ea9cd2899e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17a2f75c487943f6a0cab45b4ecce11d'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:03.388391 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-43f63264-dde4-4d3f-821a-54ea9cd2899e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17a2f75c487943f6a0cab45b4ecce11d'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:03.541201 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-43f63264-dde4-4d3f-821a-54ea9cd2899e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17a2f75c487943f6a0cab45b4ecce11d'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:03.541846 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-43f63264-dde4-4d3f-821a-54ea9cd2899e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17a2f75c487943f6a0cab45b4ecce11d'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:03.557113 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-43f63264-dde4-4d3f-821a-54ea9cd2899e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17a2f75c487943f6a0cab45b4ecce11d'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:03.567405 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1043/2069] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:53:03 2022] DELETE /identity/v3/users/17a2f75c487943f6a0cab45b4ecce11d => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:53:03.626090 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-ede086aa-774e-4135-ac88-c412249f59b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '106ae90479674d9eb519d7d6736263ad'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:03.626684 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-ede086aa-774e-4135-ac88-c412249f59b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '106ae90479674d9eb519d7d6736263ad'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:03.701510 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-ede086aa-774e-4135-ac88-c412249f59b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '106ae90479674d9eb519d7d6736263ad'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:03.702796 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-ede086aa-774e-4135-ac88-c412249f59b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '106ae90479674d9eb519d7d6736263ad'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:03.711535 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-ede086aa-774e-4135-ac88-c412249f59b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '106ae90479674d9eb519d7d6736263ad'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:03.728686 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1027/2070] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:53:03 2022] DELETE /identity/v3/users/106ae90479674d9eb519d7d6736263ad => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:53:04.424636 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f63264-dde4-4d3f-821a-54ea9cd2899e admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:04.426126 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-43f63264-dde4-4d3f-821a-54ea9cd2899e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:04.507925 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f63264-dde4-4d3f-821a-54ea9cd2899e admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:04.566370 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f1ad7-663d-4c43-b88a-06f4f812dd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:04.567036 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f1ad7-663d-4c43-b88a-06f4f812dd85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:04.567322 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f1ad7-663d-4c43-b88a-06f4f812dd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:04.567599 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f1ad7-663d-4c43-b88a-06f4f812dd85 admin admin] PATH_INFO: `/v3/projects/8f1db7ec6b1c456ea1c9f5b84f914a7a` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:04.568743 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f1ad7-663d-4c43-b88a-06f4f812dd85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f1db7ec6b1c456ea1c9f5b84f914a7a)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:04.570737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f1ad7-663d-4c43-b88a-06f4f812dd85 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:04.625639 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede086aa-774e-4135-ac88-c412249f59b2 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:04.627678 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-ede086aa-774e-4135-ac88-c412249f59b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:04.642859 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede086aa-774e-4135-ac88-c412249f59b2 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:04.647587 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7c20e-b8fb-429b-bc3a-bd8216acb928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:04.648236 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7c20e-b8fb-429b-bc3a-bd8216acb928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:04.648524 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7c20e-b8fb-429b-bc3a-bd8216acb928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:04.648802 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7c20e-b8fb-429b-bc3a-bd8216acb928 admin admin] PATH_INFO: `/v3/projects/bbdeec4b9603489a9f75b0a55cfd2e1d` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:04.649934 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7c20e-b8fb-429b-bc3a-bd8216acb928 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbdeec4b9603489a9f75b0a55cfd2e1d)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:04.651980 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7c20e-b8fb-429b-bc3a-bd8216acb928 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:04.753794 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-800f1ad7-663d-4c43-b88a-06f4f812dd85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f1db7ec6b1c456ea1c9f5b84f914a7a', 'request_id': 'req-800f1ad7-663d-4c43-b88a-06f4f812dd85'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:04.759256 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-800f1ad7-663d-4c43-b88a-06f4f812dd85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f1db7ec6b1c456ea1c9f5b84f914a7a', 'request_id': 'req-800f1ad7-663d-4c43-b88a-06f4f812dd85'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:04.768613 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-800f1ad7-663d-4c43-b88a-06f4f812dd85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f1db7ec6b1c456ea1c9f5b84f914a7a', 'request_id': 'req-800f1ad7-663d-4c43-b88a-06f4f812dd85'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:04.798320 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-8af7c20e-b8fb-429b-bc3a-bd8216acb928 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbdeec4b9603489a9f75b0a55cfd2e1d', 'request_id': 'req-8af7c20e-b8fb-429b-bc3a-bd8216acb928'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:04.809641 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-8af7c20e-b8fb-429b-bc3a-bd8216acb928 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbdeec4b9603489a9f75b0a55cfd2e1d', 'request_id': 'req-8af7c20e-b8fb-429b-bc3a-bd8216acb928'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:04.926532 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-800f1ad7-663d-4c43-b88a-06f4f812dd85 admin admin] The token cache is being invalidate because project 8f1db7ec6b1c456ea1c9f5b84f914a7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:53:04.926871 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-800f1ad7-663d-4c43-b88a-06f4f812dd85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:04.927577 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-800f1ad7-663d-4c43-b88a-06f4f812dd85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:04.930069 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1044/2071] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:53:04 2022] DELETE /identity/v3/projects/8f1db7ec6b1c456ea1c9f5b84f914a7a => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:53:04.936022 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8dabce-6b5f-43f8-95af-a4d51370675b None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:04.936302 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8dabce-6b5f-43f8-95af-a4d51370675b None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:04.936576 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8dabce-6b5f-43f8-95af-a4d51370675b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:04.959487 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-ed8dabce-6b5f-43f8-95af-a4d51370675b None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:04.960700 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-ed8dabce-6b5f-43f8-95af-a4d51370675b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:04.982172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-8af7c20e-b8fb-429b-bc3a-bd8216acb928 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbdeec4b9603489a9f75b0a55cfd2e1d', 'request_id': 'req-8af7c20e-b8fb-429b-bc3a-bd8216acb928'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:04.994035 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-8af7c20e-b8fb-429b-bc3a-bd8216acb928 admin admin] The token cache is being invalidate because project bbdeec4b9603489a9f75b0a55cfd2e1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:53:04.994330 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-8af7c20e-b8fb-429b-bc3a-bd8216acb928 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:04.996697 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-8af7c20e-b8fb-429b-bc3a-bd8216acb928 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:05.002962 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1028/2072] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:53:04 2022] DELETE /identity/v3/projects/bbdeec4b9603489a9f75b0a55cfd2e1d => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:53:05.004307 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade66c1-1ca5-4065-9c40-3c35d88e2663 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:05.004597 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade66c1-1ca5-4065-9c40-3c35d88e2663 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:05.004876 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade66c1-1ca5-4065-9c40-3c35d88e2663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:05.024992 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-cade66c1-1ca5-4065-9c40-3c35d88e2663 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:05.025760 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1045/2073] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:53:05.028885 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-cade66c1-1ca5-4065-9c40-3c35d88e2663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:05.035116 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1029/2074] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:53:05.036223 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae9c91-3f08-4373-838c-e2b8f5f29cfa None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:05.036223 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae9c91-3f08-4373-838c-e2b8f5f29cfa None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:05.036421 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae9c91-3f08-4373-838c-e2b8f5f29cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:05.042938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e90cee-5dfe-4a85-9b6f-8540abe3070b None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:05.043823 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e90cee-5dfe-4a85-9b6f-8540abe3070b None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:05.044188 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e90cee-5dfe-4a85-9b6f-8540abe3070b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:05.056546 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-56ae9c91-3f08-4373-838c-e2b8f5f29cfa None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:05.057923 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-56ae9c91-3f08-4373-838c-e2b8f5f29cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:05.063951 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-c3e90cee-5dfe-4a85-9b6f-8540abe3070b None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:05.066243 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-c3e90cee-5dfe-4a85-9b6f-8540abe3070b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:05.067053 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1046/2075] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:53:05.071071 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae9c91-3f08-4373-838c-e2b8f5f29cfa None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:05.074490 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1030/2076] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:53:05.078953 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e90cee-5dfe-4a85-9b6f-8540abe3070b None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:05.080658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae9c91-3f08-4373-838c-e2b8f5f29cfa None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:05.085852 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388576f-6f85-41ce-9404-ef7face281f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:05.086465 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388576f-6f85-41ce-9404-ef7face281f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:05.086921 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388576f-6f85-41ce-9404-ef7face281f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:05.087239 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388576f-6f85-41ce-9404-ef7face281f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:05.088025 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8388576f-6f85-41ce-9404-ef7face281f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:53:05.088230 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8388576f-6f85-41ce-9404-ef7face281f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:05.088901 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e90cee-5dfe-4a85-9b6f-8540abe3070b None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:05.094059 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7820b-833d-462b-9bb7-149f01e474d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:05.097818 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7820b-833d-462b-9bb7-149f01e474d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:05.097818 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7820b-833d-462b-9bb7-149f01e474d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:05.097818 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7820b-833d-462b-9bb7-149f01e474d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:05.098099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8388576f-6f85-41ce-9404-ef7face281f6 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:05.098186 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7820b-833d-462b-9bb7-149f01e474d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:53:05.098186 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7820b-833d-462b-9bb7-149f01e474d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:05.098345 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7820b-833d-462b-9bb7-149f01e474d3 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:05.111840 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1047/2077] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:53:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:53:05.111840 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388576f-6f85-41ce-9404-ef7face281f6 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:05.111840 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-8388576f-6f85-41ce-9404-ef7face281f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:05.118167 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1031/2078] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:53:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:53:05.118167 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7820b-833d-462b-9bb7-149f01e474d3 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:05.124934 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388576f-6f85-41ce-9404-ef7face281f6 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:05.130250 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f799af4-52b9-4836-ac28-23b02c378486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:05.130974 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f799af4-52b9-4836-ac28-23b02c378486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:05.131284 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f799af4-52b9-4836-ac28-23b02c378486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:05.131561 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f799af4-52b9-4836-ac28-23b02c378486 admin admin] PATH_INFO: `/v3/users/cddee0903c9a46909498fdc9cefbb78d` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:05.132710 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f799af4-52b9-4836-ac28-23b02c378486 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cddee0903c9a46909498fdc9cefbb78d)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:05.133699 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7820b-833d-462b-9bb7-149f01e474d3 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:05.134640 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f799af4-52b9-4836-ac28-23b02c378486 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:05.139623 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f0567-f6ed-459e-a295-48a88aac32e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:05.140233 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f0567-f6ed-459e-a295-48a88aac32e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:05.140507 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f0567-f6ed-459e-a295-48a88aac32e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:05.141537 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f0567-f6ed-459e-a295-48a88aac32e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:05.141537 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f0567-f6ed-459e-a295-48a88aac32e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:05.143546 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f0567-f6ed-459e-a295-48a88aac32e2 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:05.310763 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1032/2079] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:53:05 2022] POST /identity/v3/projects => generated 383 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:53:05.311632 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f0567-f6ed-459e-a295-48a88aac32e2 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:05.372729 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f0567-f6ed-459e-a295-48a88aac32e2 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:05.377638 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff3bda-8365-4e16-add3-5e689258ca06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:05.384338 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff3bda-8365-4e16-add3-5e689258ca06 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:05.384338 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff3bda-8365-4e16-add3-5e689258ca06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:05.384338 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff3bda-8365-4e16-add3-5e689258ca06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:05.384338 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff3bda-8365-4e16-add3-5e689258ca06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:05.384338 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff3bda-8365-4e16-add3-5e689258ca06 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:05.409980 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:53:05.446436 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-1f799af4-52b9-4836-ac28-23b02c378486 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cddee0903c9a46909498fdc9cefbb78d'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:05.453480 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-1f799af4-52b9-4836-ac28-23b02c378486 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cddee0903c9a46909498fdc9cefbb78d'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:05.503906 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1033/2080] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:53:05 2022] POST /identity/v3/projects => generated 373 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:53:05.504790 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff3bda-8365-4e16-add3-5e689258ca06 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:05.529835 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-1f799af4-52b9-4836-ac28-23b02c378486 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cddee0903c9a46909498fdc9cefbb78d'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:05.530771 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-1f799af4-52b9-4836-ac28-23b02c378486 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cddee0903c9a46909498fdc9cefbb78d'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:05.544091 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-1f799af4-52b9-4836-ac28-23b02c378486 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cddee0903c9a46909498fdc9cefbb78d'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:05.549976 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1048/2081] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:53:05 2022] DELETE /identity/v3/users/cddee0903c9a46909498fdc9cefbb78d => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:53:05.550740 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f799af4-52b9-4836-ac28-23b02c378486 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:05.552152 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-1f799af4-52b9-4836-ac28-23b02c378486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:05.572696 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff3bda-8365-4e16-add3-5e689258ca06 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:05.616328 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:53:05.620302 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f799af4-52b9-4836-ac28-23b02c378486 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:05.625475 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e93d5-98f6-4e5b-a9cf-566a23b4fd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:05.627281 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e93d5-98f6-4e5b-a9cf-566a23b4fd4b admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:05.627281 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e93d5-98f6-4e5b-a9cf-566a23b4fd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:05.627281 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e93d5-98f6-4e5b-a9cf-566a23b4fd4b admin admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:05.627558 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e93d5-98f6-4e5b-a9cf-566a23b4fd4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:05.629820 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e93d5-98f6-4e5b-a9cf-566a23b4fd4b admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:05.630446 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3950376-7adc-49ed-9215-fcd35b809dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:05.631098 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3950376-7adc-49ed-9215-fcd35b809dcf admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:05.631375 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3950376-7adc-49ed-9215-fcd35b809dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:05.631642 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3950376-7adc-49ed-9215-fcd35b809dcf admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:05.632291 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3950376-7adc-49ed-9215-fcd35b809dcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:05.634488 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3950376-7adc-49ed-9215-fcd35b809dcf admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:05.763342 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1049/2082] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:53:05 2022] POST /identity/v3/users => generated 287 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:53:05.766161 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a757a23-ab9a-4e89-82fa-574f4d180ee5 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:05.766625 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a757a23-ab9a-4e89-82fa-574f4d180ee5 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:05.766908 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a757a23-ab9a-4e89-82fa-574f4d180ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:05.786817 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-0a757a23-ab9a-4e89-82fa-574f4d180ee5 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:05.790352 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1034/2083] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:53:05 2022] POST /identity/v3/users => generated 292 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:53:05.790509 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-0a757a23-ab9a-4e89-82fa-574f4d180ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:05.790632 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3950376-7adc-49ed-9215-fcd35b809dcf admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:05.796536 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1050/2084] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:53:05.797297 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a757a23-ab9a-4e89-82fa-574f4d180ee5 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:05.798605 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-0a757a23-ab9a-4e89-82fa-574f4d180ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:05.799918 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3950376-7adc-49ed-9215-fcd35b809dcf admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:05.805264 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d781c-2dfa-4ec8-880f-eebb2edb0fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:05.806658 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d781c-2dfa-4ec8-880f-eebb2edb0fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:05.807178 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d781c-2dfa-4ec8-880f-eebb2edb0fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:05.807630 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d781c-2dfa-4ec8-880f-eebb2edb0fe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:05.808287 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90d781c-2dfa-4ec8-880f-eebb2edb0fe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:05.810260 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90d781c-2dfa-4ec8-880f-eebb2edb0fe0 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:05.820713 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1035/2085] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:53:05.827409 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d781c-2dfa-4ec8-880f-eebb2edb0fe0 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:05.827409 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-b90d781c-2dfa-4ec8-880f-eebb2edb0fe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:05.827661 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a757a23-ab9a-4e89-82fa-574f4d180ee5 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:05.830487 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc5c21-b565-4c97-9817-cbeff32da16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:05.832055 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc5c21-b565-4c97-9817-cbeff32da16b admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:05.832826 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc5c21-b565-4c97-9817-cbeff32da16b admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:05.832826 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc5c21-b565-4c97-9817-cbeff32da16b admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:05.833534 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc5c21-b565-4c97-9817-cbeff32da16b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:05.835557 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc5c21-b565-4c97-9817-cbeff32da16b admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:05.850333 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1051/2086] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:53:05.851407 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc5c21-b565-4c97-9817-cbeff32da16b admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:05.861567 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc5c21-b565-4c97-9817-cbeff32da16b admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:05.866932 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded71e7-77ab-4a22-9f22-168506371a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:05.868025 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded71e7-77ab-4a22-9f22-168506371a42 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:05.868025 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded71e7-77ab-4a22-9f22-168506371a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:05.868228 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded71e7-77ab-4a22-9f22-168506371a42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:05.868778 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded71e7-77ab-4a22-9f22-168506371a42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:05.870424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded71e7-77ab-4a22-9f22-168506371a42 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:05.893325 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1052/2087] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:53:05.896181 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded71e7-77ab-4a22-9f22-168506371a42 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:05.900398 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d781c-2dfa-4ec8-880f-eebb2edb0fe0 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:05.905262 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dffea5-a810-4188-a800-32b86a270819 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:05.905730 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dffea5-a810-4188-a800-32b86a270819 service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:05.906045 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dffea5-a810-4188-a800-32b86a270819 service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:05.906377 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dffea5-a810-4188-a800-32b86a270819 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:05.908334 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded71e7-77ab-4a22-9f22-168506371a42 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:05.914672 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc2b79-c42c-4e9b-a6c1-b4cc540e4946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:05.915437 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc2b79-c42c-4e9b-a6c1-b4cc540e4946 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:05.915812 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc2b79-c42c-4e9b-a6c1-b4cc540e4946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:05.916181 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc2b79-c42c-4e9b-a6c1-b4cc540e4946 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:05.917086 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc2b79-c42c-4e9b-a6c1-b4cc540e4946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:05.919376 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc2b79-c42c-4e9b-a6c1-b4cc540e4946 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:05.920217 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dffea5-a810-4188-a800-32b86a270819 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:05.921779 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dffea5-a810-4188-a800-32b86a270819 service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:05.938023 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1053/2088] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:53:05.938023 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc2b79-c42c-4e9b-a6c1-b4cc540e4946 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:05.939670 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1036/2089] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:53:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:53:05.947327 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc2b79-c42c-4e9b-a6c1-b4cc540e4946 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:05.947760 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dffea5-a810-4188-a800-32b86a270819 service neutron] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:05.952725 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9134c392-46e0-4714-b969-bb3b579c4d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:05.953395 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134c392-46e0-4714-b969-bb3b579c4d12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:05.953675 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134c392-46e0-4714-b969-bb3b579c4d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:05.954093 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134c392-46e0-4714-b969-bb3b579c4d12 admin admin] PATH_INFO: `/v3/projects/7f8c0255857d4156adfb8461398baf02/users/990e9bfc16eb4e1ab7d3b7bc6100ef28/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:05.964551 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dffea5-a810-4188-a800-32b86a270819 service neutron] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:05.972088 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9134c392-46e0-4714-b969-bb3b579c4d12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f8c0255857d4156adfb8461398baf02, user_id=990e9bfc16eb4e1ab7d3b7bc6100ef28, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:05.975504 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5f27a-ca86-47f4-9c6b-fff75bee6cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:05.975504 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5f27a-ca86-47f4-9c6b-fff75bee6cab admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:05.975504 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5f27a-ca86-47f4-9c6b-fff75bee6cab admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:05.975504 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5f27a-ca86-47f4-9c6b-fff75bee6cab admin admin] PATH_INFO: `/v3/projects/86e3187815414b2bbd61f52b03bcf836/users/867719a3fa964c9081d8248040f6f180/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:05.975860 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9134c392-46e0-4714-b969-bb3b579c4d12 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:05.992324 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef5f27a-ca86-47f4-9c6b-fff75bee6cab admin admin] RBAC: Authorizing `identity:create_grant(project_id=86e3187815414b2bbd61f52b03bcf836, user_id=867719a3fa964c9081d8248040f6f180, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:05.994704 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef5f27a-ca86-47f4-9c6b-fff75bee6cab admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:06.067736 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1054/2090] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:53:05 2022] PUT /identity/v3/projects/7f8c0255857d4156adfb8461398baf02/users/990e9bfc16eb4e1ab7d3b7bc6100ef28/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:53:06.081239 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c64b21-53be-40c9-b1bd-a9201482ad95 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:06.081714 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c64b21-53be-40c9-b1bd-a9201482ad95 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:06.081986 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c64b21-53be-40c9-b1bd-a9201482ad95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:06.110044 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-a6c64b21-53be-40c9-b1bd-a9201482ad95 None None] MFA Rules not processed for user `990e9bfc16eb4e1ab7d3b7bc6100ef28`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:06.111299 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-a6c64b21-53be-40c9-b1bd-a9201482ad95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:06.125627 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1037/2091] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:53:05 2022] PUT /identity/v3/projects/86e3187815414b2bbd61f52b03bcf836/users/867719a3fa964c9081d8248040f6f180/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:53:06.140580 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d85a1-df2a-4161-821d-357ead105ee0 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:06.140860 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d85a1-df2a-4161-821d-357ead105ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:06.141134 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d85a1-df2a-4161-821d-357ead105ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:06.170707 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-410d85a1-df2a-4161-821d-357ead105ee0 None None] MFA Rules not processed for user `867719a3fa964c9081d8248040f6f180`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:06.172001 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-410d85a1-df2a-4161-821d-357ead105ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:06.183598 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1055/2092] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:53:06.195825 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c64b21-53be-40c9-b1bd-a9201482ad95 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:06.197424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-a6c64b21-53be-40c9-b1bd-a9201482ad95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:06.245121 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1038/2093] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:53:06.247026 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d85a1-df2a-4161-821d-357ead105ee0 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:06.259356 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c64b21-53be-40c9-b1bd-a9201482ad95 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:06.316957 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd6494-908f-4579-8dc9-71700979d3e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:06.317584 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd6494-908f-4579-8dc9-71700979d3e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:06.318333 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd6494-908f-4579-8dc9-71700979d3e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:06.318333 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd6494-908f-4579-8dc9-71700979d3e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:06.327085 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d85a1-df2a-4161-821d-357ead105ee0 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:06.332220 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee809db-1cfe-4863-8a26-da398ca7346e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:06.332782 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee809db-1cfe-4863-8a26-da398ca7346e admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:06.333063 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee809db-1cfe-4863-8a26-da398ca7346e admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:06.333340 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee809db-1cfe-4863-8a26-da398ca7346e admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:06.334216 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee809db-1cfe-4863-8a26-da398ca7346e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:06.336179 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee809db-1cfe-4863-8a26-da398ca7346e admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:06.413550 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd6494-908f-4579-8dc9-71700979d3e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:06.415002 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd6494-908f-4579-8dc9-71700979d3e0 service cinder] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:06.424272 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1056/2094] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:53:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 07:53:06.446959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1039/2095] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:53:06 2022] POST /identity/v3/projects => generated 383 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:53:06.447135 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd6494-908f-4579-8dc9-71700979d3e0 service cinder] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:06.447626 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee809db-1cfe-4863-8a26-da398ca7346e admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:06.453434 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd6494-908f-4579-8dc9-71700979d3e0 service cinder] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:06.511224 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafeb8eb-de52-4f04-bb9c-b3ecc1f3ccb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:06.511987 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafeb8eb-de52-4f04-bb9c-b3ecc1f3ccb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:06.512399 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafeb8eb-de52-4f04-bb9c-b3ecc1f3ccb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:06.512798 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafeb8eb-de52-4f04-bb9c-b3ecc1f3ccb7 admin admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:06.513449 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafeb8eb-de52-4f04-bb9c-b3ecc1f3ccb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:06.514753 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee809db-1cfe-4863-8a26-da398ca7346e admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:06.515410 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafeb8eb-de52-4f04-bb9c-b3ecc1f3ccb7 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:06.519900 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb7e67-1cb3-443d-b278-0e2f354f3b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:06.520714 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb7e67-1cb3-443d-b278-0e2f354f3b1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:06.521051 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb7e67-1cb3-443d-b278-0e2f354f3b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:06.521373 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb7e67-1cb3-443d-b278-0e2f354f3b1c admin admin] PATH_INFO: `/v3/users/990e9bfc16eb4e1ab7d3b7bc6100ef28` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:06.522517 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb7e67-1cb3-443d-b278-0e2f354f3b1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=990e9bfc16eb4e1ab7d3b7bc6100ef28)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:06.524533 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb7e67-1cb3-443d-b278-0e2f354f3b1c admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:06.639120 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1057/2096] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:53:06 2022] POST /identity/v3/users => generated 298 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:53:06.642836 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafeb8eb-de52-4f04-bb9c-b3ecc1f3ccb7 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:06.642836 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-bafeb8eb-de52-4f04-bb9c-b3ecc1f3ccb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:06.655590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafeb8eb-de52-4f04-bb9c-b3ecc1f3ccb7 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:06.660710 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d65fa-2fb1-4a5c-a26a-33c0f9dc9392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:06.661359 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d65fa-2fb1-4a5c-a26a-33c0f9dc9392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:06.661640 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d65fa-2fb1-4a5c-a26a-33c0f9dc9392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:06.661913 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d65fa-2fb1-4a5c-a26a-33c0f9dc9392 admin admin] PATH_INFO: `/v3/projects/0b935f03e3494158894711cd3fc2e40d` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:06.663086 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d65fa-2fb1-4a5c-a26a-33c0f9dc9392 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b935f03e3494158894711cd3fc2e40d)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:06.664968 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d65fa-2fb1-4a5c-a26a-33c0f9dc9392 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:06.905367 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-0b2d65fa-2fb1-4a5c-a26a-33c0f9dc9392 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b935f03e3494158894711cd3fc2e40d', 'request_id': 'req-0b2d65fa-2fb1-4a5c-a26a-33c0f9dc9392'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:06.907773 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-2dfb7e67-1cb3-443d-b278-0e2f354f3b1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '990e9bfc16eb4e1ab7d3b7bc6100ef28'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:06.908550 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-2dfb7e67-1cb3-443d-b278-0e2f354f3b1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '990e9bfc16eb4e1ab7d3b7bc6100ef28'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:06.911584 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-0b2d65fa-2fb1-4a5c-a26a-33c0f9dc9392 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b935f03e3494158894711cd3fc2e40d', 'request_id': 'req-0b2d65fa-2fb1-4a5c-a26a-33c0f9dc9392'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:06.919138 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-0b2d65fa-2fb1-4a5c-a26a-33c0f9dc9392 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b935f03e3494158894711cd3fc2e40d', 'request_id': 'req-0b2d65fa-2fb1-4a5c-a26a-33c0f9dc9392'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:07.107023 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-2dfb7e67-1cb3-443d-b278-0e2f354f3b1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '990e9bfc16eb4e1ab7d3b7bc6100ef28'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:07.108029 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-2dfb7e67-1cb3-443d-b278-0e2f354f3b1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '990e9bfc16eb4e1ab7d3b7bc6100ef28'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:07.115841 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-2dfb7e67-1cb3-443d-b278-0e2f354f3b1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '990e9bfc16eb4e1ab7d3b7bc6100ef28'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:07.138302 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1040/2097] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:53:06 2022] DELETE /identity/v3/users/990e9bfc16eb4e1ab7d3b7bc6100ef28 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:53:07.139231 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb7e67-1cb3-443d-b278-0e2f354f3b1c admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:07.141267 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-2dfb7e67-1cb3-443d-b278-0e2f354f3b1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:07.213201 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb7e67-1cb3-443d-b278-0e2f354f3b1c admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:07.218688 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468eed98-3d42-4cfb-af6d-4833c156b175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:07.219354 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468eed98-3d42-4cfb-af6d-4833c156b175 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:07.219636 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468eed98-3d42-4cfb-af6d-4833c156b175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:07.219912 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468eed98-3d42-4cfb-af6d-4833c156b175 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:07.220587 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468eed98-3d42-4cfb-af6d-4833c156b175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:07.222238 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468eed98-3d42-4cfb-af6d-4833c156b175 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:07.240792 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1041/2098] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:53:07.240792 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c282fc9-511f-4d8a-9ba8-3afa68608792 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:07.240792 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c282fc9-511f-4d8a-9ba8-3afa68608792 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:07.240792 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c282fc9-511f-4d8a-9ba8-3afa68608792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:07.250259 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-0b2d65fa-2fb1-4a5c-a26a-33c0f9dc9392 admin admin] The token cache is being invalidate because project 0b935f03e3494158894711cd3fc2e40d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:53:07.250259 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-0b2d65fa-2fb1-4a5c-a26a-33c0f9dc9392 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:07.250259 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-0b2d65fa-2fb1-4a5c-a26a-33c0f9dc9392 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:07.250259 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1058/2099] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:53:06 2022] DELETE /identity/v3/projects/0b935f03e3494158894711cd3fc2e40d => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:53:07.250259 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d65fa-2fb1-4a5c-a26a-33c0f9dc9392 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:07.250654 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-0b2d65fa-2fb1-4a5c-a26a-33c0f9dc9392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:07.266551 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-1c282fc9-511f-4d8a-9ba8-3afa68608792 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:07.268241 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-1c282fc9-511f-4d8a-9ba8-3afa68608792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:07.277377 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1042/2100] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:53:07.279212 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c282fc9-511f-4d8a-9ba8-3afa68608792 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:07.287289 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-1c282fc9-511f-4d8a-9ba8-3afa68608792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:07.307217 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c282fc9-511f-4d8a-9ba8-3afa68608792 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:07.313132 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a54014-38c5-48ae-8491-35307568c1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:07.313784 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a54014-38c5-48ae-8491-35307568c1c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:07.314091 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a54014-38c5-48ae-8491-35307568c1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:07.314579 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a54014-38c5-48ae-8491-35307568c1c3 admin admin] PATH_INFO: `/v3/users/b62028320c474bde875bb5f6fcebc0d8` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:07.315590 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a54014-38c5-48ae-8491-35307568c1c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b62028320c474bde875bb5f6fcebc0d8)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:07.317513 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a54014-38c5-48ae-8491-35307568c1c3 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:07.335112 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d65fa-2fb1-4a5c-a26a-33c0f9dc9392 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:07.340479 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e65498-37ee-4ecf-964c-0f34e97ce919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:07.341131 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e65498-37ee-4ecf-964c-0f34e97ce919 admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:07.341456 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e65498-37ee-4ecf-964c-0f34e97ce919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:07.341733 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e65498-37ee-4ecf-964c-0f34e97ce919 admin admin] PATH_INFO: `/v3/projects/12a22647302c47f0ae846c3346ac5339/users/18dadb56514d4f99804a1d94c72dd206/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:07.360263 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e65498-37ee-4ecf-964c-0f34e97ce919 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12a22647302c47f0ae846c3346ac5339, user_id=18dadb56514d4f99804a1d94c72dd206, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:07.363255 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e65498-37ee-4ecf-964c-0f34e97ce919 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:07.701867 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1059/2101] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:53:07 2022] PUT /identity/v3/projects/12a22647302c47f0ae846c3346ac5339/users/18dadb56514d4f99804a1d94c72dd206/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:53:07.705736 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e65498-37ee-4ecf-964c-0f34e97ce919 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:07.707719 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-27e65498-37ee-4ecf-964c-0f34e97ce919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:07.770446 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e65498-37ee-4ecf-964c-0f34e97ce919 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:07.774830 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f4f57-fc6a-40c2-9de2-a20db8077d67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:07.782045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f4f57-fc6a-40c2-9de2-a20db8077d67 service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:07.782045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f4f57-fc6a-40c2-9de2-a20db8077d67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:07.782045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f4f57-fc6a-40c2-9de2-a20db8077d67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:07.790940 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-02a54014-38c5-48ae-8491-35307568c1c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b62028320c474bde875bb5f6fcebc0d8'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:07.791940 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-02a54014-38c5-48ae-8491-35307568c1c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b62028320c474bde875bb5f6fcebc0d8'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:07.842121 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f4f57-fc6a-40c2-9de2-a20db8077d67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:07.843665 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f4f57-fc6a-40c2-9de2-a20db8077d67 service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:07.853539 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1060/2102] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:53:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:53:07.854572 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f4f57-fc6a-40c2-9de2-a20db8077d67 service neutron] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:07.866072 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f4f57-fc6a-40c2-9de2-a20db8077d67 service neutron] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:07.871071 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a43b1-bfdb-4e75-800b-21c3e0da24c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:07.871883 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a43b1-bfdb-4e75-800b-21c3e0da24c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:07.872204 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a43b1-bfdb-4e75-800b-21c3e0da24c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:07.872501 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a43b1-bfdb-4e75-800b-21c3e0da24c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:07.873265 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8a43b1-bfdb-4e75-800b-21c3e0da24c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:07.874932 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8a43b1-bfdb-4e75-800b-21c3e0da24c2 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:07.889467 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1061/2103] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:53:07.890618 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a43b1-bfdb-4e75-800b-21c3e0da24c2 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:07.901632 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a43b1-bfdb-4e75-800b-21c3e0da24c2 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:07.907631 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b360cca5-2005-4b51-8ee8-bd43f16f5910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:07.908313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360cca5-2005-4b51-8ee8-bd43f16f5910 admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:07.908604 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360cca5-2005-4b51-8ee8-bd43f16f5910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:07.908910 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360cca5-2005-4b51-8ee8-bd43f16f5910 admin admin] PATH_INFO: `/v3/projects/12a22647302c47f0ae846c3346ac5339/users/18dadb56514d4f99804a1d94c72dd206/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:07.911018 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b360cca5-2005-4b51-8ee8-bd43f16f5910 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12a22647302c47f0ae846c3346ac5339, user_id=18dadb56514d4f99804a1d94c72dd206, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:07.914118 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b360cca5-2005-4b51-8ee8-bd43f16f5910 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:07.926722 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1062/2104] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:53:07 2022] PUT /identity/v3/projects/12a22647302c47f0ae846c3346ac5339/users/18dadb56514d4f99804a1d94c72dd206/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:53:07.935635 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-02a54014-38c5-48ae-8491-35307568c1c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b62028320c474bde875bb5f6fcebc0d8'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:07.944180 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-02a54014-38c5-48ae-8491-35307568c1c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b62028320c474bde875bb5f6fcebc0d8'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:07.944758 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8faba-dd65-4b1f-9fed-57f43366f022 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:07.944758 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8faba-dd65-4b1f-9fed-57f43366f022 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:07.944758 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8faba-dd65-4b1f-9fed-57f43366f022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:07.952666 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-02a54014-38c5-48ae-8491-35307568c1c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b62028320c474bde875bb5f6fcebc0d8'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:07.970933 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-cce8faba-dd65-4b1f-9fed-57f43366f022 None None] MFA Rules not processed for user `18dadb56514d4f99804a1d94c72dd206`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:07.972403 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-cce8faba-dd65-4b1f-9fed-57f43366f022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:07.983884 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1043/2105] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:53:07 2022] DELETE /identity/v3/users/b62028320c474bde875bb5f6fcebc0d8 => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:53:08.140997 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1063/2106] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:07 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:53:08.156072 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a54014-38c5-48ae-8491-35307568c1c3 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:08.157499 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-02a54014-38c5-48ae-8491-35307568c1c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:08.272648 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a54014-38c5-48ae-8491-35307568c1c3 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:08.282564 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b865df-e512-4e9a-acc1-bb169843787e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:08.283227 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b865df-e512-4e9a-acc1-bb169843787e service cinder] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:08.287553 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b865df-e512-4e9a-acc1-bb169843787e service cinder] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:08.287553 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b865df-e512-4e9a-acc1-bb169843787e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:08.290062 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-44b865df-e512-4e9a-acc1-bb169843787e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:08.395703 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b865df-e512-4e9a-acc1-bb169843787e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:08.397245 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b865df-e512-4e9a-acc1-bb169843787e service cinder] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:08.408926 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1044/2107] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:53:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:53:08.553931 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8faba-dd65-4b1f-9fed-57f43366f022 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:08.555349 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-cce8faba-dd65-4b1f-9fed-57f43366f022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:08.655644 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8faba-dd65-4b1f-9fed-57f43366f022 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:08.726021 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a4605-240c-4747-8cc6-aeea2f153960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:08.726708 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a4605-240c-4747-8cc6-aeea2f153960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:08.726957 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a4605-240c-4747-8cc6-aeea2f153960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:08.727257 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a4605-240c-4747-8cc6-aeea2f153960 admin admin] PATH_INFO: `/v3/projects/7f8c0255857d4156adfb8461398baf02` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:08.729529 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a4605-240c-4747-8cc6-aeea2f153960 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f8c0255857d4156adfb8461398baf02)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:08.732721 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a4605-240c-4747-8cc6-aeea2f153960 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:08.826500 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b865df-e512-4e9a-acc1-bb169843787e service cinder] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:08.827969 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-44b865df-e512-4e9a-acc1-bb169843787e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:08.842461 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b865df-e512-4e9a-acc1-bb169843787e service cinder] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:08.847408 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ffbb6-6214-4f15-89a2-b43a82d1b961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:08.848085 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ffbb6-6214-4f15-89a2-b43a82d1b961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:08.848369 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ffbb6-6214-4f15-89a2-b43a82d1b961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:08.848646 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ffbb6-6214-4f15-89a2-b43a82d1b961 admin admin] PATH_INFO: `/v3/projects/2427b02be5fb427ba7b880f95535a3f7` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:08.849819 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547ffbb6-6214-4f15-89a2-b43a82d1b961 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2427b02be5fb427ba7b880f95535a3f7)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:08.851782 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547ffbb6-6214-4f15-89a2-b43a82d1b961 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:08.877757 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-d81a4605-240c-4747-8cc6-aeea2f153960 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f8c0255857d4156adfb8461398baf02', 'request_id': 'req-d81a4605-240c-4747-8cc6-aeea2f153960'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:08.883394 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-d81a4605-240c-4747-8cc6-aeea2f153960 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f8c0255857d4156adfb8461398baf02', 'request_id': 'req-d81a4605-240c-4747-8cc6-aeea2f153960'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:08.890149 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-d81a4605-240c-4747-8cc6-aeea2f153960 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f8c0255857d4156adfb8461398baf02', 'request_id': 'req-d81a4605-240c-4747-8cc6-aeea2f153960'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:09.012187 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-547ffbb6-6214-4f15-89a2-b43a82d1b961 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2427b02be5fb427ba7b880f95535a3f7', 'request_id': 'req-547ffbb6-6214-4f15-89a2-b43a82d1b961'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:09.019394 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-547ffbb6-6214-4f15-89a2-b43a82d1b961 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2427b02be5fb427ba7b880f95535a3f7', 'request_id': 'req-547ffbb6-6214-4f15-89a2-b43a82d1b961'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:09.055251 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-d81a4605-240c-4747-8cc6-aeea2f153960 admin admin] The token cache is being invalidate because project 7f8c0255857d4156adfb8461398baf02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:53:09.058200 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-d81a4605-240c-4747-8cc6-aeea2f153960 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:09.058200 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-d81a4605-240c-4747-8cc6-aeea2f153960 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:09.062192 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1064/2108] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:53:08 2022] DELETE /identity/v3/projects/7f8c0255857d4156adfb8461398baf02 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:53:09.063736 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf1eb1-38df-4ce6-b053-cecd73419b9b None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:09.063948 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf1eb1-38df-4ce6-b053-cecd73419b9b None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:09.064227 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf1eb1-38df-4ce6-b053-cecd73419b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:09.084002 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-8cdf1eb1-38df-4ce6-b053-cecd73419b9b None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:09.085244 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-8cdf1eb1-38df-4ce6-b053-cecd73419b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:09.158282 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-547ffbb6-6214-4f15-89a2-b43a82d1b961 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2427b02be5fb427ba7b880f95535a3f7', 'request_id': 'req-547ffbb6-6214-4f15-89a2-b43a82d1b961'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:09.163159 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1065/2109] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:53:09.170335 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c579e7-f740-4b6b-aba0-c80ebad4ac5a None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:09.170596 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c579e7-f740-4b6b-aba0-c80ebad4ac5a None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:09.170872 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c579e7-f740-4b6b-aba0-c80ebad4ac5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:09.173287 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-547ffbb6-6214-4f15-89a2-b43a82d1b961 admin admin] The token cache is being invalidate because project 2427b02be5fb427ba7b880f95535a3f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:53:09.173584 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-547ffbb6-6214-4f15-89a2-b43a82d1b961 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:09.175527 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-547ffbb6-6214-4f15-89a2-b43a82d1b961 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:09.178129 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1045/2110] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:53:08 2022] DELETE /identity/v3/projects/2427b02be5fb427ba7b880f95535a3f7 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:53:09.188217 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af46f2b-847c-48c8-bf59-15498baf0d59 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:09.188918 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af46f2b-847c-48c8-bf59-15498baf0d59 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:09.189263 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af46f2b-847c-48c8-bf59-15498baf0d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:09.208483 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-76c579e7-f740-4b6b-aba0-c80ebad4ac5a None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:09.210155 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-76c579e7-f740-4b6b-aba0-c80ebad4ac5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:09.222162 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1066/2111] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:53:09.224394 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-7af46f2b-847c-48c8-bf59-15498baf0d59 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:09.225812 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-7af46f2b-847c-48c8-bf59-15498baf0d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:09.226245 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c579e7-f740-4b6b-aba0-c80ebad4ac5a None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:09.235219 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1046/2112] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:53:09.243134 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c579e7-f740-4b6b-aba0-c80ebad4ac5a None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:09.245587 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e811a7b-c11f-4e3c-b1fd-7bdf3c985a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:09.246624 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e811a7b-c11f-4e3c-b1fd-7bdf3c985a01 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:09.247118 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e811a7b-c11f-4e3c-b1fd-7bdf3c985a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:09.247406 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e811a7b-c11f-4e3c-b1fd-7bdf3c985a01 admin admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:09.248082 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149ad69-0907-4782-8c5c-84626d4aeef7 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:09.248514 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149ad69-0907-4782-8c5c-84626d4aeef7 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:09.248616 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e811a7b-c11f-4e3c-b1fd-7bdf3c985a01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:53:09.248834 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149ad69-0907-4782-8c5c-84626d4aeef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:09.248950 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e811a7b-c11f-4e3c-b1fd-7bdf3c985a01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:09.250431 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e811a7b-c11f-4e3c-b1fd-7bdf3c985a01 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:09.263286 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1067/2113] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:53:09.268885 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e811a7b-c11f-4e3c-b1fd-7bdf3c985a01 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:09.278233 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-0149ad69-0907-4782-8c5c-84626d4aeef7 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:09.279893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-0149ad69-0907-4782-8c5c-84626d4aeef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:09.292984 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1047/2114] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:53:09.294404 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e811a7b-c11f-4e3c-b1fd-7bdf3c985a01 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:09.294695 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149ad69-0907-4782-8c5c-84626d4aeef7 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:09.299978 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d89b9-d698-4804-b352-a04c164a2248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:09.300801 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d89b9-d698-4804-b352-a04c164a2248 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:09.301075 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d89b9-d698-4804-b352-a04c164a2248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:09.301416 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d89b9-d698-4804-b352-a04c164a2248 admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:09.302368 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76d89b9-d698-4804-b352-a04c164a2248 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:09.304279 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149ad69-0907-4782-8c5c-84626d4aeef7 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:09.304612 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76d89b9-d698-4804-b352-a04c164a2248 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:09.311789 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b36309-69e2-4ac9-b473-42916f2341fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:09.312416 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b36309-69e2-4ac9-b473-42916f2341fa admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:09.317581 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b36309-69e2-4ac9-b473-42916f2341fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:09.317581 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b36309-69e2-4ac9-b473-42916f2341fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:09.317581 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b36309-69e2-4ac9-b473-42916f2341fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:53:09.317581 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b36309-69e2-4ac9-b473-42916f2341fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:09.317581 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b36309-69e2-4ac9-b473-42916f2341fa admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:09.329653 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1048/2115] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:53:09.335101 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b36309-69e2-4ac9-b473-42916f2341fa admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:09.348159 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b36309-69e2-4ac9-b473-42916f2341fa admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:09.353724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e8d936-92d2-4a5d-b9a2-4edf65a1f797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:09.354404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8d936-92d2-4a5d-b9a2-4edf65a1f797 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:09.354765 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8d936-92d2-4a5d-b9a2-4edf65a1f797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:09.355131 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8d936-92d2-4a5d-b9a2-4edf65a1f797 admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:09.355858 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e8d936-92d2-4a5d-b9a2-4edf65a1f797 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:09.357929 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e8d936-92d2-4a5d-b9a2-4edf65a1f797 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:09.435178 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1068/2116] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:53:09 2022] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:53:09.439352 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d89b9-d698-4804-b352-a04c164a2248 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:09.463882 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1049/2117] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:53:09 2022] POST /identity/v3/projects => generated 381 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 07:53:09.469906 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e8d936-92d2-4a5d-b9a2-4edf65a1f797 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:09.516000 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d89b9-d698-4804-b352-a04c164a2248 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:09.524114 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:53:09.550399 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e8d936-92d2-4a5d-b9a2-4edf65a1f797 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:09.555734 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9e357-d266-4f72-83b0-cb79a52d155c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:09.556379 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9e357-d266-4f72-83b0-cb79a52d155c admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:09.556662 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9e357-d266-4f72-83b0-cb79a52d155c admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:09.556945 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9e357-d266-4f72-83b0-cb79a52d155c admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:09.557590 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9e357-d266-4f72-83b0-cb79a52d155c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:09.563435 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9e357-d266-4f72-83b0-cb79a52d155c admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:09.583042 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c64c5-3955-4b77-9728-a3abc63462e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:09.583716 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c64c5-3955-4b77-9728-a3abc63462e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:09.584015 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c64c5-3955-4b77-9728-a3abc63462e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:09.584453 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c64c5-3955-4b77-9728-a3abc63462e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:09.585252 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c64c5-3955-4b77-9728-a3abc63462e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:09.587204 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c64c5-3955-4b77-9728-a3abc63462e1 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:09.622502 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:53:09.737566 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1050/2118] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:53:09 2022] POST /identity/v3/users => generated 291 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 07:53:09.754317 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9e357-d266-4f72-83b0-cb79a52d155c admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:09.764785 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9e357-d266-4f72-83b0-cb79a52d155c admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:09.769483 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d2f61-062a-4ddc-9265-005cacebca99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:09.770082 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d2f61-062a-4ddc-9265-005cacebca99 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:09.770359 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d2f61-062a-4ddc-9265-005cacebca99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:09.770630 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d2f61-062a-4ddc-9265-005cacebca99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:09.771316 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d2f61-062a-4ddc-9265-005cacebca99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:09.773089 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d2f61-062a-4ddc-9265-005cacebca99 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:09.784828 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1051/2119] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 07:53:09.789206 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d2f61-062a-4ddc-9265-005cacebca99 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:09.798619 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1069/2120] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:53:09 2022] POST /identity/v3/users => generated 287 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:53:09.800266 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c64c5-3955-4b77-9728-a3abc63462e1 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:09.810073 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d2f61-062a-4ddc-9265-005cacebca99 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:09.810073 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a952f31-7173-49fd-9497-2f5b9685560d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:09.810073 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a952f31-7173-49fd-9497-2f5b9685560d admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:09.810073 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a952f31-7173-49fd-9497-2f5b9685560d admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:09.810606 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a952f31-7173-49fd-9497-2f5b9685560d admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:09.810606 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a952f31-7173-49fd-9497-2f5b9685560d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:09.810606 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a952f31-7173-49fd-9497-2f5b9685560d admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:09.811470 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c64c5-3955-4b77-9728-a3abc63462e1 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:09.816472 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73458a19-6177-4d66-8894-10c5bf4a47fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:09.817083 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73458a19-6177-4d66-8894-10c5bf4a47fe admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:09.817360 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73458a19-6177-4d66-8894-10c5bf4a47fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:09.817637 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73458a19-6177-4d66-8894-10c5bf4a47fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:09.818275 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73458a19-6177-4d66-8894-10c5bf4a47fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:09.819902 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1052/2121] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 07:53:09.820025 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73458a19-6177-4d66-8894-10c5bf4a47fe admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:09.824157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a952f31-7173-49fd-9497-2f5b9685560d admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:09.832524 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1070/2122] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:53:09.835461 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a952f31-7173-49fd-9497-2f5b9685560d admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:09.836525 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73458a19-6177-4d66-8894-10c5bf4a47fe admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:09.841051 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757dfc23-6008-4cc7-b842-5a32c48f5c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:09.841719 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757dfc23-6008-4cc7-b842-5a32c48f5c48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:09.842001 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757dfc23-6008-4cc7-b842-5a32c48f5c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:09.842314 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757dfc23-6008-4cc7-b842-5a32c48f5c48 admin admin] PATH_INFO: `/v3/projects/d5458d528f494835bd80d1af4044b747/users/ddf84ce169734e5ab26161d9eea9bfc2/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:09.846891 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73458a19-6177-4d66-8894-10c5bf4a47fe admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:09.851971 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861edf44-0c94-432c-9617-a05397fd689a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:09.860268 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861edf44-0c94-432c-9617-a05397fd689a admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:09.860268 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861edf44-0c94-432c-9617-a05397fd689a admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:09.860268 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861edf44-0c94-432c-9617-a05397fd689a admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:09.860268 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861edf44-0c94-432c-9617-a05397fd689a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:09.860268 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861edf44-0c94-432c-9617-a05397fd689a admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:09.860712 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757dfc23-6008-4cc7-b842-5a32c48f5c48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5458d528f494835bd80d1af4044b747, user_id=ddf84ce169734e5ab26161d9eea9bfc2, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:09.860712 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757dfc23-6008-4cc7-b842-5a32c48f5c48 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:09.866073 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1071/2123] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 07:53:09.870207 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861edf44-0c94-432c-9617-a05397fd689a admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:09.881959 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861edf44-0c94-432c-9617-a05397fd689a admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:09.886633 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962bdf2f-0de2-45c3-8c5f-78e28868efdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:09.887505 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962bdf2f-0de2-45c3-8c5f-78e28868efdf admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:09.887781 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962bdf2f-0de2-45c3-8c5f-78e28868efdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:09.888052 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962bdf2f-0de2-45c3-8c5f-78e28868efdf admin admin] PATH_INFO: `/v3/projects/c0787699706f44eb8a198533f0cc1569/users/42a79f8e69c047868600e80a6e908fe8/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:09.904679 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962bdf2f-0de2-45c3-8c5f-78e28868efdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0787699706f44eb8a198533f0cc1569, user_id=42a79f8e69c047868600e80a6e908fe8, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:09.907403 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962bdf2f-0de2-45c3-8c5f-78e28868efdf admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:10.021718 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1053/2124] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:53:09 2022] PUT /identity/v3/projects/d5458d528f494835bd80d1af4044b747/users/ddf84ce169734e5ab26161d9eea9bfc2/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:53:10.032432 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eca2c5-62ce-4ef0-b27d-ebc436be6cb2 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:10.032718 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eca2c5-62ce-4ef0-b27d-ebc436be6cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:10.032996 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eca2c5-62ce-4ef0-b27d-ebc436be6cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:10.060717 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-c0eca2c5-62ce-4ef0-b27d-ebc436be6cb2 None None] MFA Rules not processed for user `ddf84ce169734e5ab26161d9eea9bfc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:10.061906 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-c0eca2c5-62ce-4ef0-b27d-ebc436be6cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:10.128789 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1054/2125] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:53:10.130142 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1072/2126] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:53:09 2022] PUT /identity/v3/projects/c0787699706f44eb8a198533f0cc1569/users/42a79f8e69c047868600e80a6e908fe8/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:53:10.140573 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fcdef9-a489-409a-8aab-3e3392f0e4b8 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:10.140857 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fcdef9-a489-409a-8aab-3e3392f0e4b8 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:10.141145 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fcdef9-a489-409a-8aab-3e3392f0e4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:10.141278 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962bdf2f-0de2-45c3-8c5f-78e28868efdf admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:10.143067 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-962bdf2f-0de2-45c3-8c5f-78e28868efdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:10.170467 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-65fcdef9-a489-409a-8aab-3e3392f0e4b8 None None] MFA Rules not processed for user `42a79f8e69c047868600e80a6e908fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:10.171730 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-65fcdef9-a489-409a-8aab-3e3392f0e4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:10.203174 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962bdf2f-0de2-45c3-8c5f-78e28868efdf admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:10.208679 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5896270-bc1b-4475-a77d-6c946c51137c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:10.208679 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5896270-bc1b-4475-a77d-6c946c51137c service cinder] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:10.208679 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5896270-bc1b-4475-a77d-6c946c51137c service cinder] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:10.208679 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5896270-bc1b-4475-a77d-6c946c51137c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:10.273860 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1055/2127] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:53:10.283501 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5896270-bc1b-4475-a77d-6c946c51137c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:10.285096 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5896270-bc1b-4475-a77d-6c946c51137c service cinder] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:10.293907 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fcdef9-a489-409a-8aab-3e3392f0e4b8 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:10.295423 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-65fcdef9-a489-409a-8aab-3e3392f0e4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:10.296508 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1073/2128] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:53:10 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 07:53:10.310956 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fcdef9-a489-409a-8aab-3e3392f0e4b8 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:10.316481 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad78d29f-8e37-4921-acba-f18e8b8dff4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:10.316481 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78d29f-8e37-4921-acba-f18e8b8dff4d service cinder] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:10.316481 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78d29f-8e37-4921-acba-f18e8b8dff4d service cinder] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:10.316481 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78d29f-8e37-4921-acba-f18e8b8dff4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:10.318244 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5896270-bc1b-4475-a77d-6c946c51137c service cinder] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:10.338580 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad78d29f-8e37-4921-acba-f18e8b8dff4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:10.341173 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad78d29f-8e37-4921-acba-f18e8b8dff4d service cinder] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:10.360659 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1056/2129] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:53:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 07:53:10.408853 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5896270-bc1b-4475-a77d-6c946c51137c service cinder] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:10.414848 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e818838a-7c9e-4149-b056-5c4f9ba44eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:10.415896 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818838a-7c9e-4149-b056-5c4f9ba44eab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:10.416174 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818838a-7c9e-4149-b056-5c4f9ba44eab admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:10.416490 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818838a-7c9e-4149-b056-5c4f9ba44eab admin admin] PATH_INFO: `/v3/users/ddf84ce169734e5ab26161d9eea9bfc2` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:10.417931 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e818838a-7c9e-4149-b056-5c4f9ba44eab admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddf84ce169734e5ab26161d9eea9bfc2)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:10.420075 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e818838a-7c9e-4149-b056-5c4f9ba44eab admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:10.758954 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-e818838a-7c9e-4149-b056-5c4f9ba44eab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddf84ce169734e5ab26161d9eea9bfc2'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:10.774530 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-e818838a-7c9e-4149-b056-5c4f9ba44eab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddf84ce169734e5ab26161d9eea9bfc2'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:10.890205 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-e818838a-7c9e-4149-b056-5c4f9ba44eab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddf84ce169734e5ab26161d9eea9bfc2'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:10.891287 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-e818838a-7c9e-4149-b056-5c4f9ba44eab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddf84ce169734e5ab26161d9eea9bfc2'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:10.905488 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-e818838a-7c9e-4149-b056-5c4f9ba44eab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddf84ce169734e5ab26161d9eea9bfc2'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:10.912368 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1074/2130] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:53:10 2022] DELETE /identity/v3/users/ddf84ce169734e5ab26161d9eea9bfc2 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:53:10.917233 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b697f4-d9bc-4763-a0a8-0fb6bd7312a4 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:10.917565 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b697f4-d9bc-4763-a0a8-0fb6bd7312a4 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:10.917795 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b697f4-d9bc-4763-a0a8-0fb6bd7312a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:10.941355 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-52b697f4-d9bc-4763-a0a8-0fb6bd7312a4 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:10.942566 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-52b697f4-d9bc-4763-a0a8-0fb6bd7312a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:11.007258 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1057/2131] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:53:11.014536 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e818838a-7c9e-4149-b056-5c4f9ba44eab admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:11.016002 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-e818838a-7c9e-4149-b056-5c4f9ba44eab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:11.073314 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e818838a-7c9e-4149-b056-5c4f9ba44eab admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:11.077463 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3072885-7992-4946-a033-f0ce936bea4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:11.078091 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3072885-7992-4946-a033-f0ce936bea4f service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:11.078399 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3072885-7992-4946-a033-f0ce936bea4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:11.078672 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3072885-7992-4946-a033-f0ce936bea4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:11.088979 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3072885-7992-4946-a033-f0ce936bea4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:11.090779 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3072885-7992-4946-a033-f0ce936bea4f service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:11.100228 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1075/2132] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:53:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 07:53:11.651235 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b697f4-d9bc-4763-a0a8-0fb6bd7312a4 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:11.653241 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-52b697f4-d9bc-4763-a0a8-0fb6bd7312a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:11.676896 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b697f4-d9bc-4763-a0a8-0fb6bd7312a4 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:11.682260 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4345308-ed7f-4da5-a839-8005c56ec457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:11.683025 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4345308-ed7f-4da5-a839-8005c56ec457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:11.683368 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4345308-ed7f-4da5-a839-8005c56ec457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:11.683862 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4345308-ed7f-4da5-a839-8005c56ec457 admin admin] PATH_INFO: `/v3/projects/d5458d528f494835bd80d1af4044b747` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:11.685264 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4345308-ed7f-4da5-a839-8005c56ec457 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5458d528f494835bd80d1af4044b747)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:11.687253 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4345308-ed7f-4da5-a839-8005c56ec457 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:11.850578 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-e4345308-ed7f-4da5-a839-8005c56ec457 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5458d528f494835bd80d1af4044b747', 'request_id': 'req-e4345308-ed7f-4da5-a839-8005c56ec457'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:11.855964 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-e4345308-ed7f-4da5-a839-8005c56ec457 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5458d528f494835bd80d1af4044b747', 'request_id': 'req-e4345308-ed7f-4da5-a839-8005c56ec457'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:11.944904 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-e4345308-ed7f-4da5-a839-8005c56ec457 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5458d528f494835bd80d1af4044b747', 'request_id': 'req-e4345308-ed7f-4da5-a839-8005c56ec457'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:11.958682 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-e4345308-ed7f-4da5-a839-8005c56ec457 admin admin] The token cache is being invalidate because project d5458d528f494835bd80d1af4044b747 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:53:11.958956 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-e4345308-ed7f-4da5-a839-8005c56ec457 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:11.959637 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-e4345308-ed7f-4da5-a839-8005c56ec457 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:11.961142 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1058/2133] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:53:11 2022] DELETE /identity/v3/projects/d5458d528f494835bd80d1af4044b747 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:53:11.967279 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67266b-b7bb-4150-9644-6e9935d8bc34 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:11.967772 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67266b-b7bb-4150-9644-6e9935d8bc34 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:11.967881 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67266b-b7bb-4150-9644-6e9935d8bc34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:11.987062 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-ed67266b-b7bb-4150-9644-6e9935d8bc34 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:11.988268 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-ed67266b-b7bb-4150-9644-6e9935d8bc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:12.055259 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1076/2134] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:53:12.064097 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0857b7-9c7d-41bd-91ed-ce783c2f4fda None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:12.064402 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0857b7-9c7d-41bd-91ed-ce783c2f4fda None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:12.064680 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0857b7-9c7d-41bd-91ed-ce783c2f4fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:12.086759 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-4a0857b7-9c7d-41bd-91ed-ce783c2f4fda None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:12.088270 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-4a0857b7-9c7d-41bd-91ed-ce783c2f4fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:12.100208 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1059/2135] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:53:12.104478 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67266b-b7bb-4150-9644-6e9935d8bc34 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:12.114770 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67266b-b7bb-4150-9644-6e9935d8bc34 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:12.119927 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038d218-7f92-4b08-a1aa-6fb59a21a344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:12.120538 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038d218-7f92-4b08-a1aa-6fb59a21a344 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:12.120819 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038d218-7f92-4b08-a1aa-6fb59a21a344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:12.121847 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038d218-7f92-4b08-a1aa-6fb59a21a344 admin admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:12.122947 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2038d218-7f92-4b08-a1aa-6fb59a21a344 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:53:12.123066 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2038d218-7f92-4b08-a1aa-6fb59a21a344 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:12.124597 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2038d218-7f92-4b08-a1aa-6fb59a21a344 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:12.137765 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1077/2136] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:53:12.142084 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0857b7-9c7d-41bd-91ed-ce783c2f4fda None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:12.151388 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0857b7-9c7d-41bd-91ed-ce783c2f4fda None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:12.156146 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a19d5-4d76-4f0a-b04a-14de0034c1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:12.156747 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a19d5-4d76-4f0a-b04a-14de0034c1d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:12.157023 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a19d5-4d76-4f0a-b04a-14de0034c1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:12.157289 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a19d5-4d76-4f0a-b04a-14de0034c1d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:12.157920 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a19d5-4d76-4f0a-b04a-14de0034c1d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:12.159833 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a19d5-4d76-4f0a-b04a-14de0034c1d9 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:12.295449 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1060/2137] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:53:12 2022] POST /identity/v3/projects => generated 375 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:53:12.306831 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038d218-7f92-4b08-a1aa-6fb59a21a344 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:12.310479 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038d218-7f92-4b08-a1aa-6fb59a21a344 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:12.320553 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29170cc6-0037-42b5-a4c6-6e93cf0946bc None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:12.320847 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29170cc6-0037-42b5-a4c6-6e93cf0946bc None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:12.321127 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29170cc6-0037-42b5-a4c6-6e93cf0946bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:12.342751 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-29170cc6-0037-42b5-a4c6-6e93cf0946bc None None] MFA Rules not processed for user `42a79f8e69c047868600e80a6e908fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:12.344051 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-29170cc6-0037-42b5-a4c6-6e93cf0946bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:12.373555 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c2c9f-de86-40e8-b1b0-5296531ad0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:12.374304 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c2c9f-de86-40e8-b1b0-5296531ad0ae admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:12.374648 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c2c9f-de86-40e8-b1b0-5296531ad0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:12.379103 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c2c9f-de86-40e8-b1b0-5296531ad0ae admin admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:12.379103 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26c2c9f-de86-40e8-b1b0-5296531ad0ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:12.379103 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26c2c9f-de86-40e8-b1b0-5296531ad0ae admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:12.411367 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1061/2138] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:53:12.456123 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:53:12.541431 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1078/2139] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:53:12 2022] POST /identity/v3/users => generated 288 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 07:53:12.546904 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29170cc6-0037-42b5-a4c6-6e93cf0946bc None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:12.559687 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29170cc6-0037-42b5-a4c6-6e93cf0946bc None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:12.565433 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ce1bd-2a94-41fe-a016-8ae44536847c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:12.566160 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ce1bd-2a94-41fe-a016-8ae44536847c admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:12.566547 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ce1bd-2a94-41fe-a016-8ae44536847c admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:12.566919 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ce1bd-2a94-41fe-a016-8ae44536847c admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:12.567707 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ce1bd-2a94-41fe-a016-8ae44536847c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:12.569441 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ce1bd-2a94-41fe-a016-8ae44536847c admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:12.576941 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:53:12.585377 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1062/2140] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:53:12.589229 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c2c9f-de86-40e8-b1b0-5296531ad0ae admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:12.601435 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c2c9f-de86-40e8-b1b0-5296531ad0ae admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:12.608780 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246588d-69f4-47ee-bf2e-2a54cbcf6a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:12.609683 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246588d-69f4-47ee-bf2e-2a54cbcf6a8a admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:12.610446 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246588d-69f4-47ee-bf2e-2a54cbcf6a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:12.610870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246588d-69f4-47ee-bf2e-2a54cbcf6a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:12.611769 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246588d-69f4-47ee-bf2e-2a54cbcf6a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:12.614559 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246588d-69f4-47ee-bf2e-2a54cbcf6a8a admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:12.631170 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1079/2141] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:53:12.632456 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ce1bd-2a94-41fe-a016-8ae44536847c admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:12.642929 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ce1bd-2a94-41fe-a016-8ae44536847c admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:12.649415 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba55b7-5553-46a8-b6c0-06ac7f4f8b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:12.650707 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba55b7-5553-46a8-b6c0-06ac7f4f8b97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:12.658035 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba55b7-5553-46a8-b6c0-06ac7f4f8b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:12.658035 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba55b7-5553-46a8-b6c0-06ac7f4f8b97 admin admin] PATH_INFO: `/v3/projects/231de962a18f49968c3738c20c596a52/users/88141d1191d24a8abf4acde108f591e4/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:12.667246 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba55b7-5553-46a8-b6c0-06ac7f4f8b97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=231de962a18f49968c3738c20c596a52, user_id=88141d1191d24a8abf4acde108f591e4, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:12.671120 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba55b7-5553-46a8-b6c0-06ac7f4f8b97 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:12.874279 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1063/2142] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:53:12 2022] PUT /identity/v3/projects/231de962a18f49968c3738c20c596a52/users/88141d1191d24a8abf4acde108f591e4/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:53:12.884527 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6ac52-466f-46a8-9520-029f8e292985 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:12.884809 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6ac52-466f-46a8-9520-029f8e292985 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:12.885103 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6ac52-466f-46a8-9520-029f8e292985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:12.914210 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-74f6ac52-466f-46a8-9520-029f8e292985 None None] MFA Rules not processed for user `88141d1191d24a8abf4acde108f591e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:12.915520 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-74f6ac52-466f-46a8-9520-029f8e292985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:12.985614 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1080/2143] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:53:13.025300 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba55b7-5553-46a8-b6c0-06ac7f4f8b97 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:13.027667 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-19ba55b7-5553-46a8-b6c0-06ac7f4f8b97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:13.094795 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba55b7-5553-46a8-b6c0-06ac7f4f8b97 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:13.107808 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5717ef3-6c50-4ca7-b485-a02427e19923 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:13.107808 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5717ef3-6c50-4ca7-b485-a02427e19923 service cinder] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:13.107808 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5717ef3-6c50-4ca7-b485-a02427e19923 service cinder] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:13.107808 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5717ef3-6c50-4ca7-b485-a02427e19923 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:13.122076 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5717ef3-6c50-4ca7-b485-a02427e19923 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:13.123671 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5717ef3-6c50-4ca7-b485-a02427e19923 service cinder] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:13.149812 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1064/2144] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:53:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:53:14.480575 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f6ac52-466f-46a8-9520-029f8e292985 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:14.498428 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f6ac52-466f-46a8-9520-029f8e292985 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:14.498428 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ea102-1240-49da-a08e-43d901b9ce89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:14.498428 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ea102-1240-49da-a08e-43d901b9ce89 service cinder] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:14.498428 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ea102-1240-49da-a08e-43d901b9ce89 service cinder] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:14.498799 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ea102-1240-49da-a08e-43d901b9ce89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:14.498891 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-bf2ea102-1240-49da-a08e-43d901b9ce89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:14.542370 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:53:14.575920 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ea102-1240-49da-a08e-43d901b9ce89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:14.577505 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ea102-1240-49da-a08e-43d901b9ce89 service cinder] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:14.587789 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1081/2145] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:53:14 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:53:14.728937 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:53:17.027664 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:53:18.025598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5717ef3-6c50-4ca7-b485-a02427e19923 service cinder] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:18.028056 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-c5717ef3-6c50-4ca7-b485-a02427e19923 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:18.103956 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5717ef3-6c50-4ca7-b485-a02427e19923 service cinder] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:18.109368 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a223a3f-9802-4624-926a-ac6d7568d44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:18.110097 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a223a3f-9802-4624-926a-ac6d7568d44f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:18.110373 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a223a3f-9802-4624-926a-ac6d7568d44f admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:18.110824 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a223a3f-9802-4624-926a-ac6d7568d44f admin admin] PATH_INFO: `/v3/users/9b91e6d68e3e40388fe50436ddb22847` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:18.112579 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a223a3f-9802-4624-926a-ac6d7568d44f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b91e6d68e3e40388fe50436ddb22847)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:18.114630 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a223a3f-9802-4624-926a-ac6d7568d44f admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:18.341968 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:53:18.434443 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-6a223a3f-9802-4624-926a-ac6d7568d44f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b91e6d68e3e40388fe50436ddb22847'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:18.435127 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-6a223a3f-9802-4624-926a-ac6d7568d44f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b91e6d68e3e40388fe50436ddb22847'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:18.558146 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-6a223a3f-9802-4624-926a-ac6d7568d44f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b91e6d68e3e40388fe50436ddb22847'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:18.559269 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-6a223a3f-9802-4624-926a-ac6d7568d44f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b91e6d68e3e40388fe50436ddb22847'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:18.567218 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-6a223a3f-9802-4624-926a-ac6d7568d44f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b91e6d68e3e40388fe50436ddb22847'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:18.585291 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1065/2146] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:53:18 2022] DELETE /identity/v3/users/9b91e6d68e3e40388fe50436ddb22847 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:53:18.854536 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ea102-1240-49da-a08e-43d901b9ce89 service cinder] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:18.877181 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ea102-1240-49da-a08e-43d901b9ce89 service cinder] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:18.980305 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea6404-e496-4fd5-a7f7-111072b044e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:18.981053 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea6404-e496-4fd5-a7f7-111072b044e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:18.981471 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea6404-e496-4fd5-a7f7-111072b044e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:18.981772 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea6404-e496-4fd5-a7f7-111072b044e8 admin admin] PATH_INFO: `/v3/projects/fb39143bfa9845ee9dce4ca51c82e751` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:18.982932 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea6404-e496-4fd5-a7f7-111072b044e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb39143bfa9845ee9dce4ca51c82e751)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:18.985012 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea6404-e496-4fd5-a7f7-111072b044e8 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:19.129837 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-efea6404-e496-4fd5-a7f7-111072b044e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb39143bfa9845ee9dce4ca51c82e751', 'request_id': 'req-efea6404-e496-4fd5-a7f7-111072b044e8'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:19.136189 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-efea6404-e496-4fd5-a7f7-111072b044e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb39143bfa9845ee9dce4ca51c82e751', 'request_id': 'req-efea6404-e496-4fd5-a7f7-111072b044e8'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:19.143488 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-efea6404-e496-4fd5-a7f7-111072b044e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb39143bfa9845ee9dce4ca51c82e751', 'request_id': 'req-efea6404-e496-4fd5-a7f7-111072b044e8'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:19.280354 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-efea6404-e496-4fd5-a7f7-111072b044e8 admin admin] The token cache is being invalidate because project fb39143bfa9845ee9dce4ca51c82e751 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:53:19.280570 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-efea6404-e496-4fd5-a7f7-111072b044e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:19.282296 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-efea6404-e496-4fd5-a7f7-111072b044e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:19.284567 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1082/2147] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:53:18 2022] DELETE /identity/v3/projects/fb39143bfa9845ee9dce4ca51c82e751 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:53:19.290300 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272f246-14e9-4cfa-bfca-3456eaf41e7f None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:19.294272 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272f246-14e9-4cfa-bfca-3456eaf41e7f None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:19.294746 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272f246-14e9-4cfa-bfca-3456eaf41e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:19.334759 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-d272f246-14e9-4cfa-bfca-3456eaf41e7f None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:19.336070 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-d272f246-14e9-4cfa-bfca-3456eaf41e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:19.416980 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1066/2148] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:53:19.424662 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919b4c7-c896-4b6e-9bfc-7a24bec7307f None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:19.425323 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919b4c7-c896-4b6e-9bfc-7a24bec7307f None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:19.425323 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919b4c7-c896-4b6e-9bfc-7a24bec7307f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:19.447091 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-3919b4c7-c896-4b6e-9bfc-7a24bec7307f None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:19.448377 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-3919b4c7-c896-4b6e-9bfc-7a24bec7307f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:19.457039 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1083/2149] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:53:19.461742 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272f246-14e9-4cfa-bfca-3456eaf41e7f None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:19.472711 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272f246-14e9-4cfa-bfca-3456eaf41e7f None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:19.477418 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e053abb-bfd8-43b8-89fe-af107058372d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:19.478028 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e053abb-bfd8-43b8-89fe-af107058372d admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:19.478426 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e053abb-bfd8-43b8-89fe-af107058372d admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:19.478567 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e053abb-bfd8-43b8-89fe-af107058372d admin admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:19.479897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e053abb-bfd8-43b8-89fe-af107058372d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:53:19.479897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e053abb-bfd8-43b8-89fe-af107058372d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:19.481995 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e053abb-bfd8-43b8-89fe-af107058372d admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:19.494469 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1067/2150] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:53:19.498973 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919b4c7-c896-4b6e-9bfc-7a24bec7307f None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:19.508648 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919b4c7-c896-4b6e-9bfc-7a24bec7307f None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:19.513400 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee5cb7-00b1-4a48-b2a0-eb413db12f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:19.514171 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee5cb7-00b1-4a48-b2a0-eb413db12f74 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:19.514340 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee5cb7-00b1-4a48-b2a0-eb413db12f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:19.514617 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee5cb7-00b1-4a48-b2a0-eb413db12f74 admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:19.515281 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ee5cb7-00b1-4a48-b2a0-eb413db12f74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:19.517187 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ee5cb7-00b1-4a48-b2a0-eb413db12f74 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:19.603320 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1084/2151] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:53:19 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:53:19.604814 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e053abb-bfd8-43b8-89fe-af107058372d admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:19.618759 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e053abb-bfd8-43b8-89fe-af107058372d admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:19.676987 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa9f8a-d3b4-44ea-b55d-18039992a5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:19.677515 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa9f8a-d3b4-44ea-b55d-18039992a5b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:19.677793 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa9f8a-d3b4-44ea-b55d-18039992a5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:19.678064 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa9f8a-d3b4-44ea-b55d-18039992a5b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:19.678697 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa9f8a-d3b4-44ea-b55d-18039992a5b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:19.680930 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa9f8a-d3b4-44ea-b55d-18039992a5b3 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:19.808540 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1068/2152] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:53:19 2022] POST /identity/v3/users => generated 292 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:53:19.813181 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee5cb7-00b1-4a48-b2a0-eb413db12f74 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:19.823409 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee5cb7-00b1-4a48-b2a0-eb413db12f74 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:19.829067 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23daef1-3f70-4103-90a5-0b28e24225fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:19.829687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23daef1-3f70-4103-90a5-0b28e24225fc admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:19.829967 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23daef1-3f70-4103-90a5-0b28e24225fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:19.832681 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23daef1-3f70-4103-90a5-0b28e24225fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:19.832681 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23daef1-3f70-4103-90a5-0b28e24225fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:19.832907 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23daef1-3f70-4103-90a5-0b28e24225fc admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:19.846422 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1085/2153] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:53:19.848915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa9f8a-d3b4-44ea-b55d-18039992a5b3 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:19.859978 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa9f8a-d3b4-44ea-b55d-18039992a5b3 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:19.866208 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e37bbd-0d02-407d-b600-045bfeda5b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:19.866828 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e37bbd-0d02-407d-b600-045bfeda5b75 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:19.867158 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e37bbd-0d02-407d-b600-045bfeda5b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:19.867437 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e37bbd-0d02-407d-b600-045bfeda5b75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:19.868094 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e37bbd-0d02-407d-b600-045bfeda5b75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:19.869713 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e37bbd-0d02-407d-b600-045bfeda5b75 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:19.881358 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1069/2154] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 07:53:19.885694 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23daef1-3f70-4103-90a5-0b28e24225fc admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:19.897534 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23daef1-3f70-4103-90a5-0b28e24225fc admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:19.902490 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8813b-b0e3-4731-9198-8b4a19fbd272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:19.903192 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8813b-b0e3-4731-9198-8b4a19fbd272 admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:19.903474 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8813b-b0e3-4731-9198-8b4a19fbd272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:19.903756 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8813b-b0e3-4731-9198-8b4a19fbd272 admin admin] PATH_INFO: `/v3/projects/6cae0dfd8d2045f186a515e71a316f14/users/0e024988791d4079888cc50db9c0b240/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:19.920005 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f8813b-b0e3-4731-9198-8b4a19fbd272 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cae0dfd8d2045f186a515e71a316f14, user_id=0e024988791d4079888cc50db9c0b240, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:19.922973 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f8813b-b0e3-4731-9198-8b4a19fbd272 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:20.034448 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1086/2155] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:53:19 2022] PUT /identity/v3/projects/6cae0dfd8d2045f186a515e71a316f14/users/0e024988791d4079888cc50db9c0b240/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:53:20.034615 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fdc3f-8c08-40e4-85fc-6a16dbd07f19 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:20.034615 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fdc3f-8c08-40e4-85fc-6a16dbd07f19 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:20.034615 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fdc3f-8c08-40e4-85fc-6a16dbd07f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:20.059829 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-4b3fdc3f-8c08-40e4-85fc-6a16dbd07f19 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:20.061078 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-4b3fdc3f-8c08-40e4-85fc-6a16dbd07f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:20.128366 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1070/2156] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:53:20.138101 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8813b-b0e3-4731-9198-8b4a19fbd272 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:20.139877 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-53f8813b-b0e3-4731-9198-8b4a19fbd272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:20.209951 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8813b-b0e3-4731-9198-8b4a19fbd272 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:20.215085 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf465b-522c-4ae0-a616-c8d36fa82c57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:20.215861 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf465b-522c-4ae0-a616-c8d36fa82c57 service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:20.216144 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf465b-522c-4ae0-a616-c8d36fa82c57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:20.216417 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf465b-522c-4ae0-a616-c8d36fa82c57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:20.226228 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf465b-522c-4ae0-a616-c8d36fa82c57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:20.227814 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf465b-522c-4ae0-a616-c8d36fa82c57 service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:20.238353 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1087/2157] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:53:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:53:20.324710 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:53:20.484868 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:53:22.534665 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:53:22.627297 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:53:23.388864 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:53:23.414430 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:53:24.746488 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:53:25.639340 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:53:26.935185 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e0bda-7d6b-4755-a651-d7d67c154c76 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:26.936123 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e0bda-7d6b-4755-a651-d7d67c154c76 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:26.936401 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e0bda-7d6b-4755-a651-d7d67c154c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:26.976895 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-c86e0bda-7d6b-4755-a651-d7d67c154c76 None None] MFA Rules not processed for user `0e024988791d4079888cc50db9c0b240`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:26.978286 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-c86e0bda-7d6b-4755-a651-d7d67c154c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:27.102664 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1071/2158] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:53:27.119046 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf465b-522c-4ae0-a616-c8d36fa82c57 service neutron] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:27.119827 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-dfdf465b-522c-4ae0-a616-c8d36fa82c57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:27.202399 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf465b-522c-4ae0-a616-c8d36fa82c57 service neutron] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:27.208271 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a07bc-5c36-49ef-93b9-a3a22d3bcdf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc92c0a0a2cc4722868e6877bac93ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:27.208891 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a07bc-5c36-49ef-93b9-a3a22d3bcdf4 service nova] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:27.209174 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a07bc-5c36-49ef-93b9-a3a22d3bcdf4 service nova] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:27.209452 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a07bc-5c36-49ef-93b9-a3a22d3bcdf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:27.219994 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a07bc-5c36-49ef-93b9-a3a22d3bcdf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:27.221533 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a07bc-5c36-49ef-93b9-a3a22d3bcdf4 service nova] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:27.233026 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1088/2159] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:53:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:53:28.123732 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:53:28.433266 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:53:30.528190 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e0bda-7d6b-4755-a651-d7d67c154c76 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:30.529749 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-c86e0bda-7d6b-4755-a651-d7d67c154c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:30.554726 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e0bda-7d6b-4755-a651-d7d67c154c76 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:30.564154 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b162fa6e-92b3-4104-a897-7f8bf364e0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:30.565276 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162fa6e-92b3-4104-a897-7f8bf364e0d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:30.565757 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162fa6e-92b3-4104-a897-7f8bf364e0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:30.566206 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162fa6e-92b3-4104-a897-7f8bf364e0d1 admin admin] PATH_INFO: `/v3/users/867719a3fa964c9081d8248040f6f180` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:30.567732 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b162fa6e-92b3-4104-a897-7f8bf364e0d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=867719a3fa964c9081d8248040f6f180)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:30.569870 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b162fa6e-92b3-4104-a897-7f8bf364e0d1 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:30.840927 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-b162fa6e-92b3-4104-a897-7f8bf364e0d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '867719a3fa964c9081d8248040f6f180'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:30.841867 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-b162fa6e-92b3-4104-a897-7f8bf364e0d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '867719a3fa964c9081d8248040f6f180'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:30.957037 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-b162fa6e-92b3-4104-a897-7f8bf364e0d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '867719a3fa964c9081d8248040f6f180'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:30.957037 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-b162fa6e-92b3-4104-a897-7f8bf364e0d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '867719a3fa964c9081d8248040f6f180'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:30.964197 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-b162fa6e-92b3-4104-a897-7f8bf364e0d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '867719a3fa964c9081d8248040f6f180'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:30.991555 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1072/2160] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:53:30 2022] DELETE /identity/v3/users/867719a3fa964c9081d8248040f6f180 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:53:30.998209 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee64a06-058d-457f-bfdb-1f48f9abe763 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:30.998694 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee64a06-058d-457f-bfdb-1f48f9abe763 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:30.998801 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee64a06-058d-457f-bfdb-1f48f9abe763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:31.022440 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-dee64a06-058d-457f-bfdb-1f48f9abe763 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:31.026072 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-dee64a06-058d-457f-bfdb-1f48f9abe763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:31.088530 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1089/2161] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:53:31.099720 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b162fa6e-92b3-4104-a897-7f8bf364e0d1 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:31.101194 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-b162fa6e-92b3-4104-a897-7f8bf364e0d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:31.169167 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b162fa6e-92b3-4104-a897-7f8bf364e0d1 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:31.173172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7293238f-39e1-4265-81b7-73774b024702 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:31.173779 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293238f-39e1-4265-81b7-73774b024702 service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:31.174057 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293238f-39e1-4265-81b7-73774b024702 service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:31.174329 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293238f-39e1-4265-81b7-73774b024702 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:31.184156 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7293238f-39e1-4265-81b7-73774b024702 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:31.185674 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7293238f-39e1-4265-81b7-73774b024702 service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:31.195679 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1073/2162] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:53:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:53:31.284107 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3752ba7-c3de-4c3c-8288-be2e8822d6a4 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:31.284390 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3752ba7-c3de-4c3c-8288-be2e8822d6a4 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:31.284665 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3752ba7-c3de-4c3c-8288-be2e8822d6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:31.304125 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-d3752ba7-c3de-4c3c-8288-be2e8822d6a4 None None] MFA Rules not processed for user `0e024988791d4079888cc50db9c0b240`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:31.305534 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-d3752ba7-c3de-4c3c-8288-be2e8822d6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:31.367451 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1090/2163] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:53:31.733749 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:53:31.907964 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7293238f-39e1-4265-81b7-73774b024702 service neutron] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:31.910241 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-7293238f-39e1-4265-81b7-73774b024702 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:31.936970 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7293238f-39e1-4265-81b7-73774b024702 service neutron] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:31.946524 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fee093-e77d-4515-a815-e42852134eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:31.946524 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fee093-e77d-4515-a815-e42852134eed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:31.946524 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fee093-e77d-4515-a815-e42852134eed admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:31.946524 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fee093-e77d-4515-a815-e42852134eed admin admin] PATH_INFO: `/v3/projects/86e3187815414b2bbd61f52b03bcf836` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:31.948136 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fee093-e77d-4515-a815-e42852134eed admin admin] RBAC: Authorizing `identity:delete_project(project_id=86e3187815414b2bbd61f52b03bcf836)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:31.951980 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fee093-e77d-4515-a815-e42852134eed admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:32.196459 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-f8fee093-e77d-4515-a815-e42852134eed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86e3187815414b2bbd61f52b03bcf836', 'request_id': 'req-f8fee093-e77d-4515-a815-e42852134eed'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:32.204422 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-f8fee093-e77d-4515-a815-e42852134eed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86e3187815414b2bbd61f52b03bcf836', 'request_id': 'req-f8fee093-e77d-4515-a815-e42852134eed'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:32.293172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-f8fee093-e77d-4515-a815-e42852134eed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86e3187815414b2bbd61f52b03bcf836', 'request_id': 'req-f8fee093-e77d-4515-a815-e42852134eed'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:32.311361 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-f8fee093-e77d-4515-a815-e42852134eed admin admin] The token cache is being invalidate because project 86e3187815414b2bbd61f52b03bcf836 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:53:32.311661 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-f8fee093-e77d-4515-a815-e42852134eed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:32.312485 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-f8fee093-e77d-4515-a815-e42852134eed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:32.317601 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1074/2164] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:53:31 2022] DELETE /identity/v3/projects/86e3187815414b2bbd61f52b03bcf836 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:53:32.321796 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3752ba7-c3de-4c3c-8288-be2e8822d6a4 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:32.335118 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3752ba7-c3de-4c3c-8288-be2e8822d6a4 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:32.416504 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6bc726-39f8-48f5-a7d1-7a157cd775d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:32.418168 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bc726-39f8-48f5-a7d1-7a157cd775d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:32.418473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bc726-39f8-48f5-a7d1-7a157cd775d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:32.418725 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bc726-39f8-48f5-a7d1-7a157cd775d1 admin admin] PATH_INFO: `/v3/users/18dadb56514d4f99804a1d94c72dd206` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:32.420703 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6bc726-39f8-48f5-a7d1-7a157cd775d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18dadb56514d4f99804a1d94c72dd206)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:32.422691 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6bc726-39f8-48f5-a7d1-7a157cd775d1 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:32.715060 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-4e6bc726-39f8-48f5-a7d1-7a157cd775d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18dadb56514d4f99804a1d94c72dd206'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:32.722666 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-4e6bc726-39f8-48f5-a7d1-7a157cd775d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18dadb56514d4f99804a1d94c72dd206'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:32.832350 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-4e6bc726-39f8-48f5-a7d1-7a157cd775d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18dadb56514d4f99804a1d94c72dd206'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:32.832968 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-4e6bc726-39f8-48f5-a7d1-7a157cd775d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18dadb56514d4f99804a1d94c72dd206'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:32.846208 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-4e6bc726-39f8-48f5-a7d1-7a157cd775d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18dadb56514d4f99804a1d94c72dd206'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:32.852914 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1091/2165] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:53:32 2022] DELETE /identity/v3/users/18dadb56514d4f99804a1d94c72dd206 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:53:33.438111 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:53:33.459077 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fee093-e77d-4515-a815-e42852134eed admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:33.460524 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-f8fee093-e77d-4515-a815-e42852134eed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:33.474029 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fee093-e77d-4515-a815-e42852134eed admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:33.532215 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67086c0-dfde-48cf-abdf-ac4b99556c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:33.532871 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67086c0-dfde-48cf-abdf-ac4b99556c49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:33.533151 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67086c0-dfde-48cf-abdf-ac4b99556c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:33.533470 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67086c0-dfde-48cf-abdf-ac4b99556c49 admin admin] PATH_INFO: `/v3/users/929b25c26d9b4ad197def51a67d5261f` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:33.534633 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67086c0-dfde-48cf-abdf-ac4b99556c49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=929b25c26d9b4ad197def51a67d5261f)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:33.536585 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67086c0-dfde-48cf-abdf-ac4b99556c49 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:33.577827 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6bc726-39f8-48f5-a7d1-7a157cd775d1 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:33.579461 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-4e6bc726-39f8-48f5-a7d1-7a157cd775d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:33.595036 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6bc726-39f8-48f5-a7d1-7a157cd775d1 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:33.600786 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf9dbc5-f5d8-444f-852b-f9e1a3b43edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:33.601503 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9dbc5-f5d8-444f-852b-f9e1a3b43edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:33.601924 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9dbc5-f5d8-444f-852b-f9e1a3b43edc admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:33.602200 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9dbc5-f5d8-444f-852b-f9e1a3b43edc admin admin] PATH_INFO: `/v3/projects/12a22647302c47f0ae846c3346ac5339` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:33.603895 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf9dbc5-f5d8-444f-852b-f9e1a3b43edc admin admin] RBAC: Authorizing `identity:delete_project(project_id=12a22647302c47f0ae846c3346ac5339)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:33.605737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf9dbc5-f5d8-444f-852b-f9e1a3b43edc admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:33.888268 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-cdf9dbc5-f5d8-444f-852b-f9e1a3b43edc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12a22647302c47f0ae846c3346ac5339', 'request_id': 'req-cdf9dbc5-f5d8-444f-852b-f9e1a3b43edc'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:33.888959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-b67086c0-dfde-48cf-abdf-ac4b99556c49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '929b25c26d9b4ad197def51a67d5261f'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:33.889948 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-b67086c0-dfde-48cf-abdf-ac4b99556c49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '929b25c26d9b4ad197def51a67d5261f'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:33.895796 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-cdf9dbc5-f5d8-444f-852b-f9e1a3b43edc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12a22647302c47f0ae846c3346ac5339', 'request_id': 'req-cdf9dbc5-f5d8-444f-852b-f9e1a3b43edc'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:33.902122 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-cdf9dbc5-f5d8-444f-852b-f9e1a3b43edc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12a22647302c47f0ae846c3346ac5339', 'request_id': 'req-cdf9dbc5-f5d8-444f-852b-f9e1a3b43edc'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:34.113270 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-b67086c0-dfde-48cf-abdf-ac4b99556c49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '929b25c26d9b4ad197def51a67d5261f'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:34.114443 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-b67086c0-dfde-48cf-abdf-ac4b99556c49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '929b25c26d9b4ad197def51a67d5261f'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:34.129844 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-b67086c0-dfde-48cf-abdf-ac4b99556c49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '929b25c26d9b4ad197def51a67d5261f'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:34.154389 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1075/2166] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:53:33 2022] DELETE /identity/v3/users/929b25c26d9b4ad197def51a67d5261f => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:53:34.160259 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f233465-2724-40a0-8a0b-850bd99cecdd None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:34.160351 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f233465-2724-40a0-8a0b-850bd99cecdd None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:34.160664 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f233465-2724-40a0-8a0b-850bd99cecdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:34.186427 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-7f233465-2724-40a0-8a0b-850bd99cecdd None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:34.188031 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-7f233465-2724-40a0-8a0b-850bd99cecdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:34.245878 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-cdf9dbc5-f5d8-444f-852b-f9e1a3b43edc admin admin] The token cache is being invalidate because project 12a22647302c47f0ae846c3346ac5339 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:53:34.246261 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-cdf9dbc5-f5d8-444f-852b-f9e1a3b43edc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:34.247220 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-cdf9dbc5-f5d8-444f-852b-f9e1a3b43edc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:34.249056 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1092/2167] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:53:33 2022] DELETE /identity/v3/projects/12a22647302c47f0ae846c3346ac5339 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:53:34.255715 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db66ea-9550-43a0-8909-fdc62d9d0f4d None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:34.256218 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db66ea-9550-43a0-8909-fdc62d9d0f4d None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:34.258290 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db66ea-9550-43a0-8909-fdc62d9d0f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:34.284348 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1076/2168] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:53:34.294514 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-c0db66ea-9550-43a0-8909-fdc62d9d0f4d None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:34.295650 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-c0db66ea-9550-43a0-8909-fdc62d9d0f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:34.304628 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1093/2169] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:53:34.313220 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e5daf-462a-41d6-a465-bfcd3389b040 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:34.313675 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e5daf-462a-41d6-a465-bfcd3389b040 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:34.314094 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e5daf-462a-41d6-a465-bfcd3389b040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:34.324130 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db66ea-9550-43a0-8909-fdc62d9d0f4d None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:34.327171 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-c0db66ea-9550-43a0-8909-fdc62d9d0f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:34.352116 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-784e5daf-462a-41d6-a465-bfcd3389b040 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:34.353621 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-784e5daf-462a-41d6-a465-bfcd3389b040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:34.364469 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1077/2170] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:53:34.367966 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e5daf-462a-41d6-a465-bfcd3389b040 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:34.380726 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e5daf-462a-41d6-a465-bfcd3389b040 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:34.388964 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa735f-663d-4b43-8876-9516173b3e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:34.390075 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa735f-663d-4b43-8876-9516173b3e25 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:34.390556 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa735f-663d-4b43-8876-9516173b3e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:34.390815 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db66ea-9550-43a0-8909-fdc62d9d0f4d None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:34.390926 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa735f-663d-4b43-8876-9516173b3e25 admin admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:34.391687 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa735f-663d-4b43-8876-9516173b3e25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:53:34.392010 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa735f-663d-4b43-8876-9516173b3e25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:34.393715 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa735f-663d-4b43-8876-9516173b3e25 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:34.394780 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f0c15-9d06-4f16-ae22-7ebb43c281cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:34.395567 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f0c15-9d06-4f16-ae22-7ebb43c281cf service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:34.395856 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f0c15-9d06-4f16-ae22-7ebb43c281cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:34.396125 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f0c15-9d06-4f16-ae22-7ebb43c281cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:34.408529 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1078/2171] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:53:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:53:34.411972 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa735f-663d-4b43-8876-9516173b3e25 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:34.419696 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5f0c15-9d06-4f16-ae22-7ebb43c281cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:34.421231 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5f0c15-9d06-4f16-ae22-7ebb43c281cf service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:34.423719 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa735f-663d-4b43-8876-9516173b3e25 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:34.427609 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec92d8b-21e3-4c82-a58b-08b6a13e7a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:34.428213 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec92d8b-21e3-4c82-a58b-08b6a13e7a20 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:34.428488 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec92d8b-21e3-4c82-a58b-08b6a13e7a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:34.431753 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec92d8b-21e3-4c82-a58b-08b6a13e7a20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:34.431753 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec92d8b-21e3-4c82-a58b-08b6a13e7a20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:34.431753 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec92d8b-21e3-4c82-a58b-08b6a13e7a20 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:34.433711 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1094/2172] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:53:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:53:34.580673 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1079/2173] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:53:34 2022] POST /identity/v3/projects => generated 383 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 07:53:34.584681 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f0c15-9d06-4f16-ae22-7ebb43c281cf service neutron] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:34.598583 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f0c15-9d06-4f16-ae22-7ebb43c281cf service neutron] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:34.664324 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a89744-5c8f-47a6-923d-9d2f04237c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:34.664940 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a89744-5c8f-47a6-923d-9d2f04237c7f admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:34.665220 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a89744-5c8f-47a6-923d-9d2f04237c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:34.665492 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a89744-5c8f-47a6-923d-9d2f04237c7f admin admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:34.666113 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a89744-5c8f-47a6-923d-9d2f04237c7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:34.668463 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a89744-5c8f-47a6-923d-9d2f04237c7f admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:34.891512 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1095/2174] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:53:34 2022] POST /identity/v3/users => generated 292 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:53:34.894170 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec92d8b-21e3-4c82-a58b-08b6a13e7a20 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:34.930548 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec92d8b-21e3-4c82-a58b-08b6a13e7a20 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:34.948838 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c29d12-7c93-4b08-acd4-59170c474eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:34.949997 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c29d12-7c93-4b08-acd4-59170c474eda admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:34.955410 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c29d12-7c93-4b08-acd4-59170c474eda admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:34.955930 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c29d12-7c93-4b08-acd4-59170c474eda admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:34.957562 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c29d12-7c93-4b08-acd4-59170c474eda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:34.959860 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c29d12-7c93-4b08-acd4-59170c474eda admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:35.004719 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a89744-5c8f-47a6-923d-9d2f04237c7f admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:35.005780 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1080/2175] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:53:35.018717 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a89744-5c8f-47a6-923d-9d2f04237c7f admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:35.028242 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cafa08a-5c6a-4a73-bcf8-72f54ce0c71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:35.028242 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafa08a-5c6a-4a73-bcf8-72f54ce0c71a admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:35.028242 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafa08a-5c6a-4a73-bcf8-72f54ce0c71a admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:35.028699 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafa08a-5c6a-4a73-bcf8-72f54ce0c71a admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:35.029537 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cafa08a-5c6a-4a73-bcf8-72f54ce0c71a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:35.031947 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cafa08a-5c6a-4a73-bcf8-72f54ce0c71a admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:35.032534 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c29d12-7c93-4b08-acd4-59170c474eda admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:35.035252 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-d0c29d12-7c93-4b08-acd4-59170c474eda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:35.047903 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1096/2176] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:53:35.051364 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cafa08a-5c6a-4a73-bcf8-72f54ce0c71a admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:35.084067 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c29d12-7c93-4b08-acd4-59170c474eda admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:35.093275 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cafa08a-5c6a-4a73-bcf8-72f54ce0c71a admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:35.096421 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c8809-6ac0-4800-a668-fc570d6f8c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:35.097086 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c8809-6ac0-4800-a668-fc570d6f8c09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:35.097369 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c8809-6ac0-4800-a668-fc570d6f8c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:35.097649 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c8809-6ac0-4800-a668-fc570d6f8c09 admin admin] PATH_INFO: `/v3/projects/6235a7cf7c8a4384a73e4093bfbc5552` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:35.101715 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c8809-6ac0-4800-a668-fc570d6f8c09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6235a7cf7c8a4384a73e4093bfbc5552)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:35.103889 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c8809-6ac0-4800-a668-fc570d6f8c09 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:35.111803 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d193e-1549-48a8-8f21-3b574cae7c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:35.113127 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d193e-1549-48a8-8f21-3b574cae7c9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:35.113748 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d193e-1549-48a8-8f21-3b574cae7c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:35.114358 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d193e-1549-48a8-8f21-3b574cae7c9a admin admin] PATH_INFO: `/v3/projects/c6d9c0a041a84581922a42155f2f9137/users/97939db97395428f9bf2edc054e8ee4e/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:35.154447 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d193e-1549-48a8-8f21-3b574cae7c9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6d9c0a041a84581922a42155f2f9137, user_id=97939db97395428f9bf2edc054e8ee4e, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:35.157580 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d193e-1549-48a8-8f21-3b574cae7c9a admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:35.314642 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-374c8809-6ac0-4800-a668-fc570d6f8c09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6235a7cf7c8a4384a73e4093bfbc5552', 'request_id': 'req-374c8809-6ac0-4800-a668-fc570d6f8c09'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:35.320834 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1097/2177] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:53:35 2022] PUT /identity/v3/projects/c6d9c0a041a84581922a42155f2f9137/users/97939db97395428f9bf2edc054e8ee4e/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:53:35.322133 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-374c8809-6ac0-4800-a668-fc570d6f8c09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6235a7cf7c8a4384a73e4093bfbc5552', 'request_id': 'req-374c8809-6ac0-4800-a668-fc570d6f8c09'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:35.336343 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78638dc6-2071-4283-879b-85fd83ee670a None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:35.336684 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78638dc6-2071-4283-879b-85fd83ee670a None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:35.336963 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78638dc6-2071-4283-879b-85fd83ee670a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:35.376405 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-78638dc6-2071-4283-879b-85fd83ee670a None None] MFA Rules not processed for user `97939db97395428f9bf2edc054e8ee4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:35.378113 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-78638dc6-2071-4283-879b-85fd83ee670a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:35.433339 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-374c8809-6ac0-4800-a668-fc570d6f8c09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6235a7cf7c8a4384a73e4093bfbc5552', 'request_id': 'req-374c8809-6ac0-4800-a668-fc570d6f8c09'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:35.455994 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-374c8809-6ac0-4800-a668-fc570d6f8c09 admin admin] The token cache is being invalidate because project 6235a7cf7c8a4384a73e4093bfbc5552 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:53:35.456297 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-374c8809-6ac0-4800-a668-fc570d6f8c09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:35.461071 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-374c8809-6ac0-4800-a668-fc570d6f8c09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:35.465952 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1081/2178] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:53:35 2022] DELETE /identity/v3/projects/6235a7cf7c8a4384a73e4093bfbc5552 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:53:35.468006 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c8809-6ac0-4800-a668-fc570d6f8c09 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:35.469405 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-374c8809-6ac0-4800-a668-fc570d6f8c09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:35.494295 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1098/2179] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:53:35.519981 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78638dc6-2071-4283-879b-85fd83ee670a None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:35.522536 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-78638dc6-2071-4283-879b-85fd83ee670a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:35.561035 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c8809-6ac0-4800-a668-fc570d6f8c09 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:35.575406 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d42bd-0b7f-4017-9f3c-e25f2de17a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:35.576634 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d42bd-0b7f-4017-9f3c-e25f2de17a09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:35.576929 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d42bd-0b7f-4017-9f3c-e25f2de17a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:35.577217 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d42bd-0b7f-4017-9f3c-e25f2de17a09 admin admin] PATH_INFO: `/v3/users/bb952b5f6e91402d9b3cea0283b53fbb` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:35.578587 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d42bd-0b7f-4017-9f3c-e25f2de17a09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb952b5f6e91402d9b3cea0283b53fbb)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:35.581783 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d42bd-0b7f-4017-9f3c-e25f2de17a09 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:35.621009 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78638dc6-2071-4283-879b-85fd83ee670a None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:35.629039 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589ff7f-c68e-489f-8703-943e00fde636 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:35.630151 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589ff7f-c68e-489f-8703-943e00fde636 service cinder] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:35.630398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589ff7f-c68e-489f-8703-943e00fde636 service cinder] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:35.630761 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589ff7f-c68e-489f-8703-943e00fde636 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:35.645449 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6589ff7f-c68e-489f-8703-943e00fde636 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:35.645449 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6589ff7f-c68e-489f-8703-943e00fde636 service cinder] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:35.675666 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1099/2180] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:53:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 07:53:35.791178 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:53:35.931500 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-ae3d42bd-0b7f-4017-9f3c-e25f2de17a09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb952b5f6e91402d9b3cea0283b53fbb'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:35.932148 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-ae3d42bd-0b7f-4017-9f3c-e25f2de17a09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb952b5f6e91402d9b3cea0283b53fbb'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:36.058935 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-ae3d42bd-0b7f-4017-9f3c-e25f2de17a09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb952b5f6e91402d9b3cea0283b53fbb'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:36.059583 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-ae3d42bd-0b7f-4017-9f3c-e25f2de17a09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb952b5f6e91402d9b3cea0283b53fbb'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:36.067004 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-ae3d42bd-0b7f-4017-9f3c-e25f2de17a09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb952b5f6e91402d9b3cea0283b53fbb'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:36.084413 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1082/2181] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:53:35 2022] DELETE /identity/v3/users/bb952b5f6e91402d9b3cea0283b53fbb => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:53:36.554894 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589ff7f-c68e-489f-8703-943e00fde636 service cinder] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:36.566756 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589ff7f-c68e-489f-8703-943e00fde636 service cinder] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:36.625428 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfcf111-3954-4b57-941e-1f63315a1afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:36.626080 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfcf111-3954-4b57-941e-1f63315a1afc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:36.626331 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfcf111-3954-4b57-941e-1f63315a1afc admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:36.626607 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfcf111-3954-4b57-941e-1f63315a1afc admin admin] PATH_INFO: `/v3/projects/2c6fa982a3a9431caf45500e96b76d8f` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:36.627772 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfcf111-3954-4b57-941e-1f63315a1afc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c6fa982a3a9431caf45500e96b76d8f)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:36.629676 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfcf111-3954-4b57-941e-1f63315a1afc admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:36.784036 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-4dfcf111-3954-4b57-941e-1f63315a1afc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c6fa982a3a9431caf45500e96b76d8f', 'request_id': 'req-4dfcf111-3954-4b57-941e-1f63315a1afc'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:36.792540 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-4dfcf111-3954-4b57-941e-1f63315a1afc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c6fa982a3a9431caf45500e96b76d8f', 'request_id': 'req-4dfcf111-3954-4b57-941e-1f63315a1afc'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:36.799246 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-4dfcf111-3954-4b57-941e-1f63315a1afc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c6fa982a3a9431caf45500e96b76d8f', 'request_id': 'req-4dfcf111-3954-4b57-941e-1f63315a1afc'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:36.945923 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-4dfcf111-3954-4b57-941e-1f63315a1afc admin admin] The token cache is being invalidate because project 2c6fa982a3a9431caf45500e96b76d8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:53:36.946135 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-4dfcf111-3954-4b57-941e-1f63315a1afc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:36.946745 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-4dfcf111-3954-4b57-941e-1f63315a1afc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:36.948273 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1100/2182] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:53:36 2022] DELETE /identity/v3/projects/2c6fa982a3a9431caf45500e96b76d8f => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:53:36.953352 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e39712-8f95-4508-889f-ffedcc91bcd2 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:36.958301 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e39712-8f95-4508-889f-ffedcc91bcd2 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:36.958301 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e39712-8f95-4508-889f-ffedcc91bcd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:36.975185 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-d7e39712-8f95-4508-889f-ffedcc91bcd2 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:36.976445 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-d7e39712-8f95-4508-889f-ffedcc91bcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:37.037787 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1083/2183] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:53:37.046747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10808cb-b85d-41c7-8f35-1340f28c3656 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:37.047071 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10808cb-b85d-41c7-8f35-1340f28c3656 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:37.047353 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10808cb-b85d-41c7-8f35-1340f28c3656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:37.069481 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-d10808cb-b85d-41c7-8f35-1340f28c3656 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:37.070739 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-d10808cb-b85d-41c7-8f35-1340f28c3656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:37.080136 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1101/2184] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:53:37.084939 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e39712-8f95-4508-889f-ffedcc91bcd2 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:37.095210 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e39712-8f95-4508-889f-ffedcc91bcd2 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:37.099933 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241a71a-ba16-4479-b954-4abe61623dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:37.100557 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241a71a-ba16-4479-b954-4abe61623dbc admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:37.100826 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241a71a-ba16-4479-b954-4abe61623dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:37.101093 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241a71a-ba16-4479-b954-4abe61623dbc admin admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:37.101823 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3241a71a-ba16-4479-b954-4abe61623dbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:53:37.102134 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3241a71a-ba16-4479-b954-4abe61623dbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:37.103805 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3241a71a-ba16-4479-b954-4abe61623dbc admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:37.116776 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1084/2185] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:53:37.121821 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10808cb-b85d-41c7-8f35-1340f28c3656 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:37.131148 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10808cb-b85d-41c7-8f35-1340f28c3656 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:37.136205 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6359f1-2592-4320-8a9e-4d5656df4461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:37.138013 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6359f1-2592-4320-8a9e-4d5656df4461 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:37.138013 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6359f1-2592-4320-8a9e-4d5656df4461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:37.138013 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6359f1-2592-4320-8a9e-4d5656df4461 admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:37.138013 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6359f1-2592-4320-8a9e-4d5656df4461 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:37.139902 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6359f1-2592-4320-8a9e-4d5656df4461 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:37.361224 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1102/2186] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:53:37 2022] POST /identity/v3/projects => generated 367 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:53:37.365487 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241a71a-ba16-4479-b954-4abe61623dbc admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:37.375849 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241a71a-ba16-4479-b954-4abe61623dbc admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:37.433842 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b380d-2d46-472f-9ac0-0260114ceed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:37.434447 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b380d-2d46-472f-9ac0-0260114ceed4 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:37.434730 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b380d-2d46-472f-9ac0-0260114ceed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:37.435025 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b380d-2d46-472f-9ac0-0260114ceed4 admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:37.435665 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b380d-2d46-472f-9ac0-0260114ceed4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:37.437624 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b380d-2d46-472f-9ac0-0260114ceed4 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:37.632956 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1085/2187] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:53:37 2022] POST /identity/v3/users => generated 284 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:53:37.638076 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6359f1-2592-4320-8a9e-4d5656df4461 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:37.649928 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6359f1-2592-4320-8a9e-4d5656df4461 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:37.657261 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7523196-fe11-49d4-872b-cdc290807a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:37.657968 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7523196-fe11-49d4-872b-cdc290807a01 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:37.658251 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7523196-fe11-49d4-872b-cdc290807a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:37.658545 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7523196-fe11-49d4-872b-cdc290807a01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:37.659215 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7523196-fe11-49d4-872b-cdc290807a01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:37.660964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7523196-fe11-49d4-872b-cdc290807a01 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:37.672731 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1103/2188] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:53:37.676981 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b380d-2d46-472f-9ac0-0260114ceed4 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:37.687477 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b380d-2d46-472f-9ac0-0260114ceed4 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:37.691997 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba444a0e-1d91-45ce-b7d0-5ce750556522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:37.692624 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba444a0e-1d91-45ce-b7d0-5ce750556522 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:37.692899 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba444a0e-1d91-45ce-b7d0-5ce750556522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:37.693171 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba444a0e-1d91-45ce-b7d0-5ce750556522 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:37.693814 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba444a0e-1d91-45ce-b7d0-5ce750556522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:37.695477 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba444a0e-1d91-45ce-b7d0-5ce750556522 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:37.707651 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1086/2189] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 07:53:37.720239 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7523196-fe11-49d4-872b-cdc290807a01 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:37.730475 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7523196-fe11-49d4-872b-cdc290807a01 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:37.735281 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c130a-fae2-46cc-8676-bd36e909aad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:37.735942 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c130a-fae2-46cc-8676-bd36e909aad5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:37.736221 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c130a-fae2-46cc-8676-bd36e909aad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:37.736493 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c130a-fae2-46cc-8676-bd36e909aad5 admin admin] PATH_INFO: `/v3/projects/a26450e1e4634bf1ba44e86a34db3e1c/users/d611193685254b858962b3b7466803e7/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:37.751592 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c130a-fae2-46cc-8676-bd36e909aad5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a26450e1e4634bf1ba44e86a34db3e1c, user_id=d611193685254b858962b3b7466803e7, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:37.754238 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c130a-fae2-46cc-8676-bd36e909aad5 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:37.862291 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1104/2190] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:53:37 2022] PUT /identity/v3/projects/a26450e1e4634bf1ba44e86a34db3e1c/users/d611193685254b858962b3b7466803e7/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:53:37.887915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd66f4-a2f9-4fb9-9fd4-87298b19f085 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:37.887915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd66f4-a2f9-4fb9-9fd4-87298b19f085 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:37.887915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd66f4-a2f9-4fb9-9fd4-87298b19f085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:37.926257 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-a3dd66f4-a2f9-4fb9-9fd4-87298b19f085 None None] MFA Rules not processed for user `d611193685254b858962b3b7466803e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:37.927553 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-a3dd66f4-a2f9-4fb9-9fd4-87298b19f085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:38.009862 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1087/2191] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:53:38.015384 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c130a-fae2-46cc-8676-bd36e909aad5 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:38.081958 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c130a-fae2-46cc-8676-bd36e909aad5 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:38.086636 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b673e-2069-4a36-9564-4a17bb3c113c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:38.087265 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b673e-2069-4a36-9564-4a17bb3c113c admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:38.087545 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b673e-2069-4a36-9564-4a17bb3c113c admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:38.087816 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b673e-2069-4a36-9564-4a17bb3c113c admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:38.088452 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b673e-2069-4a36-9564-4a17bb3c113c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:38.090371 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b673e-2069-4a36-9564-4a17bb3c113c admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:38.135192 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:53:38.245278 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1105/2192] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:53:38 2022] POST /identity/v3/projects => generated 367 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 07:53:38.250467 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd66f4-a2f9-4fb9-9fd4-87298b19f085 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:38.262092 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd66f4-a2f9-4fb9-9fd4-87298b19f085 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:38.321709 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8e4e8-da03-4d7f-98bb-a287b60b3c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:38.322477 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8e4e8-da03-4d7f-98bb-a287b60b3c63 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:38.322756 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8e4e8-da03-4d7f-98bb-a287b60b3c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:38.323666 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8e4e8-da03-4d7f-98bb-a287b60b3c63 admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:38.324491 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d8e4e8-da03-4d7f-98bb-a287b60b3c63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:38.326310 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d8e4e8-da03-4d7f-98bb-a287b60b3c63 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:38.505335 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1088/2193] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:53:38 2022] POST /identity/v3/users => generated 290 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 07:53:38.551964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b673e-2069-4a36-9564-4a17bb3c113c admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:38.575437 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b673e-2069-4a36-9564-4a17bb3c113c admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:38.580327 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f3f7f-6ffb-4e37-ad2a-47c6c37c8b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:38.580940 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f3f7f-6ffb-4e37-ad2a-47c6c37c8b07 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:38.581215 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f3f7f-6ffb-4e37-ad2a-47c6c37c8b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:38.581744 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f3f7f-6ffb-4e37-ad2a-47c6c37c8b07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:38.582398 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f3f7f-6ffb-4e37-ad2a-47c6c37c8b07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:38.584065 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f3f7f-6ffb-4e37-ad2a-47c6c37c8b07 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:38.599430 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1106/2194] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:53:38.617063 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8e4e8-da03-4d7f-98bb-a287b60b3c63 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:38.617903 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8e4e8-da03-4d7f-98bb-a287b60b3c63 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:38.624104 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3693cf2-8a42-4e7e-ae78-ff2ca8f3b588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:38.624658 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3693cf2-8a42-4e7e-ae78-ff2ca8f3b588 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:38.624934 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3693cf2-8a42-4e7e-ae78-ff2ca8f3b588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:38.625207 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3693cf2-8a42-4e7e-ae78-ff2ca8f3b588 admin admin] PATH_INFO: `/v3/projects/671542fa059a4c90b4d1df623945857f/users/f818cf1f097b451999867b498c1fa9f3/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:38.642205 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3693cf2-8a42-4e7e-ae78-ff2ca8f3b588 admin admin] RBAC: Authorizing `identity:create_grant(project_id=671542fa059a4c90b4d1df623945857f, user_id=f818cf1f097b451999867b498c1fa9f3, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:38.645111 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3693cf2-8a42-4e7e-ae78-ff2ca8f3b588 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:38.811032 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1089/2195] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:53:38 2022] PUT /identity/v3/projects/671542fa059a4c90b4d1df623945857f/users/f818cf1f097b451999867b498c1fa9f3/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:53:38.815006 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f3f7f-6ffb-4e37-ad2a-47c6c37c8b07 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:38.828069 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f3f7f-6ffb-4e37-ad2a-47c6c37c8b07 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:38.918241 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e5e15b-0157-44ae-8ed3-cf53b4b0b7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:38.918936 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5e15b-0157-44ae-8ed3-cf53b4b0b7b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:38.919268 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5e15b-0157-44ae-8ed3-cf53b4b0b7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:38.919545 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5e15b-0157-44ae-8ed3-cf53b4b0b7b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:38.921216 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e5e15b-0157-44ae-8ed3-cf53b4b0b7b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:38.922829 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e5e15b-0157-44ae-8ed3-cf53b4b0b7b3 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:38.940596 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1107/2196] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:53:38.948636 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3693cf2-8a42-4e7e-ae78-ff2ca8f3b588 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:38.961099 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3693cf2-8a42-4e7e-ae78-ff2ca8f3b588 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:38.968549 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53e861-f42e-4322-9928-8adb1a72b8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:38.969562 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53e861-f42e-4322-9928-8adb1a72b8a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:38.970021 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53e861-f42e-4322-9928-8adb1a72b8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:38.970460 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53e861-f42e-4322-9928-8adb1a72b8a9 admin admin] PATH_INFO: `/v3/projects/671542fa059a4c90b4d1df623945857f/users/f818cf1f097b451999867b498c1fa9f3/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:38.973030 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f53e861-f42e-4322-9928-8adb1a72b8a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=671542fa059a4c90b4d1df623945857f, user_id=f818cf1f097b451999867b498c1fa9f3, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:38.976032 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f53e861-f42e-4322-9928-8adb1a72b8a9 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:38.990531 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1090/2197] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:53:38 2022] PUT /identity/v3/projects/671542fa059a4c90b4d1df623945857f/users/f818cf1f097b451999867b498c1fa9f3/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:53:39.014296 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcbf83-9994-4138-b5cc-a01e3e96aa28 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:39.014296 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcbf83-9994-4138-b5cc-a01e3e96aa28 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:39.014296 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcbf83-9994-4138-b5cc-a01e3e96aa28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:39.048921 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-41bcbf83-9994-4138-b5cc-a01e3e96aa28 None None] MFA Rules not processed for user `f818cf1f097b451999867b498c1fa9f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:39.050431 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-41bcbf83-9994-4138-b5cc-a01e3e96aa28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:39.131200 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1108/2198] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:39 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:53:39.143376 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53e861-f42e-4322-9928-8adb1a72b8a9 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:39.145848 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-3f53e861-f42e-4322-9928-8adb1a72b8a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:39.206754 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53e861-f42e-4322-9928-8adb1a72b8a9 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:39.210494 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d6aa7-b798-4b46-ac78-5858fd460b2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:39.211162 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d6aa7-b798-4b46-ac78-5858fd460b2f service cinder] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:39.211443 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d6aa7-b798-4b46-ac78-5858fd460b2f service cinder] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:39.211711 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d6aa7-b798-4b46-ac78-5858fd460b2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:39.222605 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d6aa7-b798-4b46-ac78-5858fd460b2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:39.224076 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d6aa7-b798-4b46-ac78-5858fd460b2f service cinder] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:39.234845 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1091/2199] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:53:39 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:53:39.257878 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:53:39.424619 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bcbf83-9994-4138-b5cc-a01e3e96aa28 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:39.426175 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-41bcbf83-9994-4138-b5cc-a01e3e96aa28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:39.439655 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bcbf83-9994-4138-b5cc-a01e3e96aa28 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:39.443277 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ef008-add9-4b4b-8962-c92a61d5bcc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:39.443879 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ef008-add9-4b4b-8962-c92a61d5bcc5 service cinder] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:39.444153 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ef008-add9-4b4b-8962-c92a61d5bcc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:39.444422 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ef008-add9-4b4b-8962-c92a61d5bcc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:39.507867 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ef008-add9-4b4b-8962-c92a61d5bcc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:39.509260 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ef008-add9-4b4b-8962-c92a61d5bcc5 service cinder] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:39.521998 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1109/2200] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:53:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:53:40.032337 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:53:41.482281 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:53:42.306598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:53:46.146311 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:53:46.412999 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d6aa7-b798-4b46-ac78-5858fd460b2f service cinder] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:46.477448 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d6aa7-b798-4b46-ac78-5858fd460b2f service cinder] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:46.483042 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa37a3-596e-48b8-8e06-ccacc57190c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:46.487180 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa37a3-596e-48b8-8e06-ccacc57190c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:46.487180 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa37a3-596e-48b8-8e06-ccacc57190c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:46.487180 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa37a3-596e-48b8-8e06-ccacc57190c7 admin admin] PATH_INFO: `/v3/users/d611193685254b858962b3b7466803e7` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:46.487180 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa37a3-596e-48b8-8e06-ccacc57190c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d611193685254b858962b3b7466803e7)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:46.487524 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa37a3-596e-48b8-8e06-ccacc57190c7 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:46.558296 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:53:46.735204 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-8bfa37a3-596e-48b8-8e06-ccacc57190c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd611193685254b858962b3b7466803e7'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:46.735869 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-8bfa37a3-596e-48b8-8e06-ccacc57190c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd611193685254b858962b3b7466803e7'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:46.864189 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-8bfa37a3-596e-48b8-8e06-ccacc57190c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd611193685254b858962b3b7466803e7'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:46.864817 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-8bfa37a3-596e-48b8-8e06-ccacc57190c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd611193685254b858962b3b7466803e7'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:46.872732 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-8bfa37a3-596e-48b8-8e06-ccacc57190c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd611193685254b858962b3b7466803e7'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:46.891032 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1092/2201] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:53:46 2022] DELETE /identity/v3/users/d611193685254b858962b3b7466803e7 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:53:46.896191 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70487e0-6479-449d-94a6-d20a93e3054a None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:46.896481 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70487e0-6479-449d-94a6-d20a93e3054a None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:46.896759 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70487e0-6479-449d-94a6-d20a93e3054a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:46.916138 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-e70487e0-6479-449d-94a6-d20a93e3054a None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:46.917510 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-e70487e0-6479-449d-94a6-d20a93e3054a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:46.977267 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1110/2202] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:53:46.987360 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa37a3-596e-48b8-8e06-ccacc57190c7 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:46.988738 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-8bfa37a3-596e-48b8-8e06-ccacc57190c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:47.048139 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa37a3-596e-48b8-8e06-ccacc57190c7 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:47.051760 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5645a2-4c45-4f22-9e9b-2447d37e5197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:47.052371 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5645a2-4c45-4f22-9e9b-2447d37e5197 service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:47.052652 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5645a2-4c45-4f22-9e9b-2447d37e5197 service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:47.052924 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5645a2-4c45-4f22-9e9b-2447d37e5197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:47.062606 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5645a2-4c45-4f22-9e9b-2447d37e5197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:47.064073 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5645a2-4c45-4f22-9e9b-2447d37e5197 service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:47.074172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1093/2203] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:53:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:53:47.622947 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70487e0-6479-449d-94a6-d20a93e3054a None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:47.625021 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-e70487e0-6479-449d-94a6-d20a93e3054a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:47.637612 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70487e0-6479-449d-94a6-d20a93e3054a None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:47.642879 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0958c39-25ac-428e-9392-c1ff65ff23fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:47.643546 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0958c39-25ac-428e-9392-c1ff65ff23fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:47.643823 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0958c39-25ac-428e-9392-c1ff65ff23fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:47.644099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0958c39-25ac-428e-9392-c1ff65ff23fd admin admin] PATH_INFO: `/v3/projects/a26450e1e4634bf1ba44e86a34db3e1c` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:47.645241 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0958c39-25ac-428e-9392-c1ff65ff23fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a26450e1e4634bf1ba44e86a34db3e1c)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:47.647209 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0958c39-25ac-428e-9392-c1ff65ff23fd admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:47.758573 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-a0958c39-25ac-428e-9392-c1ff65ff23fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a26450e1e4634bf1ba44e86a34db3e1c', 'request_id': 'req-a0958c39-25ac-428e-9392-c1ff65ff23fd'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:47.765419 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-a0958c39-25ac-428e-9392-c1ff65ff23fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a26450e1e4634bf1ba44e86a34db3e1c', 'request_id': 'req-a0958c39-25ac-428e-9392-c1ff65ff23fd'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:47.773528 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-a0958c39-25ac-428e-9392-c1ff65ff23fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a26450e1e4634bf1ba44e86a34db3e1c', 'request_id': 'req-a0958c39-25ac-428e-9392-c1ff65ff23fd'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:47.855169 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-a0958c39-25ac-428e-9392-c1ff65ff23fd admin admin] The token cache is being invalidate because project a26450e1e4634bf1ba44e86a34db3e1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:53:47.855461 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-a0958c39-25ac-428e-9392-c1ff65ff23fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:47.856101 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-a0958c39-25ac-428e-9392-c1ff65ff23fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:47.857581 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1111/2204] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:53:47 2022] DELETE /identity/v3/projects/a26450e1e4634bf1ba44e86a34db3e1c => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:53:47.861734 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5645a2-4c45-4f22-9e9b-2447d37e5197 service neutron] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:47.875988 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5645a2-4c45-4f22-9e9b-2447d37e5197 service neutron] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:47.942083 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4fc860-0aab-4f7a-8c6b-2fd9aa2a62b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:47.942725 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4fc860-0aab-4f7a-8c6b-2fd9aa2a62b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:47.943078 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4fc860-0aab-4f7a-8c6b-2fd9aa2a62b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:47.943385 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4fc860-0aab-4f7a-8c6b-2fd9aa2a62b6 admin admin] PATH_INFO: `/v3/users/f818cf1f097b451999867b498c1fa9f3` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:47.944577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4fc860-0aab-4f7a-8c6b-2fd9aa2a62b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f818cf1f097b451999867b498c1fa9f3)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:47.946523 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4fc860-0aab-4f7a-8c6b-2fd9aa2a62b6 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:48.222728 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-4d4fc860-0aab-4f7a-8c6b-2fd9aa2a62b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f818cf1f097b451999867b498c1fa9f3'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:48.223400 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-4d4fc860-0aab-4f7a-8c6b-2fd9aa2a62b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f818cf1f097b451999867b498c1fa9f3'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:48.323680 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-4d4fc860-0aab-4f7a-8c6b-2fd9aa2a62b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f818cf1f097b451999867b498c1fa9f3'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:48.324530 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-4d4fc860-0aab-4f7a-8c6b-2fd9aa2a62b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f818cf1f097b451999867b498c1fa9f3'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:48.332244 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-4d4fc860-0aab-4f7a-8c6b-2fd9aa2a62b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f818cf1f097b451999867b498c1fa9f3'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:48.349237 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1094/2205] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:53:47 2022] DELETE /identity/v3/users/f818cf1f097b451999867b498c1fa9f3 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:53:48.954720 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0958c39-25ac-428e-9392-c1ff65ff23fd admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:48.956167 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-a0958c39-25ac-428e-9392-c1ff65ff23fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:48.969867 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0958c39-25ac-428e-9392-c1ff65ff23fd admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:49.036933 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250755ca-b888-4461-aa54-df5151705a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:49.037679 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250755ca-b888-4461-aa54-df5151705a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:49.038026 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250755ca-b888-4461-aa54-df5151705a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:49.038725 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250755ca-b888-4461-aa54-df5151705a66 admin admin] PATH_INFO: `/v3/projects/671542fa059a4c90b4d1df623945857f` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:49.039620 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250755ca-b888-4461-aa54-df5151705a66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=671542fa059a4c90b4d1df623945857f)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:49.041628 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250755ca-b888-4461-aa54-df5151705a66 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:49.190746 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-250755ca-b888-4461-aa54-df5151705a66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '671542fa059a4c90b4d1df623945857f', 'request_id': 'req-250755ca-b888-4461-aa54-df5151705a66'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:49.197430 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-250755ca-b888-4461-aa54-df5151705a66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '671542fa059a4c90b4d1df623945857f', 'request_id': 'req-250755ca-b888-4461-aa54-df5151705a66'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:49.206466 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-250755ca-b888-4461-aa54-df5151705a66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '671542fa059a4c90b4d1df623945857f', 'request_id': 'req-250755ca-b888-4461-aa54-df5151705a66'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:49.338744 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-250755ca-b888-4461-aa54-df5151705a66 admin admin] The token cache is being invalidate because project 671542fa059a4c90b4d1df623945857f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:53:49.339145 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-250755ca-b888-4461-aa54-df5151705a66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:49.344907 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-250755ca-b888-4461-aa54-df5151705a66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:49.344907 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1112/2206] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:53:48 2022] DELETE /identity/v3/projects/671542fa059a4c90b4d1df623945857f => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:53:49.346483 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ac6a1-fa10-44a0-8b5c-7ff94a9062da None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:49.346961 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ac6a1-fa10-44a0-8b5c-7ff94a9062da None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:49.347090 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ac6a1-fa10-44a0-8b5c-7ff94a9062da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:49.367841 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-843ac6a1-fa10-44a0-8b5c-7ff94a9062da None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:49.369067 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-843ac6a1-fa10-44a0-8b5c-7ff94a9062da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:49.432979 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1095/2207] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:53:49.442212 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb91dd-1530-45c3-8d43-a85626dfba05 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:49.442570 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb91dd-1530-45c3-8d43-a85626dfba05 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:49.442847 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb91dd-1530-45c3-8d43-a85626dfba05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:49.465506 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-eafb91dd-1530-45c3-8d43-a85626dfba05 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:49.466744 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-eafb91dd-1530-45c3-8d43-a85626dfba05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:49.480295 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1113/2208] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:53:49.482899 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ac6a1-fa10-44a0-8b5c-7ff94a9062da None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:49.489526 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:53:49.503617 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ac6a1-fa10-44a0-8b5c-7ff94a9062da None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:49.510573 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae442442-a902-499a-8eb2-63022306ede1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:49.512463 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae442442-a902-499a-8eb2-63022306ede1 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:49.512463 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae442442-a902-499a-8eb2-63022306ede1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:49.512463 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae442442-a902-499a-8eb2-63022306ede1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:49.512810 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae442442-a902-499a-8eb2-63022306ede1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:53:49.513265 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae442442-a902-499a-8eb2-63022306ede1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:49.515147 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae442442-a902-499a-8eb2-63022306ede1 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:49.528756 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1096/2209] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:53:49.537401 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb91dd-1530-45c3-8d43-a85626dfba05 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:49.547553 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb91dd-1530-45c3-8d43-a85626dfba05 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:49.552493 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681d1e4-95a7-4694-b045-5acc0de55892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:49.553124 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681d1e4-95a7-4694-b045-5acc0de55892 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:49.553407 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681d1e4-95a7-4694-b045-5acc0de55892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:49.553679 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681d1e4-95a7-4694-b045-5acc0de55892 admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:49.554367 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f681d1e4-95a7-4694-b045-5acc0de55892 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:49.556311 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f681d1e4-95a7-4694-b045-5acc0de55892 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:49.755177 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1114/2210] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:53:49 2022] POST /identity/v3/projects => generated 377 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:53:49.759232 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae442442-a902-499a-8eb2-63022306ede1 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:49.778853 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae442442-a902-499a-8eb2-63022306ede1 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:49.856235 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b81dc-2883-4775-80e6-585b5e93a1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:49.857050 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b81dc-2883-4775-80e6-585b5e93a1c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:49.857550 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b81dc-2883-4775-80e6-585b5e93a1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:49.857833 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b81dc-2883-4775-80e6-585b5e93a1c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:49.858624 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73b81dc-2883-4775-80e6-585b5e93a1c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:49.860901 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73b81dc-2883-4775-80e6-585b5e93a1c4 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:50.004038 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1097/2211] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:53:49 2022] POST /identity/v3/users => generated 289 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:53:50.008181 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681d1e4-95a7-4694-b045-5acc0de55892 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:50.019195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681d1e4-95a7-4694-b045-5acc0de55892 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:50.024563 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53816722-575a-410a-85dd-123729b3e8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:50.025671 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53816722-575a-410a-85dd-123729b3e8d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:50.026676 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53816722-575a-410a-85dd-123729b3e8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:50.027408 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53816722-575a-410a-85dd-123729b3e8d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:50.028092 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53816722-575a-410a-85dd-123729b3e8d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:50.029726 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53816722-575a-410a-85dd-123729b3e8d1 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:50.040239 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1115/2212] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:53:50.045057 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b81dc-2883-4775-80e6-585b5e93a1c4 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:50.058110 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b81dc-2883-4775-80e6-585b5e93a1c4 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:50.061031 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cebc76f-dbf9-42e7-8f6e-25e9fe54fab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:50.061650 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cebc76f-dbf9-42e7-8f6e-25e9fe54fab1 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:50.061930 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cebc76f-dbf9-42e7-8f6e-25e9fe54fab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:50.062205 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cebc76f-dbf9-42e7-8f6e-25e9fe54fab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:50.062960 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cebc76f-dbf9-42e7-8f6e-25e9fe54fab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:50.064615 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cebc76f-dbf9-42e7-8f6e-25e9fe54fab1 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:50.075680 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1098/2213] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:53:50.080094 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53816722-575a-410a-85dd-123729b3e8d1 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:50.092376 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53816722-575a-410a-85dd-123729b3e8d1 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:50.097969 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a34c6-62fe-455e-a118-5d4e35afed3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:50.097969 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a34c6-62fe-455e-a118-5d4e35afed3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:50.098208 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a34c6-62fe-455e-a118-5d4e35afed3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:50.098466 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a34c6-62fe-455e-a118-5d4e35afed3e admin admin] PATH_INFO: `/v3/projects/279bdeaf89a24b2d94b12bb98949978a/users/ce532d5e1a3d4fc9ab7e4d80eb5528b9/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:50.114807 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8a34c6-62fe-455e-a118-5d4e35afed3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=279bdeaf89a24b2d94b12bb98949978a, user_id=ce532d5e1a3d4fc9ab7e4d80eb5528b9, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:50.118039 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8a34c6-62fe-455e-a118-5d4e35afed3e admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:50.316217 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1116/2214] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:53:50 2022] PUT /identity/v3/projects/279bdeaf89a24b2d94b12bb98949978a/users/ce532d5e1a3d4fc9ab7e4d80eb5528b9/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:53:50.327705 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571682b-f9ab-47d5-a910-ff29005be758 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:50.327993 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571682b-f9ab-47d5-a910-ff29005be758 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:50.328285 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571682b-f9ab-47d5-a910-ff29005be758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:50.371009 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-e571682b-f9ab-47d5-a910-ff29005be758 None None] MFA Rules not processed for user `ce532d5e1a3d4fc9ab7e4d80eb5528b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:50.372375 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-e571682b-f9ab-47d5-a910-ff29005be758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:50.439066 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:53:50.447935 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1099/2215] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:53:50.453449 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a34c6-62fe-455e-a118-5d4e35afed3e admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:50.517257 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a34c6-62fe-455e-a118-5d4e35afed3e admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:50.521901 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13009f36-00e6-4a5c-ac48-c99297ee800a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:50.522503 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13009f36-00e6-4a5c-ac48-c99297ee800a admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:50.522854 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13009f36-00e6-4a5c-ac48-c99297ee800a admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:50.523160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13009f36-00e6-4a5c-ac48-c99297ee800a admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:50.528109 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13009f36-00e6-4a5c-ac48-c99297ee800a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:50.528109 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13009f36-00e6-4a5c-ac48-c99297ee800a admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:50.833428 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1117/2216] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:53:50 2022] POST /identity/v3/projects => generated 377 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:53:50.837642 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e571682b-f9ab-47d5-a910-ff29005be758 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:50.848737 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e571682b-f9ab-47d5-a910-ff29005be758 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:50.913281 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2183f09-9f48-4055-8ab9-c1d579ac405d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:50.913905 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2183f09-9f48-4055-8ab9-c1d579ac405d admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:50.914245 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2183f09-9f48-4055-8ab9-c1d579ac405d admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:50.914528 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2183f09-9f48-4055-8ab9-c1d579ac405d admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:50.915195 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2183f09-9f48-4055-8ab9-c1d579ac405d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:50.918196 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2183f09-9f48-4055-8ab9-c1d579ac405d admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:51.039028 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1100/2217] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:53:50 2022] POST /identity/v3/users => generated 289 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:53:51.045741 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13009f36-00e6-4a5c-ac48-c99297ee800a admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:51.063987 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13009f36-00e6-4a5c-ac48-c99297ee800a admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:51.076325 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d7656-7b4c-4dd3-a8a2-027b16fad5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:51.076325 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d7656-7b4c-4dd3-a8a2-027b16fad5f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:51.076325 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d7656-7b4c-4dd3-a8a2-027b16fad5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:51.076325 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d7656-7b4c-4dd3-a8a2-027b16fad5f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:51.076874 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398d7656-7b4c-4dd3-a8a2-027b16fad5f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:51.078483 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398d7656-7b4c-4dd3-a8a2-027b16fad5f1 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:51.094073 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1118/2218] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:53:51.098099 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2183f09-9f48-4055-8ab9-c1d579ac405d admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:51.128896 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2183f09-9f48-4055-8ab9-c1d579ac405d admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:51.136323 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6adb82b-7021-47b2-95a9-08c2abd99c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:51.137146 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6adb82b-7021-47b2-95a9-08c2abd99c04 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:51.137577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6adb82b-7021-47b2-95a9-08c2abd99c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:51.137996 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6adb82b-7021-47b2-95a9-08c2abd99c04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:51.138827 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6adb82b-7021-47b2-95a9-08c2abd99c04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:51.140712 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6adb82b-7021-47b2-95a9-08c2abd99c04 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:51.153840 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1101/2219] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:53:51.157750 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d7656-7b4c-4dd3-a8a2-027b16fad5f1 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:51.173503 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d7656-7b4c-4dd3-a8a2-027b16fad5f1 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:51.185146 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b89cf-ba21-4381-a2ca-e0a0dae96843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:51.194158 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b89cf-ba21-4381-a2ca-e0a0dae96843 admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:51.195239 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b89cf-ba21-4381-a2ca-e0a0dae96843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:51.195914 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b89cf-ba21-4381-a2ca-e0a0dae96843 admin admin] PATH_INFO: `/v3/projects/1d4333e62f8d4a92b898c88b03a1c60d/users/db36bc1c269949aeb7c991e9dec4fb4d/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:51.233104 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b89cf-ba21-4381-a2ca-e0a0dae96843 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d4333e62f8d4a92b898c88b03a1c60d, user_id=db36bc1c269949aeb7c991e9dec4fb4d, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:51.236780 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b89cf-ba21-4381-a2ca-e0a0dae96843 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:51.347877 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1119/2220] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:53:51 2022] PUT /identity/v3/projects/1d4333e62f8d4a92b898c88b03a1c60d/users/db36bc1c269949aeb7c991e9dec4fb4d/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:53:51.360447 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859487fe-045f-4ec2-9557-45b5628d51ec None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:51.360736 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859487fe-045f-4ec2-9557-45b5628d51ec None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:51.361015 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859487fe-045f-4ec2-9557-45b5628d51ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:51.393689 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-859487fe-045f-4ec2-9557-45b5628d51ec None None] MFA Rules not processed for user `db36bc1c269949aeb7c991e9dec4fb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:51.395469 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-859487fe-045f-4ec2-9557-45b5628d51ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:51.466964 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1102/2221] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:53:51.471640 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b89cf-ba21-4381-a2ca-e0a0dae96843 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:51.543846 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b89cf-ba21-4381-a2ca-e0a0dae96843 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:51.548972 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce6fab-f8e8-462f-a7c3-04f7c3a35f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:51.549591 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce6fab-f8e8-462f-a7c3-04f7c3a35f8d admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:51.549873 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce6fab-f8e8-462f-a7c3-04f7c3a35f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:51.550150 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce6fab-f8e8-462f-a7c3-04f7c3a35f8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:51.550781 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ce6fab-f8e8-462f-a7c3-04f7c3a35f8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:51.552768 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ce6fab-f8e8-462f-a7c3-04f7c3a35f8d admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:51.732209 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1120/2222] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:53:51 2022] POST /identity/v3/projects => generated 379 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:53:51.736255 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859487fe-045f-4ec2-9557-45b5628d51ec None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:51.747541 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859487fe-045f-4ec2-9557-45b5628d51ec None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:51.808896 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e916cab-798f-4058-b7cb-f4bf74670677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:51.809521 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e916cab-798f-4058-b7cb-f4bf74670677 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:51.809795 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e916cab-798f-4058-b7cb-f4bf74670677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:51.810064 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e916cab-798f-4058-b7cb-f4bf74670677 admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:51.810740 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e916cab-798f-4058-b7cb-f4bf74670677 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:51.812708 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e916cab-798f-4058-b7cb-f4bf74670677 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:51.986725 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1103/2223] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:53:51 2022] POST /identity/v3/users => generated 296 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 07:53:51.991013 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce6fab-f8e8-462f-a7c3-04f7c3a35f8d admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:52.002863 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce6fab-f8e8-462f-a7c3-04f7c3a35f8d admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:52.008981 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4a52c-4f2c-47ca-b414-017623a43fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:52.009589 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4a52c-4f2c-47ca-b414-017623a43fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:52.009959 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4a52c-4f2c-47ca-b414-017623a43fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:52.010546 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4a52c-4f2c-47ca-b414-017623a43fb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:52.011791 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd4a52c-4f2c-47ca-b414-017623a43fb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:52.013544 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd4a52c-4f2c-47ca-b414-017623a43fb6 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:52.027203 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1121/2224] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:53:52.031489 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e916cab-798f-4058-b7cb-f4bf74670677 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:52.042143 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e916cab-798f-4058-b7cb-f4bf74670677 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:52.046851 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5a670-17d7-4255-a9ff-7d1ffcd076d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:52.047543 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5a670-17d7-4255-a9ff-7d1ffcd076d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:52.047820 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5a670-17d7-4255-a9ff-7d1ffcd076d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:52.048095 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5a670-17d7-4255-a9ff-7d1ffcd076d5 admin admin] PATH_INFO: `/v3/projects/fc12a97c830b49fdb40abb42f544a207/users/3ea8f2b535914cd18be97eb9d1069329/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:52.063432 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5a670-17d7-4255-a9ff-7d1ffcd076d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc12a97c830b49fdb40abb42f544a207, user_id=3ea8f2b535914cd18be97eb9d1069329, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:52.066085 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5a670-17d7-4255-a9ff-7d1ffcd076d5 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:52.169760 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1104/2225] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:53:52 2022] PUT /identity/v3/projects/fc12a97c830b49fdb40abb42f544a207/users/3ea8f2b535914cd18be97eb9d1069329/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:53:52.173864 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4a52c-4f2c-47ca-b414-017623a43fb6 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:52.184566 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4a52c-4f2c-47ca-b414-017623a43fb6 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:52.240568 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad3514-8394-4f73-a76a-06c425a7d8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:52.241416 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad3514-8394-4f73-a76a-06c425a7d8d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:52.241697 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad3514-8394-4f73-a76a-06c425a7d8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:52.241971 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad3514-8394-4f73-a76a-06c425a7d8d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:52.242610 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad3514-8394-4f73-a76a-06c425a7d8d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:52.244223 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad3514-8394-4f73-a76a-06c425a7d8d1 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:52.255120 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1122/2226] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:53:52.259409 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5a670-17d7-4255-a9ff-7d1ffcd076d5 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:52.269738 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5a670-17d7-4255-a9ff-7d1ffcd076d5 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:52.278630 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf34a1-ccdf-436e-99b5-c9c7071eba5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:52.278630 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf34a1-ccdf-436e-99b5-c9c7071eba5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:52.278630 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf34a1-ccdf-436e-99b5-c9c7071eba5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:52.278630 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf34a1-ccdf-436e-99b5-c9c7071eba5d admin admin] PATH_INFO: `/v3/projects/fc12a97c830b49fdb40abb42f544a207/users/3ea8f2b535914cd18be97eb9d1069329/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:52.279193 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf34a1-ccdf-436e-99b5-c9c7071eba5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc12a97c830b49fdb40abb42f544a207, user_id=3ea8f2b535914cd18be97eb9d1069329, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:52.280797 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf34a1-ccdf-436e-99b5-c9c7071eba5d admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:52.293345 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1105/2227] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:53:52 2022] PUT /identity/v3/projects/fc12a97c830b49fdb40abb42f544a207/users/3ea8f2b535914cd18be97eb9d1069329/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:53:52.307918 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86a842-bc82-43f5-832f-7bd60941f64f None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:52.308219 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86a842-bc82-43f5-832f-7bd60941f64f None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:52.309038 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86a842-bc82-43f5-832f-7bd60941f64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:52.349758 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-2c86a842-bc82-43f5-832f-7bd60941f64f None None] MFA Rules not processed for user `3ea8f2b535914cd18be97eb9d1069329`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:52.351111 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-2c86a842-bc82-43f5-832f-7bd60941f64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:52.451061 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1123/2228] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:52 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:53:52.463976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf34a1-ccdf-436e-99b5-c9c7071eba5d admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:52.468683 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-e3bf34a1-ccdf-436e-99b5-c9c7071eba5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:52.527423 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf34a1-ccdf-436e-99b5-c9c7071eba5d admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:52.530937 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c4173-e417-4d69-a4aa-bde45f23d17e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:52.531579 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c4173-e417-4d69-a4aa-bde45f23d17e service cinder] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:52.531861 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c4173-e417-4d69-a4aa-bde45f23d17e service cinder] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:52.532135 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c4173-e417-4d69-a4aa-bde45f23d17e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:52.540970 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c4173-e417-4d69-a4aa-bde45f23d17e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:52.543080 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c4173-e417-4d69-a4aa-bde45f23d17e service cinder] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:52.552375 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1106/2229] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:53:52 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:53:52.580188 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:53:52.676206 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86a842-bc82-43f5-832f-7bd60941f64f None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:52.677619 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-2c86a842-bc82-43f5-832f-7bd60941f64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:52.691620 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86a842-bc82-43f5-832f-7bd60941f64f None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:52.696844 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc621512-ff7f-46de-b192-c3c2ef4739a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:52.698133 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc621512-ff7f-46de-b192-c3c2ef4739a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:52.698620 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc621512-ff7f-46de-b192-c3c2ef4739a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:52.698826 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc621512-ff7f-46de-b192-c3c2ef4739a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:52.784133 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc621512-ff7f-46de-b192-c3c2ef4739a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:52.785511 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc621512-ff7f-46de-b192-c3c2ef4739a4 service cinder] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:52.802610 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1124/2230] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:53:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:53:53.072084 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:53:53.152184 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e302a0-3734-447a-9c3c-f7979e0cf16b None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:53.152476 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e302a0-3734-447a-9c3c-f7979e0cf16b None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:53.152753 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e302a0-3734-447a-9c3c-f7979e0cf16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:53.181147 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-92e302a0-3734-447a-9c3c-f7979e0cf16b None None] MFA Rules not processed for user `30dc2621143f4604b53bb44b82e8efbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:53.182948 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-92e302a0-3734-447a-9c3c-f7979e0cf16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:53.241480 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1107/2231] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Aug 26 07:53:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:53:53.297174 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc621512-ff7f-46de-b192-c3c2ef4739a4 service cinder] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:53.297174 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-bc621512-ff7f-46de-b192-c3c2ef4739a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:53.362185 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc621512-ff7f-46de-b192-c3c2ef4739a4 service cinder] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:53.367217 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af382e-a091-4629-9511-b4237ef761a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3142255c263e44a189db82c621f87e7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:53.367760 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af382e-a091-4629-9511-b4237ef761a8 service swift] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:53.368040 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af382e-a091-4629-9511-b4237ef761a8 service swift] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:53.368314 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af382e-a091-4629-9511-b4237ef761a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:53.377364 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af382e-a091-4629-9511-b4237ef761a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:53.378960 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af382e-a091-4629-9511-b4237ef761a8 service swift] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:53.387934 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1125/2232] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 26 07:53:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 07:53:54.448838 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc652c-bb38-448b-9807-7a553cf32083 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:54.449344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc652c-bb38-448b-9807-7a553cf32083 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:54.449471 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc652c-bb38-448b-9807-7a553cf32083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:54.469599 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-4bdc652c-bb38-448b-9807-7a553cf32083 None None] MFA Rules not processed for user `30dc2621143f4604b53bb44b82e8efbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:54.470955 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-4bdc652c-bb38-448b-9807-7a553cf32083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:54.478329 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1108/2233] 10.222.0.42 () {58 vars in 967 bytes} [Fri Aug 26 07:53:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:53:54.491509 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af382e-a091-4629-9511-b4237ef761a8 service swift] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:54.504349 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af382e-a091-4629-9511-b4237ef761a8 service swift] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:54.507444 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc8c08d-3dbb-4fd0-901c-a5e3272de70f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3142255c263e44a189db82c621f87e7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:54.508040 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8c08d-3dbb-4fd0-901c-a5e3272de70f service swift] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:54.508317 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8c08d-3dbb-4fd0-901c-a5e3272de70f service swift] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:54.508587 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8c08d-3dbb-4fd0-901c-a5e3272de70f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:54.517061 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc8c08d-3dbb-4fd0-901c-a5e3272de70f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:54.518626 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc8c08d-3dbb-4fd0-901c-a5e3272de70f service swift] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:54.527225 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1126/2234] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 26 07:53:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 26 07:53:54.654593 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:53:55.444136 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:53:55.643368 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bbfdb-9f4c-4a2d-b763-1819fa0736b4 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:55.643920 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bbfdb-9f4c-4a2d-b763-1819fa0736b4 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:55.643920 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bbfdb-9f4c-4a2d-b763-1819fa0736b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:55.662881 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-a68bbfdb-9f4c-4a2d-b763-1819fa0736b4 None None] MFA Rules not processed for user `30dc2621143f4604b53bb44b82e8efbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:55.664483 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-a68bbfdb-9f4c-4a2d-b763-1819fa0736b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:55.671996 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1109/2235] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Aug 26 07:53:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:53:55.686068 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc8c08d-3dbb-4fd0-901c-a5e3272de70f service swift] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:55.696701 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc8c08d-3dbb-4fd0-901c-a5e3272de70f service swift] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:55.701722 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a972eb2-31b0-4670-b128-7f86ddb5a912 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3142255c263e44a189db82c621f87e7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:55.702310 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a972eb2-31b0-4670-b128-7f86ddb5a912 service swift] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:55.702686 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a972eb2-31b0-4670-b128-7f86ddb5a912 service swift] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:55.702963 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a972eb2-31b0-4670-b128-7f86ddb5a912 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:55.711706 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a972eb2-31b0-4670-b128-7f86ddb5a912 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:55.713851 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a972eb2-31b0-4670-b128-7f86ddb5a912 service swift] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:55.722144 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1127/2236] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 26 07:53:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 07:53:55.945251 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68bbfdb-9f4c-4a2d-b763-1819fa0736b4 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:55.946729 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-a68bbfdb-9f4c-4a2d-b763-1819fa0736b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:56.008639 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a972eb2-31b0-4670-b128-7f86ddb5a912 service swift] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:56.010977 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-4a972eb2-31b0-4670-b128-7f86ddb5a912 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:56.094891 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68bbfdb-9f4c-4a2d-b763-1819fa0736b4 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:56.100930 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb66db5d-4e2b-46ba-b795-a84565efcd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:56.101676 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66db5d-4e2b-46ba-b795-a84565efcd28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:56.102053 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66db5d-4e2b-46ba-b795-a84565efcd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:56.102388 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66db5d-4e2b-46ba-b795-a84565efcd28 admin admin] PATH_INFO: `/v3/users/97939db97395428f9bf2edc054e8ee4e` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:56.104225 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb66db5d-4e2b-46ba-b795-a84565efcd28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97939db97395428f9bf2edc054e8ee4e)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:56.106521 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb66db5d-4e2b-46ba-b795-a84565efcd28 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:56.133223 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a972eb2-31b0-4670-b128-7f86ddb5a912 service swift] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:56.139254 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34267c90-69f6-44ab-9f26-50c8a3138af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:56.139902 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34267c90-69f6-44ab-9f26-50c8a3138af7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:56.140179 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34267c90-69f6-44ab-9f26-50c8a3138af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:56.140453 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34267c90-69f6-44ab-9f26-50c8a3138af7 admin admin] PATH_INFO: `/v3/users/88141d1191d24a8abf4acde108f591e4` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:56.141622 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34267c90-69f6-44ab-9f26-50c8a3138af7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88141d1191d24a8abf4acde108f591e4)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:56.143617 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34267c90-69f6-44ab-9f26-50c8a3138af7 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:56.429244 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-34267c90-69f6-44ab-9f26-50c8a3138af7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88141d1191d24a8abf4acde108f591e4'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:56.439231 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-34267c90-69f6-44ab-9f26-50c8a3138af7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88141d1191d24a8abf4acde108f591e4'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:56.447981 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-eb66db5d-4e2b-46ba-b795-a84565efcd28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97939db97395428f9bf2edc054e8ee4e'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:56.454158 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-eb66db5d-4e2b-46ba-b795-a84565efcd28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97939db97395428f9bf2edc054e8ee4e'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:56.545863 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-34267c90-69f6-44ab-9f26-50c8a3138af7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88141d1191d24a8abf4acde108f591e4'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:56.546662 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-34267c90-69f6-44ab-9f26-50c8a3138af7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88141d1191d24a8abf4acde108f591e4'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:56.562868 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-34267c90-69f6-44ab-9f26-50c8a3138af7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88141d1191d24a8abf4acde108f591e4'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:56.570962 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1128/2237] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:53:56 2022] DELETE /identity/v3/users/88141d1191d24a8abf4acde108f591e4 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:53:56.575365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f24ad-0dab-4d75-bb56-24ef1be1bc16 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:56.575821 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f24ad-0dab-4d75-bb56-24ef1be1bc16 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:56.576413 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f24ad-0dab-4d75-bb56-24ef1be1bc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:56.600666 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-c84f24ad-0dab-4d75-bb56-24ef1be1bc16 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:56.601830 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-c84f24ad-0dab-4d75-bb56-24ef1be1bc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:56.614340 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-eb66db5d-4e2b-46ba-b795-a84565efcd28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97939db97395428f9bf2edc054e8ee4e'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:56.615093 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-eb66db5d-4e2b-46ba-b795-a84565efcd28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97939db97395428f9bf2edc054e8ee4e'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:56.623674 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-eb66db5d-4e2b-46ba-b795-a84565efcd28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97939db97395428f9bf2edc054e8ee4e'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:56.657028 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1110/2238] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:53:55 2022] DELETE /identity/v3/users/97939db97395428f9bf2edc054e8ee4e => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:53:56.658682 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c329375-4d0e-4aa1-b56e-3bd01fbf9298 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:56.659863 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c329375-4d0e-4aa1-b56e-3bd01fbf9298 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:56.660319 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c329375-4d0e-4aa1-b56e-3bd01fbf9298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:56.688355 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1129/2239] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:53:56.691622 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac93fb-88dd-4bf5-9f4b-fd94100c0a66 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:56.691622 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac93fb-88dd-4bf5-9f4b-fd94100c0a66 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:56.691622 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac93fb-88dd-4bf5-9f4b-fd94100c0a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:56.696372 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-3c329375-4d0e-4aa1-b56e-3bd01fbf9298 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:56.697687 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-3c329375-4d0e-4aa1-b56e-3bd01fbf9298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:56.712200 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-d8ac93fb-88dd-4bf5-9f4b-fd94100c0a66 None None] MFA Rules not processed for user `30dc2621143f4604b53bb44b82e8efbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:56.714222 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-d8ac93fb-88dd-4bf5-9f4b-fd94100c0a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:56.775129 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1111/2240] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:53:56.777056 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c329375-4d0e-4aa1-b56e-3bd01fbf9298 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:56.780764 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-3c329375-4d0e-4aa1-b56e-3bd01fbf9298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:56.796759 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1130/2241] 10.222.0.42 () {58 vars in 967 bytes} [Fri Aug 26 07:53:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:53:56.797633 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac93fb-88dd-4bf5-9f4b-fd94100c0a66 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:56.798946 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-d8ac93fb-88dd-4bf5-9f4b-fd94100c0a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:56.868436 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c329375-4d0e-4aa1-b56e-3bd01fbf9298 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:56.876228 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931c5f1-b6bd-492f-9db8-a00fb8452ae5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:56.876228 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931c5f1-b6bd-492f-9db8-a00fb8452ae5 service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:56.876228 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931c5f1-b6bd-492f-9db8-a00fb8452ae5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:56.876228 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931c5f1-b6bd-492f-9db8-a00fb8452ae5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:56.877876 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac93fb-88dd-4bf5-9f4b-fd94100c0a66 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:56.882286 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496bb8a-fe56-4299-9277-ad29fa00fa8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:56.882902 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496bb8a-fe56-4299-9277-ad29fa00fa8d service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:56.883797 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496bb8a-fe56-4299-9277-ad29fa00fa8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:56.884084 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496bb8a-fe56-4299-9277-ad29fa00fa8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:56.888310 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1931c5f1-b6bd-492f-9db8-a00fb8452ae5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:56.889826 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1931c5f1-b6bd-492f-9db8-a00fb8452ae5 service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:56.897473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9496bb8a-fe56-4299-9277-ad29fa00fa8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:56.899577 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9496bb8a-fe56-4299-9277-ad29fa00fa8d service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:56.902398 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1112/2242] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:53:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:53:56.903071 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931c5f1-b6bd-492f-9db8-a00fb8452ae5 service neutron] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:56.904788 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-1931c5f1-b6bd-492f-9db8-a00fb8452ae5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:56.939648 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1131/2243] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:53:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:53:57.003626 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931c5f1-b6bd-492f-9db8-a00fb8452ae5 service neutron] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:57.012050 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cbe467-b9ae-4295-a0f3-7b4eac8ad428 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3142255c263e44a189db82c621f87e7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:57.012842 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cbe467-b9ae-4295-a0f3-7b4eac8ad428 service swift] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:57.013197 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cbe467-b9ae-4295-a0f3-7b4eac8ad428 service swift] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:57.013535 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cbe467-b9ae-4295-a0f3-7b4eac8ad428 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:57.023434 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cbe467-b9ae-4295-a0f3-7b4eac8ad428 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:57.025050 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cbe467-b9ae-4295-a0f3-7b4eac8ad428 service swift] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:57.034655 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1113/2244] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 26 07:53:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 07:53:57.398880 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:53:57.536328 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:53:57.678474 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496bb8a-fe56-4299-9277-ad29fa00fa8d service neutron] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:57.680999 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-9496bb8a-fe56-4299-9277-ad29fa00fa8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:57.700327 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496bb8a-fe56-4299-9277-ad29fa00fa8d service neutron] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:57.719106 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df05e9-c36a-4fcf-89cc-1342e4cd170f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:57.720109 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df05e9-c36a-4fcf-89cc-1342e4cd170f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:57.720535 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df05e9-c36a-4fcf-89cc-1342e4cd170f admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:57.720964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df05e9-c36a-4fcf-89cc-1342e4cd170f admin admin] PATH_INFO: `/v3/projects/231de962a18f49968c3738c20c596a52` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:57.722631 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df05e9-c36a-4fcf-89cc-1342e4cd170f admin admin] RBAC: Authorizing `identity:delete_project(project_id=231de962a18f49968c3738c20c596a52)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:57.725867 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df05e9-c36a-4fcf-89cc-1342e4cd170f admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:57.746918 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cbe467-b9ae-4295-a0f3-7b4eac8ad428 service swift] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:57.751747 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-00cbe467-b9ae-4295-a0f3-7b4eac8ad428 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:57.782655 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cbe467-b9ae-4295-a0f3-7b4eac8ad428 service swift] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:57.792226 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1926aa02-6814-461d-9334-fad93a5d4aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:57.792226 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926aa02-6814-461d-9334-fad93a5d4aff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:57.792226 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926aa02-6814-461d-9334-fad93a5d4aff admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:57.792226 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926aa02-6814-461d-9334-fad93a5d4aff admin admin] PATH_INFO: `/v3/projects/c6d9c0a041a84581922a42155f2f9137` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:57.793989 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1926aa02-6814-461d-9334-fad93a5d4aff admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6d9c0a041a84581922a42155f2f9137)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:57.798142 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1926aa02-6814-461d-9334-fad93a5d4aff admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:57.902278 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-63df05e9-c36a-4fcf-89cc-1342e4cd170f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '231de962a18f49968c3738c20c596a52', 'request_id': 'req-63df05e9-c36a-4fcf-89cc-1342e4cd170f'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:57.907797 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-63df05e9-c36a-4fcf-89cc-1342e4cd170f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '231de962a18f49968c3738c20c596a52', 'request_id': 'req-63df05e9-c36a-4fcf-89cc-1342e4cd170f'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:57.914246 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-63df05e9-c36a-4fcf-89cc-1342e4cd170f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '231de962a18f49968c3738c20c596a52', 'request_id': 'req-63df05e9-c36a-4fcf-89cc-1342e4cd170f'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:58.039288 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-1926aa02-6814-461d-9334-fad93a5d4aff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6d9c0a041a84581922a42155f2f9137', 'request_id': 'req-1926aa02-6814-461d-9334-fad93a5d4aff'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:58.051071 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-63df05e9-c36a-4fcf-89cc-1342e4cd170f admin admin] The token cache is being invalidate because project 231de962a18f49968c3738c20c596a52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:53:58.051374 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-63df05e9-c36a-4fcf-89cc-1342e4cd170f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:58.053615 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-63df05e9-c36a-4fcf-89cc-1342e4cd170f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:58.057236 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1132/2245] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:53:57 2022] DELETE /identity/v3/projects/231de962a18f49968c3738c20c596a52 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:53:58.058536 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-1926aa02-6814-461d-9334-fad93a5d4aff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6d9c0a041a84581922a42155f2f9137', 'request_id': 'req-1926aa02-6814-461d-9334-fad93a5d4aff'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:58.061267 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a5901-ee7d-474b-a257-bd9b447b62fa None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:58.061553 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a5901-ee7d-474b-a257-bd9b447b62fa None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:58.062316 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a5901-ee7d-474b-a257-bd9b447b62fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:58.090458 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-6e4a5901-ee7d-474b-a257-bd9b447b62fa None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:58.091727 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-6e4a5901-ee7d-474b-a257-bd9b447b62fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:58.163388 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-1926aa02-6814-461d-9334-fad93a5d4aff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6d9c0a041a84581922a42155f2f9137', 'request_id': 'req-1926aa02-6814-461d-9334-fad93a5d4aff'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:58.175378 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1133/2246] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:53:58.175565 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-1926aa02-6814-461d-9334-fad93a5d4aff admin admin] The token cache is being invalidate because project c6d9c0a041a84581922a42155f2f9137 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:53:58.175764 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-1926aa02-6814-461d-9334-fad93a5d4aff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:58.176536 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-1926aa02-6814-461d-9334-fad93a5d4aff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:58.178049 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1114/2247] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:53:57 2022] DELETE /identity/v3/projects/c6d9c0a041a84581922a42155f2f9137 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:53:58.184943 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8c486-130c-49b1-9dd5-8f546cf1d15e None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:58.185425 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8c486-130c-49b1-9dd5-8f546cf1d15e None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:58.185747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8c486-130c-49b1-9dd5-8f546cf1d15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:58.186023 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d2148-1b1b-46f1-8edb-1518f18deac6 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:58.186330 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d2148-1b1b-46f1-8edb-1518f18deac6 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:58.186610 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d2148-1b1b-46f1-8edb-1518f18deac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:58.207822 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-47f8c486-130c-49b1-9dd5-8f546cf1d15e None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:58.208028 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-0e2d2148-1b1b-46f1-8edb-1518f18deac6 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:58.209020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-47f8c486-130c-49b1-9dd5-8f546cf1d15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:58.209119 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-0e2d2148-1b1b-46f1-8edb-1518f18deac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:58.217703 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1115/2248] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:53:58.218861 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1134/2249] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:53:58.225999 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d2148-1b1b-46f1-8edb-1518f18deac6 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:58.226440 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4683a43-53ba-478e-a19c-76654d18dc7f None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:58.226726 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4683a43-53ba-478e-a19c-76654d18dc7f None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:58.227011 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4683a43-53ba-478e-a19c-76654d18dc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:58.241889 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d2148-1b1b-46f1-8edb-1518f18deac6 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:58.248478 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04953e8-1f4b-442f-aaaf-aa26f8ec3644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:58.249067 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04953e8-1f4b-442f-aaaf-aa26f8ec3644 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:58.249352 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04953e8-1f4b-442f-aaaf-aa26f8ec3644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:58.249628 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04953e8-1f4b-442f-aaaf-aa26f8ec3644 admin admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:58.249960 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-d4683a43-53ba-478e-a19c-76654d18dc7f None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:58.250282 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04953e8-1f4b-442f-aaaf-aa26f8ec3644 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:53:58.250585 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04953e8-1f4b-442f-aaaf-aa26f8ec3644 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:58.251494 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-d4683a43-53ba-478e-a19c-76654d18dc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:58.252291 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04953e8-1f4b-442f-aaaf-aa26f8ec3644 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:58.261791 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1135/2250] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:53:58.265895 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4683a43-53ba-478e-a19c-76654d18dc7f None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:58.269194 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1116/2251] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:53:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:53:58.274074 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04953e8-1f4b-442f-aaaf-aa26f8ec3644 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:58.275183 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4683a43-53ba-478e-a19c-76654d18dc7f None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:58.281246 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34056237-0b48-4d95-8c44-96a4ad91cc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:58.282015 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34056237-0b48-4d95-8c44-96a4ad91cc66 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:58.282140 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34056237-0b48-4d95-8c44-96a4ad91cc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:58.282419 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34056237-0b48-4d95-8c44-96a4ad91cc66 admin admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:58.283114 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34056237-0b48-4d95-8c44-96a4ad91cc66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:53:58.283422 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34056237-0b48-4d95-8c44-96a4ad91cc66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:58.285012 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34056237-0b48-4d95-8c44-96a4ad91cc66 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:58.295063 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04953e8-1f4b-442f-aaaf-aa26f8ec3644 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:58.298561 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1136/2252] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:53:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:53:58.303072 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34056237-0b48-4d95-8c44-96a4ad91cc66 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:58.307871 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc0c8a-8cc1-438f-a2cc-af576cc10dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:58.308667 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc0c8a-8cc1-438f-a2cc-af576cc10dee admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:58.308951 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc0c8a-8cc1-438f-a2cc-af576cc10dee admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:58.309231 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc0c8a-8cc1-438f-a2cc-af576cc10dee admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:58.309863 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc0c8a-8cc1-438f-a2cc-af576cc10dee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:58.311966 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc0c8a-8cc1-438f-a2cc-af576cc10dee admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:58.319049 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34056237-0b48-4d95-8c44-96a4ad91cc66 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:58.324876 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba89fd-acf8-44df-a9ad-2bbace0ce89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:58.325711 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba89fd-acf8-44df-a9ad-2bbace0ce89f admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:58.326004 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba89fd-acf8-44df-a9ad-2bbace0ce89f admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:58.326284 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba89fd-acf8-44df-a9ad-2bbace0ce89f admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:58.326917 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba89fd-acf8-44df-a9ad-2bbace0ce89f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:58.328855 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba89fd-acf8-44df-a9ad-2bbace0ce89f admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:58.502218 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1117/2253] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:53:58 2022] POST /identity/v3/projects => generated 383 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:53:58.503012 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc0c8a-8cc1-438f-a2cc-af576cc10dee admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:58.504917 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1137/2254] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:53:58 2022] POST /identity/v3/projects => generated 375 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:53:58.505957 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba89fd-acf8-44df-a9ad-2bbace0ce89f admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:58.632313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba89fd-acf8-44df-a9ad-2bbace0ce89f admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:58.667518 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc0c8a-8cc1-438f-a2cc-af576cc10dee admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:58.680511 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f075d7-4a96-4c8f-bcda-26de0f6c5401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:58.683416 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f075d7-4a96-4c8f-bcda-26de0f6c5401 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:58.684113 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f075d7-4a96-4c8f-bcda-26de0f6c5401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:58.684459 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f075d7-4a96-4c8f-bcda-26de0f6c5401 admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:58.685911 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f075d7-4a96-4c8f-bcda-26de0f6c5401 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:58.691041 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f075d7-4a96-4c8f-bcda-26de0f6c5401 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:58.764127 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae6f06a-dde1-4b04-ba20-e96279300eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:58.764763 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6f06a-dde1-4b04-ba20-e96279300eeb admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:58.765046 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6f06a-dde1-4b04-ba20-e96279300eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:58.765323 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6f06a-dde1-4b04-ba20-e96279300eeb admin admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:58.765963 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae6f06a-dde1-4b04-ba20-e96279300eeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:58.770249 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae6f06a-dde1-4b04-ba20-e96279300eeb admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:58.822530 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1118/2255] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:53:58 2022] POST /identity/v3/users => generated 288 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:53:58.828731 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f075d7-4a96-4c8f-bcda-26de0f6c5401 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:58.840405 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f075d7-4a96-4c8f-bcda-26de0f6c5401 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:58.851192 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb33dc4-56f0-453a-bc82-68612a91bc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:58.854293 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb33dc4-56f0-453a-bc82-68612a91bc19 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:58.854907 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb33dc4-56f0-453a-bc82-68612a91bc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:58.855893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb33dc4-56f0-453a-bc82-68612a91bc19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:58.856622 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb33dc4-56f0-453a-bc82-68612a91bc19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:58.859533 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb33dc4-56f0-453a-bc82-68612a91bc19 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:58.878790 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1119/2256] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:53:58.883012 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb33dc4-56f0-453a-bc82-68612a91bc19 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:58.884735 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-7fb33dc4-56f0-453a-bc82-68612a91bc19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:58.895188 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1138/2257] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:53:58 2022] POST /identity/v3/users => generated 292 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:53:58.895188 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae6f06a-dde1-4b04-ba20-e96279300eeb admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:58.904934 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb33dc4-56f0-453a-bc82-68612a91bc19 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:58.908895 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae6f06a-dde1-4b04-ba20-e96279300eeb admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:58.911350 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e2a03-fbce-48a6-b896-763c22616ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:58.911350 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e2a03-fbce-48a6-b896-763c22616ec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:58.911350 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e2a03-fbce-48a6-b896-763c22616ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:58.911350 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e2a03-fbce-48a6-b896-763c22616ec3 admin admin] PATH_INFO: `/v3/users/ce532d5e1a3d4fc9ab7e4d80eb5528b9` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:58.913158 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e2a03-fbce-48a6-b896-763c22616ec3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce532d5e1a3d4fc9ab7e4d80eb5528b9)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:58.916969 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e2a03-fbce-48a6-b896-763c22616ec3 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:58.919231 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe816f-b7fa-498b-bf23-c610a921ad7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:58.920742 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe816f-b7fa-498b-bf23-c610a921ad7d admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:58.921358 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe816f-b7fa-498b-bf23-c610a921ad7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:58.921735 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe816f-b7fa-498b-bf23-c610a921ad7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:58.922633 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe816f-b7fa-498b-bf23-c610a921ad7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:58.925666 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe816f-b7fa-498b-bf23-c610a921ad7d admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:58.942524 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1139/2258] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:53:58.943353 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe816f-b7fa-498b-bf23-c610a921ad7d admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:58.954894 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe816f-b7fa-498b-bf23-c610a921ad7d admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:58.960519 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802fffb-3050-47a1-a034-57b6ed4bbb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:58.961737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802fffb-3050-47a1-a034-57b6ed4bbb77 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:58.962102 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802fffb-3050-47a1-a034-57b6ed4bbb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:58.962364 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802fffb-3050-47a1-a034-57b6ed4bbb77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:58.968927 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802fffb-3050-47a1-a034-57b6ed4bbb77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:58.968927 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802fffb-3050-47a1-a034-57b6ed4bbb77 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:58.987260 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1140/2259] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:53:58.988217 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802fffb-3050-47a1-a034-57b6ed4bbb77 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:59.003187 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802fffb-3050-47a1-a034-57b6ed4bbb77 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:59.008938 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a4c59-041c-48da-ae6a-73a30bebeaf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:59.015411 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a4c59-041c-48da-ae6a-73a30bebeaf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:59.015411 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a4c59-041c-48da-ae6a-73a30bebeaf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:59.015411 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a4c59-041c-48da-ae6a-73a30bebeaf5 admin admin] PATH_INFO: `/v3/projects/882178acd9eb40ea9fe77fe8a6345197/users/635848f5456445a8b14cb7d9512e6768/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:59.029111 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63a4c59-041c-48da-ae6a-73a30bebeaf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=882178acd9eb40ea9fe77fe8a6345197, user_id=635848f5456445a8b14cb7d9512e6768, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:59.032110 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63a4c59-041c-48da-ae6a-73a30bebeaf5 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:59.170805 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1141/2260] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:53:58 2022] PUT /identity/v3/projects/882178acd9eb40ea9fe77fe8a6345197/users/635848f5456445a8b14cb7d9512e6768/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:53:59.174037 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a4c59-041c-48da-ae6a-73a30bebeaf5 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:59.224744 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-9c4e2a03-fbce-48a6-b896-763c22616ec3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce532d5e1a3d4fc9ab7e4d80eb5528b9'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:59.225394 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-9c4e2a03-fbce-48a6-b896-763c22616ec3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce532d5e1a3d4fc9ab7e4d80eb5528b9'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:59.249719 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a4c59-041c-48da-ae6a-73a30bebeaf5 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:59.254577 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932f563-c08c-47fb-8326-03df7f8679dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:59.262521 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932f563-c08c-47fb-8326-03df7f8679dc admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:59.262521 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932f563-c08c-47fb-8326-03df7f8679dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:59.262521 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932f563-c08c-47fb-8326-03df7f8679dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:59.262521 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3932f563-c08c-47fb-8326-03df7f8679dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:59.262521 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3932f563-c08c-47fb-8326-03df7f8679dc admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:59.268819 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1142/2261] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:53:59.270061 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee08d60-b62d-40c1-8a20-ca349aced6b8 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:59.270348 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee08d60-b62d-40c1-8a20-ca349aced6b8 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:59.270747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee08d60-b62d-40c1-8a20-ca349aced6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:59.308809 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-4ee08d60-b62d-40c1-8a20-ca349aced6b8 None None] MFA Rules not processed for user `635848f5456445a8b14cb7d9512e6768`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:59.310110 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-4ee08d60-b62d-40c1-8a20-ca349aced6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:59.322353 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-9c4e2a03-fbce-48a6-b896-763c22616ec3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce532d5e1a3d4fc9ab7e4d80eb5528b9'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:59.325436 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-9c4e2a03-fbce-48a6-b896-763c22616ec3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce532d5e1a3d4fc9ab7e4d80eb5528b9'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:59.335463 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-9c4e2a03-fbce-48a6-b896-763c22616ec3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce532d5e1a3d4fc9ab7e4d80eb5528b9'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:53:59.381105 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1120/2262] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:53:58 2022] DELETE /identity/v3/users/ce532d5e1a3d4fc9ab7e4d80eb5528b9 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:53:59.382354 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e2a03-fbce-48a6-b896-763c22616ec3 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:59.394254 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-9c4e2a03-fbce-48a6-b896-763c22616ec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:59.423873 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1143/2263] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:53:59.425619 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754400e5-08a2-45db-b5d8-7cc28cee4797 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:59.425914 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754400e5-08a2-45db-b5d8-7cc28cee4797 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:59.426189 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754400e5-08a2-45db-b5d8-7cc28cee4797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:59.459678 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-754400e5-08a2-45db-b5d8-7cc28cee4797 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:59.462230 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-754400e5-08a2-45db-b5d8-7cc28cee4797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:59.573456 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e2a03-fbce-48a6-b896-763c22616ec3 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:59.580001 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a256fee0-3d33-43ef-840e-5291d2f96051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:59.580851 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256fee0-3d33-43ef-840e-5291d2f96051 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:59.581976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256fee0-3d33-43ef-840e-5291d2f96051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:59.581976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256fee0-3d33-43ef-840e-5291d2f96051 admin admin] PATH_INFO: `/v3/projects/9c5c264dadeb460793cd6495b24716a7/users/6da9f1a22fc846ac90cd23dad2ac8c8e/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:59.599727 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1144/2264] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:53:59.600785 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754400e5-08a2-45db-b5d8-7cc28cee4797 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:59.602283 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-754400e5-08a2-45db-b5d8-7cc28cee4797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:59.609287 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a256fee0-3d33-43ef-840e-5291d2f96051 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c5c264dadeb460793cd6495b24716a7, user_id=6da9f1a22fc846ac90cd23dad2ac8c8e, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:59.612181 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a256fee0-3d33-43ef-840e-5291d2f96051 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:59.660515 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754400e5-08a2-45db-b5d8-7cc28cee4797 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:59.664381 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19c166-252e-4ed7-9551-91fb73fe10b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:59.664993 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19c166-252e-4ed7-9551-91fb73fe10b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:59.665274 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19c166-252e-4ed7-9551-91fb73fe10b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:59.665555 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19c166-252e-4ed7-9551-91fb73fe10b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:59.734955 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e19c166-252e-4ed7-9551-91fb73fe10b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:53:59.736354 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e19c166-252e-4ed7-9551-91fb73fe10b3 service cinder] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:53:59.745475 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1145/2265] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:53:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:53:59.746297 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19c166-252e-4ed7-9551-91fb73fe10b3 service cinder] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:53:59.747653 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-1e19c166-252e-4ed7-9551-91fb73fe10b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:59.797000 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1121/2266] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:53:59 2022] PUT /identity/v3/projects/9c5c264dadeb460793cd6495b24716a7/users/6da9f1a22fc846ac90cd23dad2ac8c8e/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:53:59.798976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c2719-81b9-4f05-8099-3ea971dd69e5 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:59.799468 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c2719-81b9-4f05-8099-3ea971dd69e5 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:59.799896 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c2719-81b9-4f05-8099-3ea971dd69e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:53:59.815762 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19c166-252e-4ed7-9551-91fb73fe10b3 service cinder] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:53:59.837858 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-6f5c2719-81b9-4f05-8099-3ea971dd69e5 None None] MFA Rules not processed for user `6da9f1a22fc846ac90cd23dad2ac8c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:53:59.839987 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-6f5c2719-81b9-4f05-8099-3ea971dd69e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:53:59.916535 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b282366-7ad2-4ba2-91ef-49b9be565bce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:53:59.918161 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b282366-7ad2-4ba2-91ef-49b9be565bce service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:53:59.918451 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b282366-7ad2-4ba2-91ef-49b9be565bce service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:53:59.918775 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b282366-7ad2-4ba2-91ef-49b9be565bce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:00.003054 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1122/2267] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:53:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:54:00.018637 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c2719-81b9-4f05-8099-3ea971dd69e5 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:00.019037 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b282366-7ad2-4ba2-91ef-49b9be565bce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:00.020634 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b282366-7ad2-4ba2-91ef-49b9be565bce service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:00.032561 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1146/2268] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:53:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:54:00.046657 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c2719-81b9-4f05-8099-3ea971dd69e5 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:00.053496 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283acfd6-48f2-4da4-932a-3a72089776e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:00.054275 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283acfd6-48f2-4da4-932a-3a72089776e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:00.054624 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283acfd6-48f2-4da4-932a-3a72089776e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:00.054968 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283acfd6-48f2-4da4-932a-3a72089776e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:00.055701 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283acfd6-48f2-4da4-932a-3a72089776e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:00.057794 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283acfd6-48f2-4da4-932a-3a72089776e6 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:00.218406 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1123/2269] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:54:00 2022] POST /identity/v3/projects => generated 385 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 07:54:00.219586 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b282366-7ad2-4ba2-91ef-49b9be565bce service neutron] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:00.229973 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b282366-7ad2-4ba2-91ef-49b9be565bce service neutron] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:00.307556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a11171-ebd3-4eb0-b48f-5ee455dd9e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:00.308499 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a11171-ebd3-4eb0-b48f-5ee455dd9e89 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:00.308776 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a11171-ebd3-4eb0-b48f-5ee455dd9e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:00.309045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a11171-ebd3-4eb0-b48f-5ee455dd9e89 admin admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:00.309677 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a11171-ebd3-4eb0-b48f-5ee455dd9e89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:00.312123 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a11171-ebd3-4eb0-b48f-5ee455dd9e89 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:00.375204 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:00.476342 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1147/2270] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:54:00 2022] POST /identity/v3/users => generated 293 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:54:00.478319 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283acfd6-48f2-4da4-932a-3a72089776e6 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:00.497743 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283acfd6-48f2-4da4-932a-3a72089776e6 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:00.502890 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5622cb-3021-46d4-a29a-5fe509578a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:00.503647 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5622cb-3021-46d4-a29a-5fe509578a7e admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:00.504297 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5622cb-3021-46d4-a29a-5fe509578a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:00.504297 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5622cb-3021-46d4-a29a-5fe509578a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:00.506875 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5622cb-3021-46d4-a29a-5fe509578a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:00.507571 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5622cb-3021-46d4-a29a-5fe509578a7e admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:00.528486 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1124/2271] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:54:00.533894 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a11171-ebd3-4eb0-b48f-5ee455dd9e89 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:00.546492 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a11171-ebd3-4eb0-b48f-5ee455dd9e89 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:00.552004 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef0de2-aa8c-4552-b168-7cff818336fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:00.552752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef0de2-aa8c-4552-b168-7cff818336fd admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:00.562866 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef0de2-aa8c-4552-b168-7cff818336fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:00.563360 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef0de2-aa8c-4552-b168-7cff818336fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:00.564081 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef0de2-aa8c-4552-b168-7cff818336fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:00.565717 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef0de2-aa8c-4552-b168-7cff818336fd admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:00.579573 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1148/2272] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:54:00.584278 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5622cb-3021-46d4-a29a-5fe509578a7e admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:00.600555 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5622cb-3021-46d4-a29a-5fe509578a7e admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:00.602038 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef0de2-aa8c-4552-b168-7cff818336fd admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:00.605508 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-cfef0de2-aa8c-4552-b168-7cff818336fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:00.606318 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1ce19-ceb4-40a9-9263-d3cfd9538e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:00.607206 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1ce19-ceb4-40a9-9263-d3cfd9538e5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:00.607596 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1ce19-ceb4-40a9-9263-d3cfd9538e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:00.608026 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1ce19-ceb4-40a9-9263-d3cfd9538e5c admin admin] PATH_INFO: `/v3/projects/b8f0086aae8f495a92f42f5b4a316264/users/e7840c0a0b6a4771bad32301d260f783/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:00.623683 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef0de2-aa8c-4552-b168-7cff818336fd admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:00.628583 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf1ce19-ceb4-40a9-9263-d3cfd9538e5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8f0086aae8f495a92f42f5b4a316264, user_id=e7840c0a0b6a4771bad32301d260f783, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:00.640411 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf1ce19-ceb4-40a9-9263-d3cfd9538e5c admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:00.640578 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abecaab3-180c-4018-9627-b062f38fca76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:00.640578 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abecaab3-180c-4018-9627-b062f38fca76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:00.640578 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abecaab3-180c-4018-9627-b062f38fca76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:00.640578 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abecaab3-180c-4018-9627-b062f38fca76 admin admin] PATH_INFO: `/v3/users/42a79f8e69c047868600e80a6e908fe8` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:00.640941 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abecaab3-180c-4018-9627-b062f38fca76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42a79f8e69c047868600e80a6e908fe8)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:00.642826 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abecaab3-180c-4018-9627-b062f38fca76 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:00.840010 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1125/2273] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:54:00 2022] PUT /identity/v3/projects/b8f0086aae8f495a92f42f5b4a316264/users/e7840c0a0b6a4771bad32301d260f783/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:54:00.841431 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1ce19-ceb4-40a9-9263-d3cfd9538e5c admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:00.843473 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-aaf1ce19-ceb4-40a9-9263-d3cfd9538e5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:00.959867 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1ce19-ceb4-40a9-9263-d3cfd9538e5c admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:00.965851 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9528c-061a-431c-8667-2da08877edcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:00.966525 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9528c-061a-431c-8667-2da08877edcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:00.966810 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9528c-061a-431c-8667-2da08877edcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:00.967128 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9528c-061a-431c-8667-2da08877edcb admin admin] PATH_INFO: `/v3/projects/279bdeaf89a24b2d94b12bb98949978a` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:00.968464 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc9528c-061a-431c-8667-2da08877edcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=279bdeaf89a24b2d94b12bb98949978a)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:00.970527 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc9528c-061a-431c-8667-2da08877edcb admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:01.061251 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-abecaab3-180c-4018-9627-b062f38fca76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42a79f8e69c047868600e80a6e908fe8'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:01.076798 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-abecaab3-180c-4018-9627-b062f38fca76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42a79f8e69c047868600e80a6e908fe8'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:01.164536 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-7fc9528c-061a-431c-8667-2da08877edcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '279bdeaf89a24b2d94b12bb98949978a', 'request_id': 'req-7fc9528c-061a-431c-8667-2da08877edcb'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:01.172189 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-7fc9528c-061a-431c-8667-2da08877edcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '279bdeaf89a24b2d94b12bb98949978a', 'request_id': 'req-7fc9528c-061a-431c-8667-2da08877edcb'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:01.183093 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-abecaab3-180c-4018-9627-b062f38fca76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42a79f8e69c047868600e80a6e908fe8'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:01.183827 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-abecaab3-180c-4018-9627-b062f38fca76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42a79f8e69c047868600e80a6e908fe8'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:01.202427 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-abecaab3-180c-4018-9627-b062f38fca76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42a79f8e69c047868600e80a6e908fe8'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:01.211004 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1149/2274] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:54:00 2022] DELETE /identity/v3/users/42a79f8e69c047868600e80a6e908fe8 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:54:01.213301 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e6f39-13b7-4283-b161-253d353a03ff None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:01.213806 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e6f39-13b7-4283-b161-253d353a03ff None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:01.214627 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e6f39-13b7-4283-b161-253d353a03ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:01.249118 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-c68e6f39-13b7-4283-b161-253d353a03ff None None] MFA Rules not processed for user `e7840c0a0b6a4771bad32301d260f783`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:54:01.250410 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-c68e6f39-13b7-4283-b161-253d353a03ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:01.340692 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-7fc9528c-061a-431c-8667-2da08877edcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '279bdeaf89a24b2d94b12bb98949978a', 'request_id': 'req-7fc9528c-061a-431c-8667-2da08877edcb'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:01.347840 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1150/2275] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:54:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:54:01.352850 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c4caf-8df1-4efa-a3bf-a19b82d7e2d5 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:01.354559 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c4caf-8df1-4efa-a3bf-a19b82d7e2d5 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:01.354954 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c4caf-8df1-4efa-a3bf-a19b82d7e2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:01.359539 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-7fc9528c-061a-431c-8667-2da08877edcb admin admin] The token cache is being invalidate because project 279bdeaf89a24b2d94b12bb98949978a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:54:01.359933 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-7fc9528c-061a-431c-8667-2da08877edcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:01.360618 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-7fc9528c-061a-431c-8667-2da08877edcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:01.371453 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1126/2276] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:54:00 2022] DELETE /identity/v3/projects/279bdeaf89a24b2d94b12bb98949978a => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:54:01.372714 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9528c-061a-431c-8667-2da08877edcb admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:01.374150 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-7fc9528c-061a-431c-8667-2da08877edcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:01.380309 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-cf6c4caf-8df1-4efa-a3bf-a19b82d7e2d5 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:54:01.381537 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-cf6c4caf-8df1-4efa-a3bf-a19b82d7e2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:01.497506 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9528c-061a-431c-8667-2da08877edcb admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:01.501448 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1151/2277] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:54:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:54:01.502386 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c4caf-8df1-4efa-a3bf-a19b82d7e2d5 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:01.503857 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-cf6c4caf-8df1-4efa-a3bf-a19b82d7e2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:01.513348 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d00e3d-fbe9-4063-a389-afcaec95b9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:01.515658 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d00e3d-fbe9-4063-a389-afcaec95b9e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:01.516759 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d00e3d-fbe9-4063-a389-afcaec95b9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:01.517216 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d00e3d-fbe9-4063-a389-afcaec95b9e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:01.518071 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d00e3d-fbe9-4063-a389-afcaec95b9e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:01.518807 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c4caf-8df1-4efa-a3bf-a19b82d7e2d5 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:01.535786 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d00e3d-fbe9-4063-a389-afcaec95b9e7 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:01.535933 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e21910-9751-4729-adec-348a8df3fc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:01.535933 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e21910-9751-4729-adec-348a8df3fc08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:01.535933 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e21910-9751-4729-adec-348a8df3fc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:01.535933 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e21910-9751-4729-adec-348a8df3fc08 admin admin] PATH_INFO: `/v3/users/db36bc1c269949aeb7c991e9dec4fb4d` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:01.536240 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e21910-9751-4729-adec-348a8df3fc08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db36bc1c269949aeb7c991e9dec4fb4d)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:01.536240 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e21910-9751-4729-adec-348a8df3fc08 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:01.654815 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1127/2278] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:54:01 2022] POST /identity/v3/projects => generated 383 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:54:01.654815 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d00e3d-fbe9-4063-a389-afcaec95b9e7 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:01.654815 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-b0d00e3d-fbe9-4063-a389-afcaec95b9e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:01.750450 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d00e3d-fbe9-4063-a389-afcaec95b9e7 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:01.756458 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a3683-b4d9-43bb-9f38-69c5273580a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:01.757028 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a3683-b4d9-43bb-9f38-69c5273580a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:01.757367 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a3683-b4d9-43bb-9f38-69c5273580a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:01.757571 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a3683-b4d9-43bb-9f38-69c5273580a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:01.788273 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-d3e21910-9751-4729-adec-348a8df3fc08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db36bc1c269949aeb7c991e9dec4fb4d'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:01.798582 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-d3e21910-9751-4729-adec-348a8df3fc08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db36bc1c269949aeb7c991e9dec4fb4d'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:01.844430 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a3683-b4d9-43bb-9f38-69c5273580a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:01.847210 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a3683-b4d9-43bb-9f38-69c5273580a2 service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:01.865867 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1128/2279] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:54:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:54:01.868082 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a3683-b4d9-43bb-9f38-69c5273580a2 service neutron] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:01.888037 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a3683-b4d9-43bb-9f38-69c5273580a2 service neutron] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:01.898268 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e43c8-874f-43a3-a0ce-73274083e4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:01.899407 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e43c8-874f-43a3-a0ce-73274083e4bd admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:01.901069 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e43c8-874f-43a3-a0ce-73274083e4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:01.901069 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e43c8-874f-43a3-a0ce-73274083e4bd admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:01.901978 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e43c8-874f-43a3-a0ce-73274083e4bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:01.904253 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e43c8-874f-43a3-a0ce-73274083e4bd admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:01.926936 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-d3e21910-9751-4729-adec-348a8df3fc08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db36bc1c269949aeb7c991e9dec4fb4d'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:01.928425 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-d3e21910-9751-4729-adec-348a8df3fc08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db36bc1c269949aeb7c991e9dec4fb4d'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:01.945243 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-d3e21910-9751-4729-adec-348a8df3fc08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db36bc1c269949aeb7c991e9dec4fb4d'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:01.956210 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1152/2280] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:54:01 2022] DELETE /identity/v3/users/db36bc1c269949aeb7c991e9dec4fb4d => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:54:01.999812 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1129/2281] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:54:01 2022] POST /identity/v3/users => generated 298 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:54:02.004320 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e21910-9751-4729-adec-348a8df3fc08 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:02.005967 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-d3e21910-9751-4729-adec-348a8df3fc08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:02.065276 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:02.142153 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e21910-9751-4729-adec-348a8df3fc08 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:02.159338 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c38fd-d5c3-4073-ae90-a00257d4a39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:02.159338 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c38fd-d5c3-4073-ae90-a00257d4a39f admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:02.159338 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c38fd-d5c3-4073-ae90-a00257d4a39f admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:02.159338 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c38fd-d5c3-4073-ae90-a00257d4a39f admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:02.159968 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7c38fd-d5c3-4073-ae90-a00257d4a39f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:02.177851 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7c38fd-d5c3-4073-ae90-a00257d4a39f admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:02.196144 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1153/2282] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:54:02.198497 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e43c8-874f-43a3-a0ce-73274083e4bd admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:02.211536 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e43c8-874f-43a3-a0ce-73274083e4bd admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:02.219418 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466bd3ed-f7f0-40f3-b113-15ea24f764fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:02.221974 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466bd3ed-f7f0-40f3-b113-15ea24f764fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:02.222700 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466bd3ed-f7f0-40f3-b113-15ea24f764fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:02.223191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466bd3ed-f7f0-40f3-b113-15ea24f764fb admin admin] PATH_INFO: `/v3/projects/d71aa52b059646ff952d6d5a9b4e067d/users/d5e622a7df1f4d4abcfaa2ea6bce4052/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:02.249240 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466bd3ed-f7f0-40f3-b113-15ea24f764fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d71aa52b059646ff952d6d5a9b4e067d, user_id=d5e622a7df1f4d4abcfaa2ea6bce4052, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:02.257942 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466bd3ed-f7f0-40f3-b113-15ea24f764fb admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:02.395461 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1130/2283] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:54:02 2022] PUT /identity/v3/projects/d71aa52b059646ff952d6d5a9b4e067d/users/d5e622a7df1f4d4abcfaa2ea6bce4052/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:54:02.398394 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c38fd-d5c3-4073-ae90-a00257d4a39f admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:02.415111 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c38fd-d5c3-4073-ae90-a00257d4a39f admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:02.498964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c223d-3cca-45fa-8837-033da17e0b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:02.499830 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c223d-3cca-45fa-8837-033da17e0b4e admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:02.500112 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c223d-3cca-45fa-8837-033da17e0b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:02.500473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c223d-3cca-45fa-8837-033da17e0b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:02.501206 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c223d-3cca-45fa-8837-033da17e0b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:02.503045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c223d-3cca-45fa-8837-033da17e0b4e admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:02.523683 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466bd3ed-f7f0-40f3-b113-15ea24f764fb admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:02.526192 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-466bd3ed-f7f0-40f3-b113-15ea24f764fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:02.557900 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466bd3ed-f7f0-40f3-b113-15ea24f764fb admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:02.570814 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1154/2284] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 07:54:02.570814 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c223d-3cca-45fa-8837-033da17e0b4e admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:02.572756 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90d31f-ed5e-41de-9902-54262a24a6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:02.573786 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90d31f-ed5e-41de-9902-54262a24a6af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:02.574086 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90d31f-ed5e-41de-9902-54262a24a6af admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:02.574367 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90d31f-ed5e-41de-9902-54262a24a6af admin admin] PATH_INFO: `/v3/projects/c0787699706f44eb8a198533f0cc1569` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:02.575876 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90d31f-ed5e-41de-9902-54262a24a6af admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0787699706f44eb8a198533f0cc1569)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:02.577829 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90d31f-ed5e-41de-9902-54262a24a6af admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:02.605112 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c223d-3cca-45fa-8837-033da17e0b4e admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:02.623109 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6652e1b4-7d25-4a13-9529-9dfdc6f962df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:02.623894 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652e1b4-7d25-4a13-9529-9dfdc6f962df admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:02.624185 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652e1b4-7d25-4a13-9529-9dfdc6f962df admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:02.625312 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652e1b4-7d25-4a13-9529-9dfdc6f962df admin admin] PATH_INFO: `/v3/projects/d71aa52b059646ff952d6d5a9b4e067d/users/d5e622a7df1f4d4abcfaa2ea6bce4052/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:02.627672 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6652e1b4-7d25-4a13-9529-9dfdc6f962df admin admin] RBAC: Authorizing `identity:create_grant(project_id=d71aa52b059646ff952d6d5a9b4e067d, user_id=d5e622a7df1f4d4abcfaa2ea6bce4052, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:02.635147 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6652e1b4-7d25-4a13-9529-9dfdc6f962df admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:02.668127 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1155/2285] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:54:02 2022] PUT /identity/v3/projects/d71aa52b059646ff952d6d5a9b4e067d/users/d5e622a7df1f4d4abcfaa2ea6bce4052/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:54:02.670978 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5e653-6f4d-411b-9378-af94705884d2 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:02.671220 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5e653-6f4d-411b-9378-af94705884d2 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:02.671479 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5e653-6f4d-411b-9378-af94705884d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:02.747525 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-eae5e653-6f4d-411b-9378-af94705884d2 None None] MFA Rules not processed for user `d5e622a7df1f4d4abcfaa2ea6bce4052`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:54:02.749579 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-eae5e653-6f4d-411b-9378-af94705884d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:02.827059 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-9a90d31f-ed5e-41de-9902-54262a24a6af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0787699706f44eb8a198533f0cc1569', 'request_id': 'req-9a90d31f-ed5e-41de-9902-54262a24a6af'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:02.833665 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-9a90d31f-ed5e-41de-9902-54262a24a6af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0787699706f44eb8a198533f0cc1569', 'request_id': 'req-9a90d31f-ed5e-41de-9902-54262a24a6af'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:02.878758 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1156/2286] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:54:02 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:54:02.890621 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5e653-6f4d-411b-9378-af94705884d2 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:02.899089 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-eae5e653-6f4d-411b-9378-af94705884d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:02.997344 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5e653-6f4d-411b-9378-af94705884d2 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:03.008713 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-9a90d31f-ed5e-41de-9902-54262a24a6af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0787699706f44eb8a198533f0cc1569', 'request_id': 'req-9a90d31f-ed5e-41de-9902-54262a24a6af'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:03.042614 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-9a90d31f-ed5e-41de-9902-54262a24a6af admin admin] The token cache is being invalidate because project c0787699706f44eb8a198533f0cc1569 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:54:03.042901 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-9a90d31f-ed5e-41de-9902-54262a24a6af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:03.046116 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-9a90d31f-ed5e-41de-9902-54262a24a6af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:03.048235 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1131/2287] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:54:02 2022] DELETE /identity/v3/projects/c0787699706f44eb8a198533f0cc1569 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:54:03.049357 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90d31f-ed5e-41de-9902-54262a24a6af admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:03.051559 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-9a90d31f-ed5e-41de-9902-54262a24a6af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:03.109535 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e6ec1-94b2-47aa-84f1-de9b0e8074c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:03.110326 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e6ec1-94b2-47aa-84f1-de9b0e8074c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:03.110709 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e6ec1-94b2-47aa-84f1-de9b0e8074c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:03.111632 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e6ec1-94b2-47aa-84f1-de9b0e8074c0 admin admin] PATH_INFO: `/v3/projects/1d4333e62f8d4a92b898c88b03a1c60d` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:03.112728 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e6ec1-94b2-47aa-84f1-de9b0e8074c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d4333e62f8d4a92b898c88b03a1c60d)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:03.115443 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e6ec1-94b2-47aa-84f1-de9b0e8074c0 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:03.130563 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90d31f-ed5e-41de-9902-54262a24a6af admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:03.134536 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9435e-22ac-477d-8109-9060a37000c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:03.135397 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9435e-22ac-477d-8109-9060a37000c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:03.135772 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9435e-22ac-477d-8109-9060a37000c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:03.136171 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9435e-22ac-477d-8109-9060a37000c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:03.138249 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-08e9435e-22ac-477d-8109-9060a37000c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:03.231691 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9435e-22ac-477d-8109-9060a37000c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:03.234323 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9435e-22ac-477d-8109-9060a37000c9 service cinder] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:03.258513 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1132/2288] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:54:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:54:03.264156 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67756e77-50ee-4c21-8ce4-6b36d38ce642 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:03.264156 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67756e77-50ee-4c21-8ce4-6b36d38ce642 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:03.264156 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67756e77-50ee-4c21-8ce4-6b36d38ce642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:03.308862 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-67756e77-50ee-4c21-8ce4-6b36d38ce642 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:54:03.313684 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-67756e77-50ee-4c21-8ce4-6b36d38ce642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:03.331212 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-7b5e6ec1-94b2-47aa-84f1-de9b0e8074c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d4333e62f8d4a92b898c88b03a1c60d', 'request_id': 'req-7b5e6ec1-94b2-47aa-84f1-de9b0e8074c0'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:03.353107 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-7b5e6ec1-94b2-47aa-84f1-de9b0e8074c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d4333e62f8d4a92b898c88b03a1c60d', 'request_id': 'req-7b5e6ec1-94b2-47aa-84f1-de9b0e8074c0'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:03.367911 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-7b5e6ec1-94b2-47aa-84f1-de9b0e8074c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d4333e62f8d4a92b898c88b03a1c60d', 'request_id': 'req-7b5e6ec1-94b2-47aa-84f1-de9b0e8074c0'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:03.421241 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:03.446362 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1133/2289] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:54:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:54:03.456848 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a2e0a-8314-46bb-9b18-e14acf6f3da5 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:03.457264 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a2e0a-8314-46bb-9b18-e14acf6f3da5 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:03.457478 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a2e0a-8314-46bb-9b18-e14acf6f3da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:03.493831 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-9d3a2e0a-8314-46bb-9b18-e14acf6f3da5 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:54:03.497831 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-9d3a2e0a-8314-46bb-9b18-e14acf6f3da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:03.502450 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-7b5e6ec1-94b2-47aa-84f1-de9b0e8074c0 admin admin] The token cache is being invalidate because project 1d4333e62f8d4a92b898c88b03a1c60d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:54:03.503084 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-7b5e6ec1-94b2-47aa-84f1-de9b0e8074c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:03.504234 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-7b5e6ec1-94b2-47aa-84f1-de9b0e8074c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:03.507027 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1157/2290] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:54:02 2022] DELETE /identity/v3/projects/1d4333e62f8d4a92b898c88b03a1c60d => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:54:03.510910 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e6ec1-94b2-47aa-84f1-de9b0e8074c0 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:03.513426 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-7b5e6ec1-94b2-47aa-84f1-de9b0e8074c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:03.518799 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1134/2291] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:54:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:54:03.520054 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a2e0a-8314-46bb-9b18-e14acf6f3da5 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:03.532152 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a2e0a-8314-46bb-9b18-e14acf6f3da5 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:03.533572 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e6ec1-94b2-47aa-84f1-de9b0e8074c0 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:03.537764 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acabc0e4-5a9b-4791-afb0-02dbbd977be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:03.538478 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabc0e4-5a9b-4791-afb0-02dbbd977be9 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:03.538695 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9a6fa-12ce-4aed-81a7-8e2a600bd608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:03.539016 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabc0e4-5a9b-4791-afb0-02dbbd977be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:03.539313 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabc0e4-5a9b-4791-afb0-02dbbd977be9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:03.539408 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9a6fa-12ce-4aed-81a7-8e2a600bd608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:03.539738 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9a6fa-12ce-4aed-81a7-8e2a600bd608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:03.545724 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9a6fa-12ce-4aed-81a7-8e2a600bd608 admin admin] PATH_INFO: `/v3/users/3ea8f2b535914cd18be97eb9d1069329` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:03.545872 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acabc0e4-5a9b-4791-afb0-02dbbd977be9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:54:03.545872 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acabc0e4-5a9b-4791-afb0-02dbbd977be9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:03.546046 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e9a6fa-12ce-4aed-81a7-8e2a600bd608 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ea8f2b535914cd18be97eb9d1069329)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:03.546136 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acabc0e4-5a9b-4791-afb0-02dbbd977be9 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:03.546245 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e9a6fa-12ce-4aed-81a7-8e2a600bd608 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:03.563287 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1135/2292] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:54:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:54:03.568733 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acabc0e4-5a9b-4791-afb0-02dbbd977be9 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:03.579171 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acabc0e4-5a9b-4791-afb0-02dbbd977be9 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:03.584644 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831ed17-c2fe-4de9-bb1a-1531fc2e8d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:03.585281 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831ed17-c2fe-4de9-bb1a-1531fc2e8d09 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:03.585556 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831ed17-c2fe-4de9-bb1a-1531fc2e8d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:03.585991 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831ed17-c2fe-4de9-bb1a-1531fc2e8d09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:03.586633 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4831ed17-c2fe-4de9-bb1a-1531fc2e8d09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:03.588869 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4831ed17-c2fe-4de9-bb1a-1531fc2e8d09 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:03.737897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1136/2293] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:54:03 2022] POST /identity/v3/projects => generated 391 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:54:03.742426 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831ed17-c2fe-4de9-bb1a-1531fc2e8d09 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:03.745739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-4831ed17-c2fe-4de9-bb1a-1531fc2e8d09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:03.827960 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831ed17-c2fe-4de9-bb1a-1531fc2e8d09 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:03.833766 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47983f92-894e-41ed-a65d-b30c0f8d3ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:03.834446 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47983f92-894e-41ed-a65d-b30c0f8d3ffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:03.834734 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47983f92-894e-41ed-a65d-b30c0f8d3ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:03.835101 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47983f92-894e-41ed-a65d-b30c0f8d3ffc admin admin] PATH_INFO: `/v3/users/5cae4fc8e2634f6caaefc89b19f4f087` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:03.836586 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47983f92-894e-41ed-a65d-b30c0f8d3ffc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cae4fc8e2634f6caaefc89b19f4f087)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:03.839432 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47983f92-894e-41ed-a65d-b30c0f8d3ffc admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:03.856826 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-e3e9a6fa-12ce-4aed-81a7-8e2a600bd608 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ea8f2b535914cd18be97eb9d1069329'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:03.866226 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-e3e9a6fa-12ce-4aed-81a7-8e2a600bd608 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ea8f2b535914cd18be97eb9d1069329'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:04.077135 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-e3e9a6fa-12ce-4aed-81a7-8e2a600bd608 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ea8f2b535914cd18be97eb9d1069329'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:04.078955 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-e3e9a6fa-12ce-4aed-81a7-8e2a600bd608 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ea8f2b535914cd18be97eb9d1069329'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:04.123799 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-e3e9a6fa-12ce-4aed-81a7-8e2a600bd608 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ea8f2b535914cd18be97eb9d1069329'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:04.132456 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1158/2294] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:54:03 2022] DELETE /identity/v3/users/3ea8f2b535914cd18be97eb9d1069329 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:54:04.133428 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9a6fa-12ce-4aed-81a7-8e2a600bd608 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:04.135767 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-e3e9a6fa-12ce-4aed-81a7-8e2a600bd608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:04.258415 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-47983f92-894e-41ed-a65d-b30c0f8d3ffc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cae4fc8e2634f6caaefc89b19f4f087'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:04.261336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-47983f92-894e-41ed-a65d-b30c0f8d3ffc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cae4fc8e2634f6caaefc89b19f4f087'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:04.325004 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9a6fa-12ce-4aed-81a7-8e2a600bd608 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:04.335305 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29067d22-c165-4881-a15f-3bd6dadd3870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:04.335305 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29067d22-c165-4881-a15f-3bd6dadd3870 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:04.335305 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29067d22-c165-4881-a15f-3bd6dadd3870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:04.335305 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29067d22-c165-4881-a15f-3bd6dadd3870 admin admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:04.335678 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29067d22-c165-4881-a15f-3bd6dadd3870 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:04.340180 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29067d22-c165-4881-a15f-3bd6dadd3870 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:04.489333 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-47983f92-894e-41ed-a65d-b30c0f8d3ffc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cae4fc8e2634f6caaefc89b19f4f087'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:04.490093 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-47983f92-894e-41ed-a65d-b30c0f8d3ffc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cae4fc8e2634f6caaefc89b19f4f087'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:04.502427 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-47983f92-894e-41ed-a65d-b30c0f8d3ffc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cae4fc8e2634f6caaefc89b19f4f087'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:04.531038 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1137/2295] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:54:03 2022] DELETE /identity/v3/users/5cae4fc8e2634f6caaefc89b19f4f087 => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:54:04.534208 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dd582-5a06-4d31-aa47-585f8383a36a None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:04.534571 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dd582-5a06-4d31-aa47-585f8383a36a None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:04.534948 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dd582-5a06-4d31-aa47-585f8383a36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:04.564672 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-524dd582-5a06-4d31-aa47-585f8383a36a None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:54:04.564672 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-524dd582-5a06-4d31-aa47-585f8383a36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:04.612062 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1159/2296] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:54:04 2022] POST /identity/v3/users => generated 296 bytes in 476 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:54:04.614057 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29067d22-c165-4881-a15f-3bd6dadd3870 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:04.615892 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-29067d22-c165-4881-a15f-3bd6dadd3870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:04.669308 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29067d22-c165-4881-a15f-3bd6dadd3870 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:04.672606 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1138/2297] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:54:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:54:04.693155 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524dd582-5a06-4d31-aa47-585f8383a36a None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:04.695382 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-524dd582-5a06-4d31-aa47-585f8383a36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:04.809942 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524dd582-5a06-4d31-aa47-585f8383a36a None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:04.814702 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699663b-a02a-4130-83ad-b3a51ff7f10b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:04.815511 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699663b-a02a-4130-83ad-b3a51ff7f10b service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:04.815898 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699663b-a02a-4130-83ad-b3a51ff7f10b service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:04.816295 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699663b-a02a-4130-83ad-b3a51ff7f10b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:04.822891 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616971ba-6f96-440d-9d32-e967698d6f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:04.824285 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616971ba-6f96-440d-9d32-e967698d6f97 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:04.824569 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616971ba-6f96-440d-9d32-e967698d6f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:04.824847 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616971ba-6f96-440d-9d32-e967698d6f97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:04.825776 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616971ba-6f96-440d-9d32-e967698d6f97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:04.828578 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616971ba-6f96-440d-9d32-e967698d6f97 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:04.830640 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699663b-a02a-4130-83ad-b3a51ff7f10b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:04.833042 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699663b-a02a-4130-83ad-b3a51ff7f10b service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:04.847304 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1160/2298] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 07:54:04.848386 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1139/2299] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:54:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:54:04.849022 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616971ba-6f96-440d-9d32-e967698d6f97 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:04.861863 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616971ba-6f96-440d-9d32-e967698d6f97 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:04.872327 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f67ef5-4240-4e48-a653-76685e384d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:04.872964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f67ef5-4240-4e48-a653-76685e384d28 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:04.873249 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f67ef5-4240-4e48-a653-76685e384d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:04.873524 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f67ef5-4240-4e48-a653-76685e384d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:04.881612 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f67ef5-4240-4e48-a653-76685e384d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:04.881612 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f67ef5-4240-4e48-a653-76685e384d28 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:04.892430 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1161/2300] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:54:04.893647 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699663b-a02a-4130-83ad-b3a51ff7f10b service neutron] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:04.908474 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699663b-a02a-4130-83ad-b3a51ff7f10b service neutron] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:04.914276 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ef82c-3e5f-45d3-a56d-f4ef9d2c5219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:04.914660 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ef82c-3e5f-45d3-a56d-f4ef9d2c5219 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:04.914943 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ef82c-3e5f-45d3-a56d-f4ef9d2c5219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:04.915260 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ef82c-3e5f-45d3-a56d-f4ef9d2c5219 admin admin] PATH_INFO: `/v3/projects/6e96ec4063654876909f22132c7c82df/users/375c16a7cedf4728bb7b03148ca6e72b/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:04.935130 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0ef82c-3e5f-45d3-a56d-f4ef9d2c5219 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e96ec4063654876909f22132c7c82df, user_id=375c16a7cedf4728bb7b03148ca6e72b, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:04.938438 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0ef82c-3e5f-45d3-a56d-f4ef9d2c5219 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:05.078834 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1140/2301] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:54:04 2022] PUT /identity/v3/projects/6e96ec4063654876909f22132c7c82df/users/375c16a7cedf4728bb7b03148ca6e72b/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:54:05.095008 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010726a-09da-47cb-ae05-eba4e467ec9e None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:05.095502 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010726a-09da-47cb-ae05-eba4e467ec9e None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:05.095944 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010726a-09da-47cb-ae05-eba4e467ec9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:05.133504 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ef82c-3e5f-45d3-a56d-f4ef9d2c5219 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:05.137798 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-4f0ef82c-3e5f-45d3-a56d-f4ef9d2c5219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:05.159017 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:05.160905 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-2010726a-09da-47cb-ae05-eba4e467ec9e None None] MFA Rules not processed for user `375c16a7cedf4728bb7b03148ca6e72b`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:54:05.163238 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-2010726a-09da-47cb-ae05-eba4e467ec9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:05.299134 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ef82c-3e5f-45d3-a56d-f4ef9d2c5219 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:05.314510 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1162/2302] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:54:05 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:54:05.321637 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ff9b2-4fcf-4458-93fc-be32e00fe258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:05.321637 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ff9b2-4fcf-4458-93fc-be32e00fe258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:05.321637 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ff9b2-4fcf-4458-93fc-be32e00fe258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:05.321637 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ff9b2-4fcf-4458-93fc-be32e00fe258 admin admin] PATH_INFO: `/v3/projects/fc12a97c830b49fdb40abb42f544a207` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:05.323363 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ff9b2-4fcf-4458-93fc-be32e00fe258 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc12a97c830b49fdb40abb42f544a207)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:05.327130 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ff9b2-4fcf-4458-93fc-be32e00fe258 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:05.342779 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2010726a-09da-47cb-ae05-eba4e467ec9e None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:05.344288 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-2010726a-09da-47cb-ae05-eba4e467ec9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:05.363381 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2010726a-09da-47cb-ae05-eba4e467ec9e None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:05.369862 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b851563-d940-4bfb-a4d1-64995c3632a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:05.370580 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b851563-d940-4bfb-a4d1-64995c3632a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:05.370860 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b851563-d940-4bfb-a4d1-64995c3632a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:05.371265 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b851563-d940-4bfb-a4d1-64995c3632a8 admin admin] PATH_INFO: `/v3/users/635848f5456445a8b14cb7d9512e6768` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:05.372452 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b851563-d940-4bfb-a4d1-64995c3632a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=635848f5456445a8b14cb7d9512e6768)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:05.374395 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b851563-d940-4bfb-a4d1-64995c3632a8 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:05.531046 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-9d3ff9b2-4fcf-4458-93fc-be32e00fe258 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc12a97c830b49fdb40abb42f544a207', 'request_id': 'req-9d3ff9b2-4fcf-4458-93fc-be32e00fe258'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:05.536521 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-9d3ff9b2-4fcf-4458-93fc-be32e00fe258 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc12a97c830b49fdb40abb42f544a207', 'request_id': 'req-9d3ff9b2-4fcf-4458-93fc-be32e00fe258'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:05.712849 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-9d3ff9b2-4fcf-4458-93fc-be32e00fe258 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc12a97c830b49fdb40abb42f544a207', 'request_id': 'req-9d3ff9b2-4fcf-4458-93fc-be32e00fe258'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:05.735499 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-9d3ff9b2-4fcf-4458-93fc-be32e00fe258 admin admin] The token cache is being invalidate because project fc12a97c830b49fdb40abb42f544a207 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:54:05.738328 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-9d3ff9b2-4fcf-4458-93fc-be32e00fe258 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:05.738328 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-9d3ff9b2-4fcf-4458-93fc-be32e00fe258 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:05.738573 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1141/2303] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:54:05 2022] DELETE /identity/v3/projects/fc12a97c830b49fdb40abb42f544a207 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:54:05.739269 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ff9b2-4fcf-4458-93fc-be32e00fe258 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:05.740958 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-9d3ff9b2-4fcf-4458-93fc-be32e00fe258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:05.821464 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ff9b2-4fcf-4458-93fc-be32e00fe258 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:05.826161 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ca2a0-1a33-4309-809e-9af8e03ff460 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:05.826846 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ca2a0-1a33-4309-809e-9af8e03ff460 service cinder] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:05.827374 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ca2a0-1a33-4309-809e-9af8e03ff460 service cinder] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:05.827750 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ca2a0-1a33-4309-809e-9af8e03ff460 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:05.829612 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-4c9ca2a0-1a33-4309-809e-9af8e03ff460 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:05.881806 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-1b851563-d940-4bfb-a4d1-64995c3632a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '635848f5456445a8b14cb7d9512e6768'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:05.889224 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-1b851563-d940-4bfb-a4d1-64995c3632a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '635848f5456445a8b14cb7d9512e6768'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:05.901753 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9ca2a0-1a33-4309-809e-9af8e03ff460 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:05.903246 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9ca2a0-1a33-4309-809e-9af8e03ff460 service cinder] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:05.912040 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1142/2304] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:54:05 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:54:05.913287 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0010a-61c7-4bf3-a62e-cfc11313d2d0 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:05.913573 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0010a-61c7-4bf3-a62e-cfc11313d2d0 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:05.923263 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0010a-61c7-4bf3-a62e-cfc11313d2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:05.947341 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-f7a0010a-61c7-4bf3-a62e-cfc11313d2d0 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:54:05.948642 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-f7a0010a-61c7-4bf3-a62e-cfc11313d2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:06.015735 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1143/2305] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:54:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:54:06.016509 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0010a-61c7-4bf3-a62e-cfc11313d2d0 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:06.017793 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-f7a0010a-61c7-4bf3-a62e-cfc11313d2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:06.030138 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0010a-61c7-4bf3-a62e-cfc11313d2d0 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:06.039969 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b97c5-ffcb-460b-b334-aa64bf7875c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:06.040620 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b97c5-ffcb-460b-b334-aa64bf7875c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:06.041423 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b97c5-ffcb-460b-b334-aa64bf7875c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:06.042436 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b97c5-ffcb-460b-b334-aa64bf7875c2 admin admin] PATH_INFO: `/v3/projects/40dff7f366c7469ba1771f140618a07e` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:06.042913 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b97c5-ffcb-460b-b334-aa64bf7875c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40dff7f366c7469ba1771f140618a07e)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:06.045026 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b97c5-ffcb-460b-b334-aa64bf7875c2 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:06.094804 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-1b851563-d940-4bfb-a4d1-64995c3632a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '635848f5456445a8b14cb7d9512e6768'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:06.095676 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-1b851563-d940-4bfb-a4d1-64995c3632a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '635848f5456445a8b14cb7d9512e6768'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:06.108911 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-1b851563-d940-4bfb-a4d1-64995c3632a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '635848f5456445a8b14cb7d9512e6768'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:06.115119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1163/2306] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:54:05 2022] DELETE /identity/v3/users/635848f5456445a8b14cb7d9512e6768 => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:54:06.116449 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcc11d-4b00-4a29-8267-858fa1d17967 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:06.116845 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcc11d-4b00-4a29-8267-858fa1d17967 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:06.117119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcc11d-4b00-4a29-8267-858fa1d17967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:06.137202 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-bafcc11d-4b00-4a29-8267-858fa1d17967 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:54:06.138418 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-bafcc11d-4b00-4a29-8267-858fa1d17967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:06.198692 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1164/2307] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:54:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:54:06.200184 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168323e7-ad35-45ae-9067-e35cfa5637b0 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:06.200485 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168323e7-ad35-45ae-9067-e35cfa5637b0 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:06.200764 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168323e7-ad35-45ae-9067-e35cfa5637b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:06.220700 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-168323e7-ad35-45ae-9067-e35cfa5637b0 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:54:06.221920 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-168323e7-ad35-45ae-9067-e35cfa5637b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:06.231448 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1165/2308] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:54:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:54:06.232295 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168323e7-ad35-45ae-9067-e35cfa5637b0 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:06.233565 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-168323e7-ad35-45ae-9067-e35cfa5637b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:06.289906 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168323e7-ad35-45ae-9067-e35cfa5637b0 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:06.300033 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-0c0b97c5-ffcb-460b-b334-aa64bf7875c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40dff7f366c7469ba1771f140618a07e', 'request_id': 'req-0c0b97c5-ffcb-460b-b334-aa64bf7875c2'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:06.305716 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-0c0b97c5-ffcb-460b-b334-aa64bf7875c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40dff7f366c7469ba1771f140618a07e', 'request_id': 'req-0c0b97c5-ffcb-460b-b334-aa64bf7875c2'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:06.340841 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a24e7-d753-40b5-906b-fb4f4e89a735 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:06.341456 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a24e7-d753-40b5-906b-fb4f4e89a735 service cinder] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:06.341736 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a24e7-d753-40b5-906b-fb4f4e89a735 service cinder] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:06.342009 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a24e7-d753-40b5-906b-fb4f4e89a735 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:06.343799 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-8f6a24e7-d753-40b5-906b-fb4f4e89a735 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:06.408911 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a24e7-d753-40b5-906b-fb4f4e89a735 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:06.408911 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a24e7-d753-40b5-906b-fb4f4e89a735 service cinder] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:06.414115 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1166/2309] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:54:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:54:06.417240 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a24e7-d753-40b5-906b-fb4f4e89a735 service cinder] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:06.487419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-0c0b97c5-ffcb-460b-b334-aa64bf7875c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40dff7f366c7469ba1771f140618a07e', 'request_id': 'req-0c0b97c5-ffcb-460b-b334-aa64bf7875c2'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:06.505475 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-0c0b97c5-ffcb-460b-b334-aa64bf7875c2 admin admin] The token cache is being invalidate because project 40dff7f366c7469ba1771f140618a07e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:54:06.505775 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-0c0b97c5-ffcb-460b-b334-aa64bf7875c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:06.507373 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-0c0b97c5-ffcb-460b-b334-aa64bf7875c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:06.508622 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a24e7-d753-40b5-906b-fb4f4e89a735 service cinder] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:06.512897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1144/2310] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:54:06 2022] DELETE /identity/v3/projects/40dff7f366c7469ba1771f140618a07e => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:54:06.517068 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb226ff-6d04-43f3-be7d-2ac66dad4172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:06.517816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b97c5-ffcb-460b-b334-aa64bf7875c2 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:06.518128 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb226ff-6d04-43f3-be7d-2ac66dad4172 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:06.518512 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb226ff-6d04-43f3-be7d-2ac66dad4172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:06.518898 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb226ff-6d04-43f3-be7d-2ac66dad4172 admin admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:06.519703 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb226ff-6d04-43f3-be7d-2ac66dad4172 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:54:06.520038 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-0c0b97c5-ffcb-460b-b334-aa64bf7875c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:06.520167 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb226ff-6d04-43f3-be7d-2ac66dad4172 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:06.522199 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb226ff-6d04-43f3-be7d-2ac66dad4172 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:06.542451 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1167/2311] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:54:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:54:06.544502 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fce01-4d02-4b6b-afaf-d9fee0c99503 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:06.544502 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fce01-4d02-4b6b-afaf-d9fee0c99503 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:06.544946 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fce01-4d02-4b6b-afaf-d9fee0c99503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:06.566265 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-535fce01-4d02-4b6b-afaf-d9fee0c99503 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:54:06.567746 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-535fce01-4d02-4b6b-afaf-d9fee0c99503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:06.580286 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1168/2312] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:54:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:54:06.581316 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535fce01-4d02-4b6b-afaf-d9fee0c99503 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:06.583162 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-535fce01-4d02-4b6b-afaf-d9fee0c99503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:06.597758 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b97c5-ffcb-460b-b334-aa64bf7875c2 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:06.609459 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535fce01-4d02-4b6b-afaf-d9fee0c99503 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:06.609616 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e891f52-1f05-4256-ad69-fbcdfd3ccf40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:06.609616 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e891f52-1f05-4256-ad69-fbcdfd3ccf40 service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:06.609616 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e891f52-1f05-4256-ad69-fbcdfd3ccf40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:06.609616 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e891f52-1f05-4256-ad69-fbcdfd3ccf40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:06.609982 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e12df-8314-468f-96d4-cf787806ed4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:06.609982 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e12df-8314-468f-96d4-cf787806ed4f admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:06.610138 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-6e891f52-1f05-4256-ad69-fbcdfd3ccf40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:06.610226 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e12df-8314-468f-96d4-cf787806ed4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:06.610226 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e12df-8314-468f-96d4-cf787806ed4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:06.610226 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e12df-8314-468f-96d4-cf787806ed4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:06.610226 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e12df-8314-468f-96d4-cf787806ed4f admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:06.618275 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e891f52-1f05-4256-ad69-fbcdfd3ccf40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:06.619982 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e891f52-1f05-4256-ad69-fbcdfd3ccf40 service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:06.630411 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1145/2313] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:54:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:54:06.631680 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f57b8f-926b-4e3a-8d19-d983290ae679 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:06.632023 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f57b8f-926b-4e3a-8d19-d983290ae679 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:06.632295 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f57b8f-926b-4e3a-8d19-d983290ae679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:06.654503 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-61f57b8f-926b-4e3a-8d19-d983290ae679 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:54:06.656409 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-61f57b8f-926b-4e3a-8d19-d983290ae679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:06.667093 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1146/2314] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:54:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:54:06.671152 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f57b8f-926b-4e3a-8d19-d983290ae679 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:06.680326 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f57b8f-926b-4e3a-8d19-d983290ae679 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:06.685027 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d4727-1ce7-45d9-ac16-ea89057ad48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:06.685633 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d4727-1ce7-45d9-ac16-ea89057ad48f admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:06.685919 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d4727-1ce7-45d9-ac16-ea89057ad48f admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:06.686186 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d4727-1ce7-45d9-ac16-ea89057ad48f admin admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:06.686833 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d4727-1ce7-45d9-ac16-ea89057ad48f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:54:06.687179 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d4727-1ce7-45d9-ac16-ea89057ad48f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:06.688781 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d4727-1ce7-45d9-ac16-ea89057ad48f admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:06.701716 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1147/2315] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:54:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:54:06.706332 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d4727-1ce7-45d9-ac16-ea89057ad48f admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:06.717790 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d4727-1ce7-45d9-ac16-ea89057ad48f admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:06.723162 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0f6bd-ba92-4c75-92a8-3c1096e1a7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:06.723973 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0f6bd-ba92-4c75-92a8-3c1096e1a7f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:06.724416 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0f6bd-ba92-4c75-92a8-3c1096e1a7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:06.724711 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0f6bd-ba92-4c75-92a8-3c1096e1a7f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:06.725448 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0f6bd-ba92-4c75-92a8-3c1096e1a7f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:06.727583 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0f6bd-ba92-4c75-92a8-3c1096e1a7f1 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:06.887617 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:06.894149 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1169/2316] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:54:06 2022] POST /identity/v3/projects => generated 365 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:54:06.898541 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e12df-8314-468f-96d4-cf787806ed4f admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:06.959191 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e12df-8314-468f-96d4-cf787806ed4f admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:06.963941 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d7596-609c-488e-b92a-e69adb6b4ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:06.964543 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d7596-609c-488e-b92a-e69adb6b4ed9 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:06.964818 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d7596-609c-488e-b92a-e69adb6b4ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:06.965091 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d7596-609c-488e-b92a-e69adb6b4ed9 admin admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:06.965713 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d7596-609c-488e-b92a-e69adb6b4ed9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:06.967971 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d7596-609c-488e-b92a-e69adb6b4ed9 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:06.979521 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1148/2317] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:54:06 2022] POST /identity/v3/projects => generated 381 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 07:54:06.984239 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0f6bd-ba92-4c75-92a8-3c1096e1a7f1 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:07.061300 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0f6bd-ba92-4c75-92a8-3c1096e1a7f1 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:07.065908 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f387e-9ec6-4673-a1ee-12d1fe4b4a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:07.066517 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f387e-9ec6-4673-a1ee-12d1fe4b4a47 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:07.066795 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f387e-9ec6-4673-a1ee-12d1fe4b4a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:07.067096 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f387e-9ec6-4673-a1ee-12d1fe4b4a47 admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:07.067762 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0f387e-9ec6-4673-a1ee-12d1fe4b4a47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:07.070133 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0f387e-9ec6-4673-a1ee-12d1fe4b4a47 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:07.258808 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1170/2318] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:54:06 2022] POST /identity/v3/users => generated 283 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 07:54:07.260236 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d7596-609c-488e-b92a-e69adb6b4ed9 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:07.271085 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d7596-609c-488e-b92a-e69adb6b4ed9 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:07.276054 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84d691-e89a-4072-afbe-4654a1d96b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:07.276659 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84d691-e89a-4072-afbe-4654a1d96b6e admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:07.276937 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84d691-e89a-4072-afbe-4654a1d96b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:07.277207 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84d691-e89a-4072-afbe-4654a1d96b6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:07.277850 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf84d691-e89a-4072-afbe-4654a1d96b6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:07.279453 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf84d691-e89a-4072-afbe-4654a1d96b6e admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:07.289716 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1171/2319] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 07:54:07.294200 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84d691-e89a-4072-afbe-4654a1d96b6e admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:07.307696 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84d691-e89a-4072-afbe-4654a1d96b6e admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:07.309594 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1149/2320] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:54:06 2022] POST /identity/v3/users => generated 291 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:54:07.310939 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f387e-9ec6-4673-a1ee-12d1fe4b4a47 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:07.314867 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-fb0f387e-9ec6-4673-a1ee-12d1fe4b4a47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:07.315117 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80133647-4ece-44dd-9a6f-2f26bea237e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:07.315802 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80133647-4ece-44dd-9a6f-2f26bea237e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:07.316151 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80133647-4ece-44dd-9a6f-2f26bea237e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:07.316445 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80133647-4ece-44dd-9a6f-2f26bea237e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:07.317161 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80133647-4ece-44dd-9a6f-2f26bea237e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:07.318851 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80133647-4ece-44dd-9a6f-2f26bea237e4 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:07.330851 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f387e-9ec6-4673-a1ee-12d1fe4b4a47 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:07.331978 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1172/2321] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 07:54:07.332842 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80133647-4ece-44dd-9a6f-2f26bea237e4 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:07.339866 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446566f6-1896-4c06-a948-589c998afbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:07.340515 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446566f6-1896-4c06-a948-589c998afbe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:07.340796 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446566f6-1896-4c06-a948-589c998afbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:07.341149 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446566f6-1896-4c06-a948-589c998afbe3 admin admin] PATH_INFO: `/v3/projects/882178acd9eb40ea9fe77fe8a6345197` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:07.342932 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446566f6-1896-4c06-a948-589c998afbe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=882178acd9eb40ea9fe77fe8a6345197)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:07.344654 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80133647-4ece-44dd-9a6f-2f26bea237e4 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:07.345410 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446566f6-1896-4c06-a948-589c998afbe3 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:07.350316 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463984a-a630-4841-b918-3f1f6a2073e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:07.351105 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463984a-a630-4841-b918-3f1f6a2073e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:07.363148 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463984a-a630-4841-b918-3f1f6a2073e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:07.363148 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463984a-a630-4841-b918-3f1f6a2073e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:07.363148 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a463984a-a630-4841-b918-3f1f6a2073e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:07.363148 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a463984a-a630-4841-b918-3f1f6a2073e8 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:07.365918 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1173/2322] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:54:07.366779 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463984a-a630-4841-b918-3f1f6a2073e8 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:07.379363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463984a-a630-4841-b918-3f1f6a2073e8 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:07.384166 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d87663-7ccf-4905-a671-f020b55544d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:07.385067 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d87663-7ccf-4905-a671-f020b55544d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:07.385236 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d87663-7ccf-4905-a671-f020b55544d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:07.385444 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d87663-7ccf-4905-a671-f020b55544d7 admin admin] PATH_INFO: `/v3/projects/d31da4bb956940eeadd88170acbc8c11/users/9345ba58cae54ccb8782d2bdefdb793b/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:07.401236 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d87663-7ccf-4905-a671-f020b55544d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d31da4bb956940eeadd88170acbc8c11, user_id=9345ba58cae54ccb8782d2bdefdb793b, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:07.404076 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d87663-7ccf-4905-a671-f020b55544d7 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:07.694547 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1174/2323] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:54:07 2022] PUT /identity/v3/projects/d31da4bb956940eeadd88170acbc8c11/users/9345ba58cae54ccb8782d2bdefdb793b/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:54:07.694547 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d87663-7ccf-4905-a671-f020b55544d7 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:07.725627 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-446566f6-1896-4c06-a948-589c998afbe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '882178acd9eb40ea9fe77fe8a6345197', 'request_id': 'req-446566f6-1896-4c06-a948-589c998afbe3'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:07.735774 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-446566f6-1896-4c06-a948-589c998afbe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '882178acd9eb40ea9fe77fe8a6345197', 'request_id': 'req-446566f6-1896-4c06-a948-589c998afbe3'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:07.768290 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d87663-7ccf-4905-a671-f020b55544d7 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:07.830910 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a9deab-15f9-4ffa-97ad-8868d14c2098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:07.831963 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a9deab-15f9-4ffa-97ad-8868d14c2098 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:07.832265 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a9deab-15f9-4ffa-97ad-8868d14c2098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:07.832602 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a9deab-15f9-4ffa-97ad-8868d14c2098 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:07.833554 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a9deab-15f9-4ffa-97ad-8868d14c2098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:07.835226 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a9deab-15f9-4ffa-97ad-8868d14c2098 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:07.847254 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1175/2324] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:54:07.848596 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41adc436-4937-4950-a08f-cd532f11ae4f None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:07.848812 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41adc436-4937-4950-a08f-cd532f11ae4f None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:07.849226 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41adc436-4937-4950-a08f-cd532f11ae4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:07.878378 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-41adc436-4937-4950-a08f-cd532f11ae4f None None] MFA Rules not processed for user `9345ba58cae54ccb8782d2bdefdb793b`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:54:07.879662 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-41adc436-4937-4950-a08f-cd532f11ae4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:07.946592 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1176/2325] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:54:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:54:07.947968 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41adc436-4937-4950-a08f-cd532f11ae4f None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:07.958864 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41adc436-4937-4950-a08f-cd532f11ae4f None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:07.964606 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82b5c9-cc5e-43a7-b900-ee5a403a9460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:07.965262 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82b5c9-cc5e-43a7-b900-ee5a403a9460 admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:07.965548 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82b5c9-cc5e-43a7-b900-ee5a403a9460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:07.965818 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82b5c9-cc5e-43a7-b900-ee5a403a9460 admin admin] PATH_INFO: `/v3/projects/69a3531472224652bcd42d0c38dfa807/users/6013bd3435a7414a9fca40d17ba91ba2/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:07.968226 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-446566f6-1896-4c06-a948-589c998afbe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '882178acd9eb40ea9fe77fe8a6345197', 'request_id': 'req-446566f6-1896-4c06-a948-589c998afbe3'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:07.982540 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-446566f6-1896-4c06-a948-589c998afbe3 admin admin] The token cache is being invalidate because project 882178acd9eb40ea9fe77fe8a6345197 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:54:07.982973 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-446566f6-1896-4c06-a948-589c998afbe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:07.983170 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf82b5c9-cc5e-43a7-b900-ee5a403a9460 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69a3531472224652bcd42d0c38dfa807, user_id=6013bd3435a7414a9fca40d17ba91ba2, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:07.984129 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-446566f6-1896-4c06-a948-589c998afbe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:07.985756 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf82b5c9-cc5e-43a7-b900-ee5a403a9460 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:07.986575 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1150/2326] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:54:07 2022] DELETE /identity/v3/projects/882178acd9eb40ea9fe77fe8a6345197 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:54:07.988421 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446566f6-1896-4c06-a948-589c998afbe3 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:07.990658 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-446566f6-1896-4c06-a948-589c998afbe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:08.065338 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446566f6-1896-4c06-a948-589c998afbe3 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:08.070573 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd61a33e-c9dd-4d5d-b9bb-dae233c16d68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:08.071469 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61a33e-c9dd-4d5d-b9bb-dae233c16d68 service cinder] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:08.083960 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61a33e-c9dd-4d5d-b9bb-dae233c16d68 service cinder] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:08.083960 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61a33e-c9dd-4d5d-b9bb-dae233c16d68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:08.083960 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-dd61a33e-c9dd-4d5d-b9bb-dae233c16d68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:08.090284 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd61a33e-c9dd-4d5d-b9bb-dae233c16d68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:08.091804 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd61a33e-c9dd-4d5d-b9bb-dae233c16d68 service cinder] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:08.102443 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1151/2327] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:54:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:54:08.269895 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1177/2328] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:54:07 2022] PUT /identity/v3/projects/69a3531472224652bcd42d0c38dfa807/users/6013bd3435a7414a9fca40d17ba91ba2/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:54:08.276834 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c54068-857f-46d7-acb0-051f65ddb214 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:08.277114 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c54068-857f-46d7-acb0-051f65ddb214 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:08.277383 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c54068-857f-46d7-acb0-051f65ddb214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:08.296940 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-c2c54068-857f-46d7-acb0-051f65ddb214 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:54:08.298134 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-c2c54068-857f-46d7-acb0-051f65ddb214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:08.360600 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1152/2329] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:54:08.372372 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82b5c9-cc5e-43a7-b900-ee5a403a9460 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:08.374126 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-cf82b5c9-cc5e-43a7-b900-ee5a403a9460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:08.438502 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82b5c9-cc5e-43a7-b900-ee5a403a9460 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:08.442460 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67405083-3e44-4567-b684-ad9281ac7ebc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:08.443248 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67405083-3e44-4567-b684-ad9281ac7ebc service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:08.443652 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67405083-3e44-4567-b684-ad9281ac7ebc service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:08.444011 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67405083-3e44-4567-b684-ad9281ac7ebc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:08.461663 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67405083-3e44-4567-b684-ad9281ac7ebc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:08.464154 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67405083-3e44-4567-b684-ad9281ac7ebc service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:08.475662 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1178/2330] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:54:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:54:09.660360 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:09.794105 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c54068-857f-46d7-acb0-051f65ddb214 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:09.795614 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-c2c54068-857f-46d7-acb0-051f65ddb214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:09.857373 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c54068-857f-46d7-acb0-051f65ddb214 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:09.860912 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62d41c-87ac-4d23-809a-c415e8c70a15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:09.861521 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62d41c-87ac-4d23-809a-c415e8c70a15 service cinder] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:09.861799 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62d41c-87ac-4d23-809a-c415e8c70a15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:09.862071 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62d41c-87ac-4d23-809a-c415e8c70a15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:09.863843 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-0e62d41c-87ac-4d23-809a-c415e8c70a15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:09.928560 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e62d41c-87ac-4d23-809a-c415e8c70a15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:09.930212 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e62d41c-87ac-4d23-809a-c415e8c70a15 service cinder] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:09.942969 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1153/2331] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:54:09 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:54:10.970349 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e4bb8-e05b-4f3a-8214-f0a4bc45e8b4 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:10.971662 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e4bb8-e05b-4f3a-8214-f0a4bc45e8b4 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:10.971662 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e4bb8-e05b-4f3a-8214-f0a4bc45e8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:11.006590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-aa1e4bb8-e05b-4f3a-8214-f0a4bc45e8b4 None None] MFA Rules not processed for user `6013bd3435a7414a9fca40d17ba91ba2`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:54:11.008155 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-aa1e4bb8-e05b-4f3a-8214-f0a4bc45e8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:11.081018 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1179/2332] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:54:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:54:11.093582 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62d41c-87ac-4d23-809a-c415e8c70a15 service cinder] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:11.102467 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62d41c-87ac-4d23-809a-c415e8c70a15 service cinder] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:11.107245 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2869a-c4e5-42be-bc07-cb1a38d4930a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:11.107866 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2869a-c4e5-42be-bc07-cb1a38d4930a service cinder] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:11.108145 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2869a-c4e5-42be-bc07-cb1a38d4930a service cinder] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:11.108422 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2869a-c4e5-42be-bc07-cb1a38d4930a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:11.121333 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c2869a-c4e5-42be-bc07-cb1a38d4930a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:11.122787 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c2869a-c4e5-42be-bc07-cb1a38d4930a service cinder] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:11.144749 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1154/2333] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:54:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:54:11.172412 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:11.997947 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b28ae0-6bbc-4b09-98ed-1ad5b24b6073 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:11.998492 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b28ae0-6bbc-4b09-98ed-1ad5b24b6073 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:11.998492 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b28ae0-6bbc-4b09-98ed-1ad5b24b6073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:12.018209 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-80b28ae0-6bbc-4b09-98ed-1ad5b24b6073 None None] MFA Rules not processed for user `c9de80eade38407c99f00c5acf45e2bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:54:12.019450 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-80b28ae0-6bbc-4b09-98ed-1ad5b24b6073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:12.100617 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1180/2334] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:54:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:54:12.713144 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:14.029626 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:14.290101 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2466943-3bac-4baf-bc1b-41db34916eda None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:14.290381 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2466943-3bac-4baf-bc1b-41db34916eda None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:14.291506 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2466943-3bac-4baf-bc1b-41db34916eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:14.318855 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-c2466943-3bac-4baf-bc1b-41db34916eda None None] MFA Rules not processed for user `6013bd3435a7414a9fca40d17ba91ba2`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:54:14.318855 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-c2466943-3bac-4baf-bc1b-41db34916eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:14.319568 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1155/2335] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:54:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:54:15.854670 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:17.597236 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:17.688750 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:19.190526 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:19.646451 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=92,keystone:INSERT=7,keystone:DELETE=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:19.685207 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b28ae0-6bbc-4b09-98ed-1ad5b24b6073 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:19.687431 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-80b28ae0-6bbc-4b09-98ed-1ad5b24b6073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:19.705659 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b28ae0-6bbc-4b09-98ed-1ad5b24b6073 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:19.711341 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977a8ba-5e58-4488-859e-14e52895b0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:19.712401 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977a8ba-5e58-4488-859e-14e52895b0d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:19.712896 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977a8ba-5e58-4488-859e-14e52895b0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:19.713386 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977a8ba-5e58-4488-859e-14e52895b0d3 admin admin] PATH_INFO: `/v3/users/6da9f1a22fc846ac90cd23dad2ac8c8e` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:19.714826 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e977a8ba-5e58-4488-859e-14e52895b0d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6da9f1a22fc846ac90cd23dad2ac8c8e)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:19.717131 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e977a8ba-5e58-4488-859e-14e52895b0d3 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:20.137694 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-e977a8ba-5e58-4488-859e-14e52895b0d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6da9f1a22fc846ac90cd23dad2ac8c8e'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:20.148013 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-e977a8ba-5e58-4488-859e-14e52895b0d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6da9f1a22fc846ac90cd23dad2ac8c8e'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:20.299523 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-e977a8ba-5e58-4488-859e-14e52895b0d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6da9f1a22fc846ac90cd23dad2ac8c8e'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:20.300337 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-e977a8ba-5e58-4488-859e-14e52895b0d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6da9f1a22fc846ac90cd23dad2ac8c8e'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:20.319200 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-e977a8ba-5e58-4488-859e-14e52895b0d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6da9f1a22fc846ac90cd23dad2ac8c8e'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:20.330155 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1181/2336] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:54:19 2022] DELETE /identity/v3/users/6da9f1a22fc846ac90cd23dad2ac8c8e => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:54:20.335528 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef111a-8083-4226-8b3c-d7d2c3b6fae4 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:20.343554 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef111a-8083-4226-8b3c-d7d2c3b6fae4 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:20.343554 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef111a-8083-4226-8b3c-d7d2c3b6fae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:20.358661 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-e8ef111a-8083-4226-8b3c-d7d2c3b6fae4 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:54:20.359857 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-e8ef111a-8083-4226-8b3c-d7d2c3b6fae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:20.452891 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1156/2337] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:54:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:54:20.454676 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977a8ba-5e58-4488-859e-14e52895b0d3 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:20.454676 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-e977a8ba-5e58-4488-859e-14e52895b0d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:20.523030 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977a8ba-5e58-4488-859e-14e52895b0d3 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:20.526600 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4268d-00d7-486d-b609-4d59b9486299 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:20.527294 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4268d-00d7-486d-b609-4d59b9486299 service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:20.527570 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4268d-00d7-486d-b609-4d59b9486299 service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:20.527840 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4268d-00d7-486d-b609-4d59b9486299 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:20.538375 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4268d-00d7-486d-b609-4d59b9486299 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:20.539977 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4268d-00d7-486d-b609-4d59b9486299 service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:20.553575 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1182/2338] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:54:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:54:21.414178 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef111a-8083-4226-8b3c-d7d2c3b6fae4 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:21.417569 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-e8ef111a-8083-4226-8b3c-d7d2c3b6fae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:21.434697 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef111a-8083-4226-8b3c-d7d2c3b6fae4 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:21.453166 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b49ba6-d289-42b0-b91e-691cb47c085a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:21.454626 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b49ba6-d289-42b0-b91e-691cb47c085a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:21.454941 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b49ba6-d289-42b0-b91e-691cb47c085a admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:21.455432 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b49ba6-d289-42b0-b91e-691cb47c085a admin admin] PATH_INFO: `/v3/projects/9c5c264dadeb460793cd6495b24716a7` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:21.457515 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b49ba6-d289-42b0-b91e-691cb47c085a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c5c264dadeb460793cd6495b24716a7)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:21.460662 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b49ba6-d289-42b0-b91e-691cb47c085a admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:21.610919 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-93b49ba6-d289-42b0-b91e-691cb47c085a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c5c264dadeb460793cd6495b24716a7', 'request_id': 'req-93b49ba6-d289-42b0-b91e-691cb47c085a'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:21.617447 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-93b49ba6-d289-42b0-b91e-691cb47c085a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c5c264dadeb460793cd6495b24716a7', 'request_id': 'req-93b49ba6-d289-42b0-b91e-691cb47c085a'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:21.729057 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-93b49ba6-d289-42b0-b91e-691cb47c085a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c5c264dadeb460793cd6495b24716a7', 'request_id': 'req-93b49ba6-d289-42b0-b91e-691cb47c085a'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:21.742810 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-93b49ba6-d289-42b0-b91e-691cb47c085a admin admin] The token cache is being invalidate because project 9c5c264dadeb460793cd6495b24716a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:54:21.743174 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-93b49ba6-d289-42b0-b91e-691cb47c085a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:21.745157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-93b49ba6-d289-42b0-b91e-691cb47c085a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:21.746846 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1157/2339] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:54:21 2022] DELETE /identity/v3/projects/9c5c264dadeb460793cd6495b24716a7 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:54:21.751180 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4268d-00d7-486d-b609-4d59b9486299 service neutron] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:21.762507 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4268d-00d7-486d-b609-4d59b9486299 service neutron] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:21.832366 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d74a8-2f73-4506-8c58-61defdf01da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:21.833161 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d74a8-2f73-4506-8c58-61defdf01da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:21.833516 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d74a8-2f73-4506-8c58-61defdf01da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:21.833871 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d74a8-2f73-4506-8c58-61defdf01da7 admin admin] PATH_INFO: `/v3/users/e7840c0a0b6a4771bad32301d260f783` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:21.835946 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d74a8-2f73-4506-8c58-61defdf01da7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7840c0a0b6a4771bad32301d260f783)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:21.838702 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d74a8-2f73-4506-8c58-61defdf01da7 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:22.142524 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-bb8d74a8-2f73-4506-8c58-61defdf01da7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7840c0a0b6a4771bad32301d260f783'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:22.150566 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-bb8d74a8-2f73-4506-8c58-61defdf01da7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7840c0a0b6a4771bad32301d260f783'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:22.263486 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-bb8d74a8-2f73-4506-8c58-61defdf01da7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7840c0a0b6a4771bad32301d260f783'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:22.264278 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-bb8d74a8-2f73-4506-8c58-61defdf01da7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7840c0a0b6a4771bad32301d260f783'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:22.281827 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-bb8d74a8-2f73-4506-8c58-61defdf01da7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7840c0a0b6a4771bad32301d260f783'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:22.288325 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1183/2340] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:54:21 2022] DELETE /identity/v3/users/e7840c0a0b6a4771bad32301d260f783 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:54:22.660325 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:22.837170 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:22.897831 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b49ba6-d289-42b0-b91e-691cb47c085a admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:22.904221 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-93b49ba6-d289-42b0-b91e-691cb47c085a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:22.939517 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b49ba6-d289-42b0-b91e-691cb47c085a admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:23.024083 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151dbf9a-6b11-4a3a-90ce-1fd5b52d6847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:23.025146 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151dbf9a-6b11-4a3a-90ce-1fd5b52d6847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:23.025679 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151dbf9a-6b11-4a3a-90ce-1fd5b52d6847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:23.025940 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151dbf9a-6b11-4a3a-90ce-1fd5b52d6847 admin admin] PATH_INFO: `/v3/projects/b8f0086aae8f495a92f42f5b4a316264` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:23.027271 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151dbf9a-6b11-4a3a-90ce-1fd5b52d6847 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8f0086aae8f495a92f42f5b4a316264)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:23.029500 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151dbf9a-6b11-4a3a-90ce-1fd5b52d6847 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:23.195399 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-151dbf9a-6b11-4a3a-90ce-1fd5b52d6847 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8f0086aae8f495a92f42f5b4a316264', 'request_id': 'req-151dbf9a-6b11-4a3a-90ce-1fd5b52d6847'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:23.201462 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-151dbf9a-6b11-4a3a-90ce-1fd5b52d6847 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8f0086aae8f495a92f42f5b4a316264', 'request_id': 'req-151dbf9a-6b11-4a3a-90ce-1fd5b52d6847'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:23.333045 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-151dbf9a-6b11-4a3a-90ce-1fd5b52d6847 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8f0086aae8f495a92f42f5b4a316264', 'request_id': 'req-151dbf9a-6b11-4a3a-90ce-1fd5b52d6847'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:23.349125 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-151dbf9a-6b11-4a3a-90ce-1fd5b52d6847 admin admin] The token cache is being invalidate because project b8f0086aae8f495a92f42f5b4a316264 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:54:23.349456 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-151dbf9a-6b11-4a3a-90ce-1fd5b52d6847 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:23.350875 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-151dbf9a-6b11-4a3a-90ce-1fd5b52d6847 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:23.353685 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1158/2341] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:54:22 2022] DELETE /identity/v3/projects/b8f0086aae8f495a92f42f5b4a316264 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:54:23.358058 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d74a8-2f73-4506-8c58-61defdf01da7 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:23.359882 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-bb8d74a8-2f73-4506-8c58-61defdf01da7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:23.377016 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d74a8-2f73-4506-8c58-61defdf01da7 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:23.455897 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ae71e-df78-4bb4-9ca6-42a6e08bcc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:23.462652 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ae71e-df78-4bb4-9ca6-42a6e08bcc8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:23.463937 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ae71e-df78-4bb4-9ca6-42a6e08bcc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:23.464278 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ae71e-df78-4bb4-9ca6-42a6e08bcc8f admin admin] PATH_INFO: `/v3/users/d5e622a7df1f4d4abcfaa2ea6bce4052` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:23.465846 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1ae71e-df78-4bb4-9ca6-42a6e08bcc8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5e622a7df1f4d4abcfaa2ea6bce4052)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:23.467888 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1ae71e-df78-4bb4-9ca6-42a6e08bcc8f admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:23.831460 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-7c1ae71e-df78-4bb4-9ca6-42a6e08bcc8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5e622a7df1f4d4abcfaa2ea6bce4052'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:23.842731 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-7c1ae71e-df78-4bb4-9ca6-42a6e08bcc8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5e622a7df1f4d4abcfaa2ea6bce4052'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:23.903475 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-7c1ae71e-df78-4bb4-9ca6-42a6e08bcc8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5e622a7df1f4d4abcfaa2ea6bce4052'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:23.904107 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-7c1ae71e-df78-4bb4-9ca6-42a6e08bcc8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5e622a7df1f4d4abcfaa2ea6bce4052'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:23.919390 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-7c1ae71e-df78-4bb4-9ca6-42a6e08bcc8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5e622a7df1f4d4abcfaa2ea6bce4052'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:23.926628 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1184/2342] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:54:23 2022] DELETE /identity/v3/users/d5e622a7df1f4d4abcfaa2ea6bce4052 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:54:24.551751 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:24.912292 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:25.022425 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151dbf9a-6b11-4a3a-90ce-1fd5b52d6847 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:25.026121 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-151dbf9a-6b11-4a3a-90ce-1fd5b52d6847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:25.049909 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151dbf9a-6b11-4a3a-90ce-1fd5b52d6847 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:25.164742 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3975b9c-a0f6-4a88-b1ab-3db129bf42c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:25.165645 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3975b9c-a0f6-4a88-b1ab-3db129bf42c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:25.166312 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3975b9c-a0f6-4a88-b1ab-3db129bf42c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:25.166752 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3975b9c-a0f6-4a88-b1ab-3db129bf42c4 admin admin] PATH_INFO: `/v3/projects/d71aa52b059646ff952d6d5a9b4e067d` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:25.168290 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3975b9c-a0f6-4a88-b1ab-3db129bf42c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d71aa52b059646ff952d6d5a9b4e067d)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:25.170275 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3975b9c-a0f6-4a88-b1ab-3db129bf42c4 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:25.347605 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-f3975b9c-a0f6-4a88-b1ab-3db129bf42c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd71aa52b059646ff952d6d5a9b4e067d', 'request_id': 'req-f3975b9c-a0f6-4a88-b1ab-3db129bf42c4'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:25.357069 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-f3975b9c-a0f6-4a88-b1ab-3db129bf42c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd71aa52b059646ff952d6d5a9b4e067d', 'request_id': 'req-f3975b9c-a0f6-4a88-b1ab-3db129bf42c4'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:25.479706 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-f3975b9c-a0f6-4a88-b1ab-3db129bf42c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd71aa52b059646ff952d6d5a9b4e067d', 'request_id': 'req-f3975b9c-a0f6-4a88-b1ab-3db129bf42c4'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:25.496347 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-f3975b9c-a0f6-4a88-b1ab-3db129bf42c4 admin admin] The token cache is being invalidate because project d71aa52b059646ff952d6d5a9b4e067d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:54:25.496748 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-f3975b9c-a0f6-4a88-b1ab-3db129bf42c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:25.497615 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-f3975b9c-a0f6-4a88-b1ab-3db129bf42c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:25.503321 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1159/2343] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:54:25 2022] DELETE /identity/v3/projects/d71aa52b059646ff952d6d5a9b4e067d => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:54:25.505902 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a684c-a7ae-476f-a484-89630913986e None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:25.506499 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a684c-a7ae-476f-a484-89630913986e None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:25.507437 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a684c-a7ae-476f-a484-89630913986e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:25.533849 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-228a684c-a7ae-476f-a484-89630913986e None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:54:25.536002 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-228a684c-a7ae-476f-a484-89630913986e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:25.613082 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1185/2344] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:54:25.621838 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19100711-a606-445b-996b-c3e497804d06 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:25.622471 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19100711-a606-445b-996b-c3e497804d06 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:25.622471 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19100711-a606-445b-996b-c3e497804d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:25.643854 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-19100711-a606-445b-996b-c3e497804d06 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:54:25.645069 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-19100711-a606-445b-996b-c3e497804d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:25.654656 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1160/2345] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:54:25.659205 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a684c-a7ae-476f-a484-89630913986e None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:25.669327 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a684c-a7ae-476f-a484-89630913986e None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:25.673948 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09f44d-b0d4-44ad-9b5b-6c829f951998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:25.674545 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09f44d-b0d4-44ad-9b5b-6c829f951998 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:25.674819 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09f44d-b0d4-44ad-9b5b-6c829f951998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:25.675122 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09f44d-b0d4-44ad-9b5b-6c829f951998 admin admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:25.675774 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09f44d-b0d4-44ad-9b5b-6c829f951998 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:54:25.676100 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09f44d-b0d4-44ad-9b5b-6c829f951998 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:25.677679 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09f44d-b0d4-44ad-9b5b-6c829f951998 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:25.690359 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1186/2346] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:54:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:54:25.694613 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19100711-a606-445b-996b-c3e497804d06 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:25.704214 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19100711-a606-445b-996b-c3e497804d06 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:25.709688 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe76f29-5caa-466c-a017-993cef83f19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:25.710534 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe76f29-5caa-466c-a017-993cef83f19f admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:25.710871 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe76f29-5caa-466c-a017-993cef83f19f admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:25.711117 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe76f29-5caa-466c-a017-993cef83f19f admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:25.712278 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe76f29-5caa-466c-a017-993cef83f19f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:25.714232 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe76f29-5caa-466c-a017-993cef83f19f admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:25.846492 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1161/2347] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:54:25 2022] POST /identity/v3/projects => generated 399 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 07:54:25.850770 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09f44d-b0d4-44ad-9b5b-6c829f951998 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:25.863458 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09f44d-b0d4-44ad-9b5b-6c829f951998 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:25.926104 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b4f7c-37bc-48a3-adbe-dd6b9c0b9a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:25.926884 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b4f7c-37bc-48a3-adbe-dd6b9c0b9a33 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:25.927028 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b4f7c-37bc-48a3-adbe-dd6b9c0b9a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:25.927273 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b4f7c-37bc-48a3-adbe-dd6b9c0b9a33 admin admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:25.927911 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b4f7c-37bc-48a3-adbe-dd6b9c0b9a33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:25.929828 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b4f7c-37bc-48a3-adbe-dd6b9c0b9a33 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:26.051707 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1187/2348] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:54:25 2022] POST /identity/v3/users => generated 300 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:54:26.053423 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe76f29-5caa-466c-a017-993cef83f19f admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:26.064279 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe76f29-5caa-466c-a017-993cef83f19f admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:26.070168 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24899c63-62ed-4f99-a7b5-db16e9b9a2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:26.070795 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24899c63-62ed-4f99-a7b5-db16e9b9a2b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:26.071679 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24899c63-62ed-4f99-a7b5-db16e9b9a2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:26.071944 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24899c63-62ed-4f99-a7b5-db16e9b9a2b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:26.072598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24899c63-62ed-4f99-a7b5-db16e9b9a2b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:26.074204 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24899c63-62ed-4f99-a7b5-db16e9b9a2b4 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:26.086294 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1162/2349] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 07:54:26.092217 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b4f7c-37bc-48a3-adbe-dd6b9c0b9a33 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:26.102210 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b4f7c-37bc-48a3-adbe-dd6b9c0b9a33 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:26.107260 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1180a2d-6cc8-4eb2-804b-42f8aa56b9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:26.107848 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1180a2d-6cc8-4eb2-804b-42f8aa56b9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:26.108127 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1180a2d-6cc8-4eb2-804b-42f8aa56b9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:26.108399 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1180a2d-6cc8-4eb2-804b-42f8aa56b9e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:26.109041 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1180a2d-6cc8-4eb2-804b-42f8aa56b9e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:26.110618 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1180a2d-6cc8-4eb2-804b-42f8aa56b9e7 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:26.123439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1188/2350] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:54:26.127750 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24899c63-62ed-4f99-a7b5-db16e9b9a2b4 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:26.139416 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24899c63-62ed-4f99-a7b5-db16e9b9a2b4 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:26.145046 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253c410-84cc-405d-a4e6-27e6daeddf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:26.145839 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253c410-84cc-405d-a4e6-27e6daeddf72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:26.146293 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253c410-84cc-405d-a4e6-27e6daeddf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:26.146571 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253c410-84cc-405d-a4e6-27e6daeddf72 admin admin] PATH_INFO: `/v3/projects/2e26e08fadba4230856339e1bd7c6e3e/users/c47c30640e604dd4b86765d1d771fe8e/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:26.163695 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d253c410-84cc-405d-a4e6-27e6daeddf72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e26e08fadba4230856339e1bd7c6e3e, user_id=c47c30640e604dd4b86765d1d771fe8e, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:26.167427 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d253c410-84cc-405d-a4e6-27e6daeddf72 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:26.273586 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1163/2351] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:54:26 2022] PUT /identity/v3/projects/2e26e08fadba4230856339e1bd7c6e3e/users/c47c30640e604dd4b86765d1d771fe8e/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:54:26.276136 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c307d17-8f56-4e8e-bc7d-42304485f855 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:26.276533 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c307d17-8f56-4e8e-bc7d-42304485f855 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:26.276995 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c307d17-8f56-4e8e-bc7d-42304485f855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:26.310738 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-4c307d17-8f56-4e8e-bc7d-42304485f855 None None] MFA Rules not processed for user `c47c30640e604dd4b86765d1d771fe8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:54:26.312139 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-4c307d17-8f56-4e8e-bc7d-42304485f855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:26.414663 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1189/2352] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:54:26 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:54:26.437871 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:26.492009 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253c410-84cc-405d-a4e6-27e6daeddf72 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:26.501247 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-d253c410-84cc-405d-a4e6-27e6daeddf72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:26.570283 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253c410-84cc-405d-a4e6-27e6daeddf72 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:26.575329 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456661b-9393-47a7-acc8-4955d7945c80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:26.576149 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456661b-9393-47a7-acc8-4955d7945c80 service cinder] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:26.576286 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456661b-9393-47a7-acc8-4955d7945c80 service cinder] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:26.576732 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456661b-9393-47a7-acc8-4955d7945c80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:26.588758 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1456661b-9393-47a7-acc8-4955d7945c80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:26.590494 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1456661b-9393-47a7-acc8-4955d7945c80 service cinder] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:26.601362 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1164/2353] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:54:26 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 07:54:28.957185 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:29.534219 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:30.214483 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:30.779782 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:31.279720 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f863a-51e8-4e5c-bcab-9cb4c8892ab6 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:31.280040 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f863a-51e8-4e5c-bcab-9cb4c8892ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:31.280348 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f863a-51e8-4e5c-bcab-9cb4c8892ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:31.303835 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-a35f863a-51e8-4e5c-bcab-9cb4c8892ab6 None None] MFA Rules not processed for user `30dc2621143f4604b53bb44b82e8efbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:54:31.305833 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-a35f863a-51e8-4e5c-bcab-9cb4c8892ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:31.390015 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1190/2354] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Aug 26 07:54:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:54:31.406590 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456661b-9393-47a7-acc8-4955d7945c80 service cinder] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:31.408963 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-1456661b-9393-47a7-acc8-4955d7945c80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:31.565879 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456661b-9393-47a7-acc8-4955d7945c80 service cinder] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:31.573966 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4613d5d0-e731-4072-9f4b-be7d400efe0c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3142255c263e44a189db82c621f87e7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:31.574609 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613d5d0-e731-4072-9f4b-be7d400efe0c service swift] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:31.574894 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613d5d0-e731-4072-9f4b-be7d400efe0c service swift] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:31.575227 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613d5d0-e731-4072-9f4b-be7d400efe0c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:31.584560 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4613d5d0-e731-4072-9f4b-be7d400efe0c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:31.586172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4613d5d0-e731-4072-9f4b-be7d400efe0c service swift] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:31.596729 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1165/2355] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 26 07:54:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 26 07:54:31.840882 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:32.996088 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:33.575143 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:34.997423 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:35.111553 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:35.683767 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:35.926702 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:36.364224 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:36.590416 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:36.803299 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f863a-51e8-4e5c-bcab-9cb4c8892ab6 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:36.804039 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-a35f863a-51e8-4e5c-bcab-9cb4c8892ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:36.880465 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f863a-51e8-4e5c-bcab-9cb4c8892ab6 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:36.887247 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ddeb1-c18b-48b2-8a1a-a77faab876a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:36.888174 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ddeb1-c18b-48b2-8a1a-a77faab876a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:36.888628 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ddeb1-c18b-48b2-8a1a-a77faab876a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:36.888904 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ddeb1-c18b-48b2-8a1a-a77faab876a9 admin admin] PATH_INFO: `/v3/users/375c16a7cedf4728bb7b03148ca6e72b` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:36.890483 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ddeb1-c18b-48b2-8a1a-a77faab876a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=375c16a7cedf4728bb7b03148ca6e72b)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:36.892564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ddeb1-c18b-48b2-8a1a-a77faab876a9 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:37.189607 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-227ddeb1-c18b-48b2-8a1a-a77faab876a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '375c16a7cedf4728bb7b03148ca6e72b'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:37.200570 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-227ddeb1-c18b-48b2-8a1a-a77faab876a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '375c16a7cedf4728bb7b03148ca6e72b'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:37.323632 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-227ddeb1-c18b-48b2-8a1a-a77faab876a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '375c16a7cedf4728bb7b03148ca6e72b'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:37.324697 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-227ddeb1-c18b-48b2-8a1a-a77faab876a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '375c16a7cedf4728bb7b03148ca6e72b'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:37.351369 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-227ddeb1-c18b-48b2-8a1a-a77faab876a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '375c16a7cedf4728bb7b03148ca6e72b'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:37.369346 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1191/2356] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:54:36 2022] DELETE /identity/v3/users/375c16a7cedf4728bb7b03148ca6e72b => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:54:37.379518 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e401d7-00e4-417c-90e4-241a3e2f3270 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:37.379883 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e401d7-00e4-417c-90e4-241a3e2f3270 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:37.380172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e401d7-00e4-417c-90e4-241a3e2f3270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:37.401448 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-69e401d7-00e4-417c-90e4-241a3e2f3270 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:54:37.402729 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-69e401d7-00e4-417c-90e4-241a3e2f3270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:37.473327 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1166/2357] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:54:37.485160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ddeb1-c18b-48b2-8a1a-a77faab876a9 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:37.487308 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-227ddeb1-c18b-48b2-8a1a-a77faab876a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:37.564010 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ddeb1-c18b-48b2-8a1a-a77faab876a9 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:37.571520 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b7abc-3e9b-441b-82f5-e1996b6ccb94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:37.572902 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b7abc-3e9b-441b-82f5-e1996b6ccb94 service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:37.573461 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b7abc-3e9b-441b-82f5-e1996b6ccb94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:37.573976 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b7abc-3e9b-441b-82f5-e1996b6ccb94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:37.580468 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:37.586651 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b7abc-3e9b-441b-82f5-e1996b6ccb94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:37.588997 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b7abc-3e9b-441b-82f5-e1996b6ccb94 service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:37.606073 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1192/2358] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:54:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:54:37.860325 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:38.867217 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e401d7-00e4-417c-90e4-241a3e2f3270 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:38.869584 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-69e401d7-00e4-417c-90e4-241a3e2f3270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:38.882507 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e401d7-00e4-417c-90e4-241a3e2f3270 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:38.888649 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda48c05-2e16-41bb-931d-02f2559b0459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:38.890778 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda48c05-2e16-41bb-931d-02f2559b0459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:38.890778 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda48c05-2e16-41bb-931d-02f2559b0459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:38.890778 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda48c05-2e16-41bb-931d-02f2559b0459 admin admin] PATH_INFO: `/v3/projects/6e96ec4063654876909f22132c7c82df` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:38.891651 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda48c05-2e16-41bb-931d-02f2559b0459 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e96ec4063654876909f22132c7c82df)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:38.893698 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda48c05-2e16-41bb-931d-02f2559b0459 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:39.199544 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-dda48c05-2e16-41bb-931d-02f2559b0459 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e96ec4063654876909f22132c7c82df', 'request_id': 'req-dda48c05-2e16-41bb-931d-02f2559b0459'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:39.221816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-dda48c05-2e16-41bb-931d-02f2559b0459 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e96ec4063654876909f22132c7c82df', 'request_id': 'req-dda48c05-2e16-41bb-931d-02f2559b0459'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:39.227345 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b7abc-3e9b-441b-82f5-e1996b6ccb94 service neutron] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:39.231938 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-2d5b7abc-3e9b-441b-82f5-e1996b6ccb94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:39.257583 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b7abc-3e9b-441b-82f5-e1996b6ccb94 service neutron] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:39.329390 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-dda48c05-2e16-41bb-931d-02f2559b0459 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e96ec4063654876909f22132c7c82df', 'request_id': 'req-dda48c05-2e16-41bb-931d-02f2559b0459'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:39.395115 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-dda48c05-2e16-41bb-931d-02f2559b0459 admin admin] The token cache is being invalidate because project 6e96ec4063654876909f22132c7c82df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:54:39.395734 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-dda48c05-2e16-41bb-931d-02f2559b0459 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:39.401033 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-dda48c05-2e16-41bb-931d-02f2559b0459 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:39.403790 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1167/2359] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:54:38 2022] DELETE /identity/v3/projects/6e96ec4063654876909f22132c7c82df => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:54:39.409432 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da3d59-3f05-4552-8063-2415b511b503 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:39.410135 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da3d59-3f05-4552-8063-2415b511b503 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:39.410623 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da3d59-3f05-4552-8063-2415b511b503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:39.473504 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-83da3d59-3f05-4552-8063-2415b511b503 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:54:39.476743 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-83da3d59-3f05-4552-8063-2415b511b503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:39.506935 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12eb335-3fd1-4715-9153-363e1d806385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:39.509068 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12eb335-3fd1-4715-9153-363e1d806385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:39.519448 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12eb335-3fd1-4715-9153-363e1d806385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:39.519886 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12eb335-3fd1-4715-9153-363e1d806385 admin admin] PATH_INFO: `/v3/users/c47c30640e604dd4b86765d1d771fe8e` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:39.522786 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1168/2360] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:54:39.525524 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12eb335-3fd1-4715-9153-363e1d806385 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c47c30640e604dd4b86765d1d771fe8e)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:39.530404 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12eb335-3fd1-4715-9153-363e1d806385 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:39.530914 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc7249-1769-4ee9-a6b5-73d83e6dc509 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:39.531391 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc7249-1769-4ee9-a6b5-73d83e6dc509 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:39.531819 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc7249-1769-4ee9-a6b5-73d83e6dc509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:39.589520 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-fabc7249-1769-4ee9-a6b5-73d83e6dc509 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:54:39.592561 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-fabc7249-1769-4ee9-a6b5-73d83e6dc509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:39.627480 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1169/2361] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:54:39.641553 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc7249-1769-4ee9-a6b5-73d83e6dc509 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:39.663185 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc7249-1769-4ee9-a6b5-73d83e6dc509 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:39.690406 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa137f5-0ab2-402a-8b65-32938322670a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:39.693625 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa137f5-0ab2-402a-8b65-32938322670a admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:39.694177 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa137f5-0ab2-402a-8b65-32938322670a admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:39.694642 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa137f5-0ab2-402a-8b65-32938322670a admin admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:39.697536 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa137f5-0ab2-402a-8b65-32938322670a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:54:39.698054 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa137f5-0ab2-402a-8b65-32938322670a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:39.700491 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa137f5-0ab2-402a-8b65-32938322670a admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:39.730545 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1170/2362] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:54:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:54:39.731628 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa137f5-0ab2-402a-8b65-32938322670a admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:39.748212 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa137f5-0ab2-402a-8b65-32938322670a admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:39.754385 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9ee01-68d5-42c2-971d-3c891d19f98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:39.755141 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9ee01-68d5-42c2-971d-3c891d19f98d admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:39.755496 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9ee01-68d5-42c2-971d-3c891d19f98d admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:39.755977 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9ee01-68d5-42c2-971d-3c891d19f98d admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:39.756692 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9ee01-68d5-42c2-971d-3c891d19f98d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:39.759907 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9ee01-68d5-42c2-971d-3c891d19f98d admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:39.818265 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-a12eb335-3fd1-4715-9153-363e1d806385 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c47c30640e604dd4b86765d1d771fe8e'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:39.827466 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-a12eb335-3fd1-4715-9153-363e1d806385 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c47c30640e604dd4b86765d1d771fe8e'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:39.905708 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1171/2363] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:54:39 2022] POST /identity/v3/projects => generated 377 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:54:39.910241 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9ee01-68d5-42c2-971d-3c891d19f98d admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:39.964738 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-a12eb335-3fd1-4715-9153-363e1d806385 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c47c30640e604dd4b86765d1d771fe8e'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:39.965191 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-a12eb335-3fd1-4715-9153-363e1d806385 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c47c30640e604dd4b86765d1d771fe8e'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:39.983445 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-a12eb335-3fd1-4715-9153-363e1d806385 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c47c30640e604dd4b86765d1d771fe8e'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:40.000275 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1193/2364] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:54:39 2022] DELETE /identity/v3/users/c47c30640e604dd4b86765d1d771fe8e => generated 0 bytes in 778 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:54:40.002360 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ddde4-37a5-44f3-bfbe-d0b87d52467f None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:40.002722 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ddde4-37a5-44f3-bfbe-d0b87d52467f None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:40.003100 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ddde4-37a5-44f3-bfbe-d0b87d52467f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:40.031902 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:40.036853 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-2b3ddde4-37a5-44f3-bfbe-d0b87d52467f None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:54:40.039232 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-2b3ddde4-37a5-44f3-bfbe-d0b87d52467f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:40.046621 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9ee01-68d5-42c2-971d-3c891d19f98d admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:40.155427 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1194/2365] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:54:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:54:40.172947 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6068c9-b928-4829-a144-cfb44db06b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:40.173818 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6068c9-b928-4829-a144-cfb44db06b88 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:40.174114 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6068c9-b928-4829-a144-cfb44db06b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:40.174378 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6068c9-b928-4829-a144-cfb44db06b88 admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:40.175182 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6068c9-b928-4829-a144-cfb44db06b88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:40.177244 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ddde4-37a5-44f3-bfbe-d0b87d52467f None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:40.179653 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-2b3ddde4-37a5-44f3-bfbe-d0b87d52467f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:40.181163 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6068c9-b928-4829-a144-cfb44db06b88 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:40.270918 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ddde4-37a5-44f3-bfbe-d0b87d52467f None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:40.280744 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab9254-1608-4d05-8cad-447019c606d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:40.281492 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab9254-1608-4d05-8cad-447019c606d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:40.281648 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab9254-1608-4d05-8cad-447019c606d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:40.281934 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab9254-1608-4d05-8cad-447019c606d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:40.306538 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1172/2366] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:54:39 2022] POST /identity/v3/users => generated 289 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:54:40.311586 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6068c9-b928-4829-a144-cfb44db06b88 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:40.314759 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab9254-1608-4d05-8cad-447019c606d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:40.317663 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-9a6068c9-b928-4829-a144-cfb44db06b88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:40.323772 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab9254-1608-4d05-8cad-447019c606d1 service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:40.345298 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1195/2367] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:54:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:54:40.353965 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6068c9-b928-4829-a144-cfb44db06b88 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:40.359422 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce86cd-f476-4429-8a87-8c02f0572753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:40.360074 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce86cd-f476-4429-8a87-8c02f0572753 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:40.360401 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce86cd-f476-4429-8a87-8c02f0572753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:40.360708 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce86cd-f476-4429-8a87-8c02f0572753 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:40.361466 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce86cd-f476-4429-8a87-8c02f0572753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:40.364191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce86cd-f476-4429-8a87-8c02f0572753 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:40.389629 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1173/2368] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 07:54:40.390444 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:40.400717 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab9254-1608-4d05-8cad-447019c606d1 service neutron] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:40.415162 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab9254-1608-4d05-8cad-447019c606d1 service neutron] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:40.432321 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e555810-e60d-442b-96a0-5fd618a86ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:40.434537 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e555810-e60d-442b-96a0-5fd618a86ccd admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:40.434537 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e555810-e60d-442b-96a0-5fd618a86ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:40.434537 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e555810-e60d-442b-96a0-5fd618a86ccd admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:40.434537 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e555810-e60d-442b-96a0-5fd618a86ccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:40.463384 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e555810-e60d-442b-96a0-5fd618a86ccd admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:40.496060 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce86cd-f476-4429-8a87-8c02f0572753 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:40.509139 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1196/2369] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:54:40.516172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce86cd-f476-4429-8a87-8c02f0572753 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:40.529588 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77936e8d-bf3a-40de-bae4-25d0e1bca804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:40.529588 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77936e8d-bf3a-40de-bae4-25d0e1bca804 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:40.529588 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77936e8d-bf3a-40de-bae4-25d0e1bca804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:40.529588 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77936e8d-bf3a-40de-bae4-25d0e1bca804 admin admin] PATH_INFO: `/v3/projects/b46ee52dcf494a37a0b0928eec3d407c/users/104001160e274732be5e9f75dfee5501/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:40.565892 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77936e8d-bf3a-40de-bae4-25d0e1bca804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b46ee52dcf494a37a0b0928eec3d407c, user_id=104001160e274732be5e9f75dfee5501, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:40.569096 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77936e8d-bf3a-40de-bae4-25d0e1bca804 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:40.684693 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1174/2370] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:54:40 2022] PUT /identity/v3/projects/b46ee52dcf494a37a0b0928eec3d407c/users/104001160e274732be5e9f75dfee5501/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:54:40.689962 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ffb7e2-cd61-44e8-9cbe-73d05f93b0fb None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:40.690670 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ffb7e2-cd61-44e8-9cbe-73d05f93b0fb None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:40.691080 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ffb7e2-cd61-44e8-9cbe-73d05f93b0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:40.730150 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-61ffb7e2-cd61-44e8-9cbe-73d05f93b0fb None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:54:40.732025 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-61ffb7e2-cd61-44e8-9cbe-73d05f93b0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:40.901993 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1197/2371] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:54:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:54:40.931154 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77936e8d-bf3a-40de-bae4-25d0e1bca804 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:41.086060 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77936e8d-bf3a-40de-bae4-25d0e1bca804 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:41.099373 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7e53e-514e-432c-91fa-718d5b7a76be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:41.117936 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7e53e-514e-432c-91fa-718d5b7a76be service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:41.121116 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7e53e-514e-432c-91fa-718d5b7a76be service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:41.121515 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7e53e-514e-432c-91fa-718d5b7a76be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:41.151196 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7e53e-514e-432c-91fa-718d5b7a76be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:41.156057 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7e53e-514e-432c-91fa-718d5b7a76be service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:41.176232 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1175/2372] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:54:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:54:41.338895 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:41.430441 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ffb7e2-cd61-44e8-9cbe-73d05f93b0fb None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:41.432262 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-61ffb7e2-cd61-44e8-9cbe-73d05f93b0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:41.508800 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ffb7e2-cd61-44e8-9cbe-73d05f93b0fb None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:41.533170 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff056b-b53e-4e81-aa9e-651eb149c616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:41.534232 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff056b-b53e-4e81-aa9e-651eb149c616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:41.534675 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff056b-b53e-4e81-aa9e-651eb149c616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:41.535585 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff056b-b53e-4e81-aa9e-651eb149c616 admin admin] PATH_INFO: `/v3/projects/2e26e08fadba4230856339e1bd7c6e3e` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:41.540290 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff056b-b53e-4e81-aa9e-651eb149c616 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e26e08fadba4230856339e1bd7c6e3e)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:41.546437 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff056b-b53e-4e81-aa9e-651eb149c616 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:41.842154 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-f0ff056b-b53e-4e81-aa9e-651eb149c616 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e26e08fadba4230856339e1bd7c6e3e', 'request_id': 'req-f0ff056b-b53e-4e81-aa9e-651eb149c616'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:41.865646 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-f0ff056b-b53e-4e81-aa9e-651eb149c616 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e26e08fadba4230856339e1bd7c6e3e', 'request_id': 'req-f0ff056b-b53e-4e81-aa9e-651eb149c616'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:41.901335 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-f0ff056b-b53e-4e81-aa9e-651eb149c616 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e26e08fadba4230856339e1bd7c6e3e', 'request_id': 'req-f0ff056b-b53e-4e81-aa9e-651eb149c616'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:42.076467 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-f0ff056b-b53e-4e81-aa9e-651eb149c616 admin admin] The token cache is being invalidate because project 2e26e08fadba4230856339e1bd7c6e3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:54:42.077106 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-f0ff056b-b53e-4e81-aa9e-651eb149c616 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:42.078250 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-f0ff056b-b53e-4e81-aa9e-651eb149c616 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:54:42.081353 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1198/2373] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:54:41 2022] DELETE /identity/v3/projects/2e26e08fadba4230856339e1bd7c6e3e => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:54:42.586214 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=88,keystone:DELETE=6,keystone:INSERT=6 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:43.340082 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:45.477203 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:46.149109 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:46.544504 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:49.780148 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:50.065188 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:50.466950 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a658b75-db1e-4416-8e99-b97a74cccb03 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:50.467264 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a658b75-db1e-4416-8e99-b97a74cccb03 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:50.467537 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a658b75-db1e-4416-8e99-b97a74cccb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:50.511510 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-8a658b75-db1e-4416-8e99-b97a74cccb03 None None] MFA Rules not processed for user `104001160e274732be5e9f75dfee5501`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:54:50.512735 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-8a658b75-db1e-4416-8e99-b97a74cccb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:50.665347 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1176/2374] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:54:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:54:50.667612 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff056b-b53e-4e81-aa9e-651eb149c616 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:50.669658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-f0ff056b-b53e-4e81-aa9e-651eb149c616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:50.793151 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff056b-b53e-4e81-aa9e-651eb149c616 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:50.802881 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462d266-a218-48b2-9eb6-28ada10cc82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:50.802881 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462d266-a218-48b2-9eb6-28ada10cc82f admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:50.802881 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462d266-a218-48b2-9eb6-28ada10cc82f admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:50.802881 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462d266-a218-48b2-9eb6-28ada10cc82f admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:50.803290 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1462d266-a218-48b2-9eb6-28ada10cc82f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:50.803290 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1462d266-a218-48b2-9eb6-28ada10cc82f admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:50.942284 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1199/2375] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:54:50 2022] POST /identity/v3/projects => generated 379 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:54:50.946613 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a658b75-db1e-4416-8e99-b97a74cccb03 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:50.958490 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a658b75-db1e-4416-8e99-b97a74cccb03 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:51.047368 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc1cada-5947-4fee-8052-85c2800ca702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:51.048029 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1cada-5947-4fee-8052-85c2800ca702 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:51.048283 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1cada-5947-4fee-8052-85c2800ca702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:51.048738 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1cada-5947-4fee-8052-85c2800ca702 admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:51.049649 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc1cada-5947-4fee-8052-85c2800ca702 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:51.051707 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc1cada-5947-4fee-8052-85c2800ca702 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:51.170717 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1177/2376] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:54:50 2022] POST /identity/v3/users => generated 296 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:54:51.175092 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462d266-a218-48b2-9eb6-28ada10cc82f admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:51.192880 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462d266-a218-48b2-9eb6-28ada10cc82f admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:51.199227 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf6689-fd4e-4c21-a4a5-d4c60496056b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:51.199961 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf6689-fd4e-4c21-a4a5-d4c60496056b admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:51.200306 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf6689-fd4e-4c21-a4a5-d4c60496056b admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:51.200788 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf6689-fd4e-4c21-a4a5-d4c60496056b admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:51.202105 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf6689-fd4e-4c21-a4a5-d4c60496056b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:51.203882 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf6689-fd4e-4c21-a4a5-d4c60496056b admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:51.221606 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1200/2377] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:54:51.225568 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc1cada-5947-4fee-8052-85c2800ca702 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:51.240181 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc1cada-5947-4fee-8052-85c2800ca702 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:51.245686 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac354e1-6d7c-4d75-b0dc-e7ad08fc19a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:51.246909 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac354e1-6d7c-4d75-b0dc-e7ad08fc19a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:51.247342 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac354e1-6d7c-4d75-b0dc-e7ad08fc19a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:51.247918 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac354e1-6d7c-4d75-b0dc-e7ad08fc19a2 admin admin] PATH_INFO: `/v3/projects/59130f868e4e44fa817cfa1c9543ad6d/users/abc98b13d8dd488a96f15ff6f372cef8/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:51.264198 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac354e1-6d7c-4d75-b0dc-e7ad08fc19a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59130f868e4e44fa817cfa1c9543ad6d, user_id=abc98b13d8dd488a96f15ff6f372cef8, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:51.266873 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac354e1-6d7c-4d75-b0dc-e7ad08fc19a2 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:51.282784 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:51.400655 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1178/2378] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:54:51 2022] PUT /identity/v3/projects/59130f868e4e44fa817cfa1c9543ad6d/users/abc98b13d8dd488a96f15ff6f372cef8/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:54:51.401948 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf6689-fd4e-4c21-a4a5-d4c60496056b admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:51.417032 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf6689-fd4e-4c21-a4a5-d4c60496056b admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:51.501598 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0324d9-ed9c-4a91-912d-fe5b42913171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:51.502908 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0324d9-ed9c-4a91-912d-fe5b42913171 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:51.503310 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0324d9-ed9c-4a91-912d-fe5b42913171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:51.504203 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0324d9-ed9c-4a91-912d-fe5b42913171 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:51.505215 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0324d9-ed9c-4a91-912d-fe5b42913171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:51.507941 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0324d9-ed9c-4a91-912d-fe5b42913171 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:51.522785 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1201/2379] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:54:51.527410 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac354e1-6d7c-4d75-b0dc-e7ad08fc19a2 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:51.537891 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac354e1-6d7c-4d75-b0dc-e7ad08fc19a2 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:51.543479 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a4177-3770-4a57-ae67-54c398afc4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:51.547101 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a4177-3770-4a57-ae67-54c398afc4fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:51.547101 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a4177-3770-4a57-ae67-54c398afc4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:51.547101 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a4177-3770-4a57-ae67-54c398afc4fd admin admin] PATH_INFO: `/v3/projects/59130f868e4e44fa817cfa1c9543ad6d/users/abc98b13d8dd488a96f15ff6f372cef8/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:51.547101 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a4177-3770-4a57-ae67-54c398afc4fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=59130f868e4e44fa817cfa1c9543ad6d, user_id=abc98b13d8dd488a96f15ff6f372cef8, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:51.549429 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a4177-3770-4a57-ae67-54c398afc4fd admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:51.568137 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1179/2380] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:54:51 2022] PUT /identity/v3/projects/59130f868e4e44fa817cfa1c9543ad6d/users/abc98b13d8dd488a96f15ff6f372cef8/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:54:53.251102 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:54.755547 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:55.082733 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d2be6-5e67-4ad7-b98c-1dd4b05455db None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:55.089789 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d2be6-5e67-4ad7-b98c-1dd4b05455db None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:55.090221 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d2be6-5e67-4ad7-b98c-1dd4b05455db None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:55.097274 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1202/2381] 10.222.0.42 () {54 vars in 921 bytes} [Fri Aug 26 07:54:55 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:54:55.104849 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f68d05-b4d5-4097-9d58-ff7199e160ce None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:55.105355 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f68d05-b4d5-4097-9d58-ff7199e160ce None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:55.107779 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f68d05-b4d5-4097-9d58-ff7199e160ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:55.136916 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-45f68d05-b4d5-4097-9d58-ff7199e160ce None None] MFA Rules not processed for user `bc92c0a0a2cc4722868e6877bac93ada`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:54:55.139103 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-45f68d05-b4d5-4097-9d58-ff7199e160ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:55.199784 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:55.302670 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1180/2382] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Aug 26 07:54:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:54:55.747559 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:56.677775 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d2be6-5e67-4ad7-b98c-1dd4b05455db None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:56.681194 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-e69d2be6-5e67-4ad7-b98c-1dd4b05455db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:56.799724 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d2be6-5e67-4ad7-b98c-1dd4b05455db None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:56.812585 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21f14d-625e-402a-8052-c2ad8ce60368 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c2bc293f1b4daca83e8d6dff66a316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:56.813964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21f14d-625e-402a-8052-c2ad8ce60368 service placement] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:56.814718 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21f14d-625e-402a-8052-c2ad8ce60368 service placement] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:56.815412 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21f14d-625e-402a-8052-c2ad8ce60368 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:56.817380 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-ff21f14d-625e-402a-8052-c2ad8ce60368 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:56.837865 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff21f14d-625e-402a-8052-c2ad8ce60368 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:56.839955 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff21f14d-625e-402a-8052-c2ad8ce60368 service placement] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:56.864329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1203/2383] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:54:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 07:54:57.162412 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:57.592057 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:57.684876 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f68d05-b4d5-4097-9d58-ff7199e160ce None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:57.686926 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-45f68d05-b4d5-4097-9d58-ff7199e160ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:57.781146 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f68d05-b4d5-4097-9d58-ff7199e160ce None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:57.790117 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0acad-24b3-4fba-8051-fda3e5bb5370 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df7725203304d8fbe3a768656cabf23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:57.791264 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0acad-24b3-4fba-8051-fda3e5bb5370 service glance] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:57.791650 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0acad-24b3-4fba-8051-fda3e5bb5370 service glance] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:57.792016 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0acad-24b3-4fba-8051-fda3e5bb5370 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:57.818839 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0acad-24b3-4fba-8051-fda3e5bb5370 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:57.821496 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0acad-24b3-4fba-8051-fda3e5bb5370 service glance] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:57.838490 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1181/2384] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:54:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:54:58.177097 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11591ba-3071-4d4b-9176-dbb33f3b2f30 None None] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:58.177696 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11591ba-3071-4d4b-9176-dbb33f3b2f30 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:58.177696 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11591ba-3071-4d4b-9176-dbb33f3b2f30 None None] PATH_INFO: `/` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:58.180319 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1204/2385] 10.222.0.42 () {54 vars in 921 bytes} [Fri Aug 26 07:54:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:54:58.189187 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffa304-6f50-462d-ad4d-27d3c84cdfd3 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:58.190166 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffa304-6f50-462d-ad4d-27d3c84cdfd3 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:58.190166 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffa304-6f50-462d-ad4d-27d3c84cdfd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:58.228200 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-c4ffa304-6f50-462d-ad4d-27d3c84cdfd3 None None] MFA Rules not processed for user `a5ea9916c82647f3a645f1a4258f558b`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:54:58.229466 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-c4ffa304-6f50-462d-ad4d-27d3c84cdfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:58.354641 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1182/2386] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Aug 26 07:54:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:54:58.368346 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11591ba-3071-4d4b-9176-dbb33f3b2f30 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:58.370525 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-f11591ba-3071-4d4b-9176-dbb33f3b2f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:58.378176 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:58.399796 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11591ba-3071-4d4b-9176-dbb33f3b2f30 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:58.404146 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3cded0-23de-45ba-a268-aa7ec80f245d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:58.405214 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3cded0-23de-45ba-a268-aa7ec80f245d service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:58.405651 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3cded0-23de-45ba-a268-aa7ec80f245d service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:58.406211 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3cded0-23de-45ba-a268-aa7ec80f245d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:58.415442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=84,keystone:INSERT=2,keystone:DELETE=14 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:54:58.416994 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3cded0-23de-45ba-a268-aa7ec80f245d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:58.418645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3cded0-23de-45ba-a268-aa7ec80f245d service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:58.428829 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1205/2387] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:54:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:54:58.534335 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4016b-cbf1-43e6-89f4-f242388b9109 None None] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:58.534773 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4016b-cbf1-43e6-89f4-f242388b9109 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:58.535239 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4016b-cbf1-43e6-89f4-f242388b9109 None None] PATH_INFO: `/` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:58.537700 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1183/2388] 10.222.0.42 () {54 vars in 921 bytes} [Fri Aug 26 07:54:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 07:54:58.546525 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22492f2b-44e8-4725-a28a-51d213c2f815 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:58.547094 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22492f2b-44e8-4725-a28a-51d213c2f815 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:58.547579 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22492f2b-44e8-4725-a28a-51d213c2f815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:58.574367 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-22492f2b-44e8-4725-a28a-51d213c2f815 None None] MFA Rules not processed for user `bc92c0a0a2cc4722868e6877bac93ada`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:54:58.575875 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-22492f2b-44e8-4725-a28a-51d213c2f815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:58.588075 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1206/2389] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Aug 26 07:54:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:54:58.600109 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4016b-cbf1-43e6-89f4-f242388b9109 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:58.627759 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4016b-cbf1-43e6-89f4-f242388b9109 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:58.632618 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f889489f-18fd-494e-b29c-6c91960765cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:58.633681 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889489f-18fd-494e-b29c-6c91960765cb service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:58.634072 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889489f-18fd-494e-b29c-6c91960765cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:58.634439 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889489f-18fd-494e-b29c-6c91960765cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:58.646332 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f889489f-18fd-494e-b29c-6c91960765cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:54:58.647817 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f889489f-18fd-494e-b29c-6c91960765cb service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:54:58.660087 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1184/2390] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:54:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:54:59.697976 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b091a-93e5-43cf-b39a-5df27094d2f1 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:59.698478 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b091a-93e5-43cf-b39a-5df27094d2f1 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:59.698588 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b091a-93e5-43cf-b39a-5df27094d2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:59.758922 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-d77b091a-93e5-43cf-b39a-5df27094d2f1 None None] MFA Rules not processed for user `abc98b13d8dd488a96f15ff6f372cef8`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:54:59.762557 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-d77b091a-93e5-43cf-b39a-5df27094d2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:59.858617 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1207/2391] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:54:59 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:54:59.876168 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f889489f-18fd-494e-b29c-6c91960765cb service neutron] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:54:59.885542 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-f889489f-18fd-494e-b29c-6c91960765cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:54:59.903247 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f889489f-18fd-494e-b29c-6c91960765cb service neutron] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:54:59.911120 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4cf26e-2a55-4e30-8a4e-7243cd337e70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc92c0a0a2cc4722868e6877bac93ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:54:59.912130 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4cf26e-2a55-4e30-8a4e-7243cd337e70 service nova] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:54:59.912612 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4cf26e-2a55-4e30-8a4e-7243cd337e70 service nova] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:54:59.913086 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4cf26e-2a55-4e30-8a4e-7243cd337e70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:54:59.999448 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4cf26e-2a55-4e30-8a4e-7243cd337e70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:55:00.001121 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4cf26e-2a55-4e30-8a4e-7243cd337e70 service nova] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:55:00.012214 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1185/2392] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:54:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:55:00.061248 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:00.527962 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:01.611782 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:02.848195 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:03.547242 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:04.463972 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:05.023699 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f2297-e868-4063-ac89-856bcaf5889b None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:55:05.024529 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f2297-e868-4063-ac89-856bcaf5889b None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:55:05.024975 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f2297-e868-4063-ac89-856bcaf5889b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:55:05.044798 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-c82f2297-e868-4063-ac89-856bcaf5889b None None] MFA Rules not processed for user `30dc2621143f4604b53bb44b82e8efbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:55:05.046139 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-c82f2297-e868-4063-ac89-856bcaf5889b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:55:05.123634 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1208/2393] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Aug 26 07:55:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:55:05.146167 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4cf26e-2a55-4e30-8a4e-7243cd337e70 service nova] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:55:05.147660 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-7a4cf26e-2a55-4e30-8a4e-7243cd337e70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:55:05.230314 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4cf26e-2a55-4e30-8a4e-7243cd337e70 service nova] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:55:05.236088 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3a082-adf7-4a01-a13a-d974dd95a695 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3142255c263e44a189db82c621f87e7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:55:05.240348 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3a082-adf7-4a01-a13a-d974dd95a695 service swift] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:55:05.240348 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3a082-adf7-4a01-a13a-d974dd95a695 service swift] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:55:05.240348 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3a082-adf7-4a01-a13a-d974dd95a695 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:55:05.247195 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b3a082-adf7-4a01-a13a-d974dd95a695 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:55:05.248812 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b3a082-adf7-4a01-a13a-d974dd95a695 service swift] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:55:05.257911 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1186/2394] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 26 07:55:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 07:55:05.634356 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:06.590308 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:07.544267 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:09.031896 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:09.500427 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:09.852360 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:09.887716 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:10.512919 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:10.589474 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:11.693584 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:11.774659 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:12.143592 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=83,keystone:DELETE=11,keystone:INSERT=6 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:12.186365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:12.500917 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:12.728168 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:13.028293 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:13.979661 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:14.811994 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:15.493727 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:15.600891 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f2297-e868-4063-ac89-856bcaf5889b None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:55:15.607919 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-c82f2297-e868-4063-ac89-856bcaf5889b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:55:15.693840 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f2297-e868-4063-ac89-856bcaf5889b None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:55:15.700775 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e29e472-281d-4688-8924-4d12e6e17daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:55:15.701458 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29e472-281d-4688-8924-4d12e6e17daa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:55:15.701718 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29e472-281d-4688-8924-4d12e6e17daa admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:55:15.701991 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29e472-281d-4688-8924-4d12e6e17daa admin admin] PATH_INFO: `/v3/users/9345ba58cae54ccb8782d2bdefdb793b` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:55:15.703578 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e29e472-281d-4688-8924-4d12e6e17daa admin admin] RBAC: Authorizing `identity:delete_user(user_id=9345ba58cae54ccb8782d2bdefdb793b)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:55:15.705534 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e29e472-281d-4688-8924-4d12e6e17daa admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:55:15.869493 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:15.984785 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-5e29e472-281d-4688-8924-4d12e6e17daa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9345ba58cae54ccb8782d2bdefdb793b'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:55:16.005670 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-5e29e472-281d-4688-8924-4d12e6e17daa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9345ba58cae54ccb8782d2bdefdb793b'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:55:16.268681 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-5e29e472-281d-4688-8924-4d12e6e17daa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9345ba58cae54ccb8782d2bdefdb793b'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:55:16.269618 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-5e29e472-281d-4688-8924-4d12e6e17daa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9345ba58cae54ccb8782d2bdefdb793b'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:55:16.291546 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-5e29e472-281d-4688-8924-4d12e6e17daa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9345ba58cae54ccb8782d2bdefdb793b'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:55:16.297810 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1209/2395] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:55:15 2022] DELETE /identity/v3/users/9345ba58cae54ccb8782d2bdefdb793b => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:55:16.303109 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e2b84-4725-4527-a204-3ae19b375c1a None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:55:16.303577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e2b84-4725-4527-a204-3ae19b375c1a None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:55:16.305219 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e2b84-4725-4527-a204-3ae19b375c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:55:16.328874 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-178e2b84-4725-4527-a204-3ae19b375c1a None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:55:16.330115 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-178e2b84-4725-4527-a204-3ae19b375c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:55:16.406391 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1187/2396] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:55:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:55:16.417374 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e29e472-281d-4688-8924-4d12e6e17daa admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:55:16.418971 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-5e29e472-281d-4688-8924-4d12e6e17daa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:55:16.485144 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e29e472-281d-4688-8924-4d12e6e17daa admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:55:16.489878 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bee688-96e8-496c-be19-6ecf571bf787 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:55:16.492125 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bee688-96e8-496c-be19-6ecf571bf787 service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:55:16.492125 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bee688-96e8-496c-be19-6ecf571bf787 service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:55:16.492125 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bee688-96e8-496c-be19-6ecf571bf787 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:55:16.501643 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bee688-96e8-496c-be19-6ecf571bf787 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:55:16.503115 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bee688-96e8-496c-be19-6ecf571bf787 service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:55:16.513694 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1210/2397] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:55:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 07:55:16.687770 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:17.066305 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e2b84-4725-4527-a204-3ae19b375c1a None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:55:17.068925 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-178e2b84-4725-4527-a204-3ae19b375c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:55:17.084886 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e2b84-4725-4527-a204-3ae19b375c1a None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:55:17.093762 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8749612e-9cf1-453a-86f0-8cc9a49c354d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:55:17.099993 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749612e-9cf1-453a-86f0-8cc9a49c354d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:55:17.099993 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749612e-9cf1-453a-86f0-8cc9a49c354d admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:55:17.099993 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749612e-9cf1-453a-86f0-8cc9a49c354d admin admin] PATH_INFO: `/v3/projects/d31da4bb956940eeadd88170acbc8c11` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:55:17.104403 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8749612e-9cf1-453a-86f0-8cc9a49c354d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d31da4bb956940eeadd88170acbc8c11)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:55:17.108546 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8749612e-9cf1-453a-86f0-8cc9a49c354d admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:55:17.213690 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:17.267385 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-8749612e-9cf1-453a-86f0-8cc9a49c354d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd31da4bb956940eeadd88170acbc8c11', 'request_id': 'req-8749612e-9cf1-453a-86f0-8cc9a49c354d'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:55:17.276414 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-8749612e-9cf1-453a-86f0-8cc9a49c354d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd31da4bb956940eeadd88170acbc8c11', 'request_id': 'req-8749612e-9cf1-453a-86f0-8cc9a49c354d'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:55:17.436061 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-8749612e-9cf1-453a-86f0-8cc9a49c354d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd31da4bb956940eeadd88170acbc8c11', 'request_id': 'req-8749612e-9cf1-453a-86f0-8cc9a49c354d'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:55:17.450821 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-8749612e-9cf1-453a-86f0-8cc9a49c354d admin admin] The token cache is being invalidate because project d31da4bb956940eeadd88170acbc8c11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:55:17.451159 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-8749612e-9cf1-453a-86f0-8cc9a49c354d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:55:17.451850 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-8749612e-9cf1-453a-86f0-8cc9a49c354d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:55:17.453367 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1188/2398] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:55:17 2022] DELETE /identity/v3/projects/d31da4bb956940eeadd88170acbc8c11 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:55:17.459271 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c4a02-8f3b-49be-b5a3-7086cbdb1a6d None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:55:17.459731 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c4a02-8f3b-49be-b5a3-7086cbdb1a6d None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:55:17.460008 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c4a02-8f3b-49be-b5a3-7086cbdb1a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:55:17.485299 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-8a9c4a02-8f3b-49be-b5a3-7086cbdb1a6d None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:55:17.486523 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-8a9c4a02-8f3b-49be-b5a3-7086cbdb1a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:55:17.551477 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1211/2399] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:55:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:55:17.559728 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564899d8-d13e-4a0a-8f1c-034d88bb07e0 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:55:17.560013 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564899d8-d13e-4a0a-8f1c-034d88bb07e0 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:55:17.560314 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564899d8-d13e-4a0a-8f1c-034d88bb07e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:55:17.580232 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-564899d8-d13e-4a0a-8f1c-034d88bb07e0 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:55:17.581356 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-564899d8-d13e-4a0a-8f1c-034d88bb07e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:55:17.590207 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1189/2400] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:55:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:55:17.594573 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c4a02-8f3b-49be-b5a3-7086cbdb1a6d None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:55:17.606461 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c4a02-8f3b-49be-b5a3-7086cbdb1a6d None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:55:17.611263 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb225e-4b6e-4446-ac20-80844aaf11c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:55:17.619329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb225e-4b6e-4446-ac20-80844aaf11c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:55:17.619329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb225e-4b6e-4446-ac20-80844aaf11c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:55:17.619329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb225e-4b6e-4446-ac20-80844aaf11c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:55:17.619329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecb225e-4b6e-4446-ac20-80844aaf11c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:55:17.619329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecb225e-4b6e-4446-ac20-80844aaf11c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:55:17.619329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecb225e-4b6e-4446-ac20-80844aaf11c0 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:55:17.633815 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1212/2401] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:55:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:55:17.639350 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564899d8-d13e-4a0a-8f1c-034d88bb07e0 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:55:17.649366 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564899d8-d13e-4a0a-8f1c-034d88bb07e0 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:55:17.654257 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd375f99-1513-44c0-9084-7247acc319d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:55:17.654864 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd375f99-1513-44c0-9084-7247acc319d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:55:17.665181 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd375f99-1513-44c0-9084-7247acc319d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:55:17.665181 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd375f99-1513-44c0-9084-7247acc319d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:55:17.665181 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd375f99-1513-44c0-9084-7247acc319d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:55:17.665181 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd375f99-1513-44c0-9084-7247acc319d9 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:55:17.685924 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:17.844177 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1190/2402] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:55:17 2022] POST /identity/v3/projects => generated 371 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:55:17.848466 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb225e-4b6e-4446-ac20-80844aaf11c0 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:55:17.861875 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb225e-4b6e-4446-ac20-80844aaf11c0 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:55:17.922642 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072143ee-b408-419e-80d3-cc45af951fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:55:17.923364 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072143ee-b408-419e-80d3-cc45af951fc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:55:17.923653 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072143ee-b408-419e-80d3-cc45af951fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:55:17.923947 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072143ee-b408-419e-80d3-cc45af951fc9 admin admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:55:17.924622 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072143ee-b408-419e-80d3-cc45af951fc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:55:17.926658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072143ee-b408-419e-80d3-cc45af951fc9 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:55:18.103830 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1213/2403] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:55:17 2022] POST /identity/v3/users => generated 286 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:55:18.108434 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd375f99-1513-44c0-9084-7247acc319d9 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:55:18.123175 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd375f99-1513-44c0-9084-7247acc319d9 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:55:18.129976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff89b4d-a08e-43a7-93a7-d9a7631955c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:55:18.130605 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff89b4d-a08e-43a7-93a7-d9a7631955c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:55:18.130891 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff89b4d-a08e-43a7-93a7-d9a7631955c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:55:18.131199 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff89b4d-a08e-43a7-93a7-d9a7631955c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:55:18.132984 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff89b4d-a08e-43a7-93a7-d9a7631955c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:55:18.134626 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff89b4d-a08e-43a7-93a7-d9a7631955c0 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:55:18.146036 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1191/2404] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 07:55:18.151461 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072143ee-b408-419e-80d3-cc45af951fc9 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:55:18.162295 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072143ee-b408-419e-80d3-cc45af951fc9 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:55:18.167820 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568644a-2817-4cf9-bceb-db597885d5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:55:18.168463 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568644a-2817-4cf9-bceb-db597885d5ac admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:55:18.168728 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568644a-2817-4cf9-bceb-db597885d5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:55:18.169000 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568644a-2817-4cf9-bceb-db597885d5ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:55:18.169779 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2568644a-2817-4cf9-bceb-db597885d5ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:55:18.171435 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2568644a-2817-4cf9-bceb-db597885d5ac admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:55:18.182743 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1214/2405] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:55:18.187290 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff89b4d-a08e-43a7-93a7-d9a7631955c0 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:55:18.200975 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff89b4d-a08e-43a7-93a7-d9a7631955c0 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:55:18.206329 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f94c34c-c710-4bed-9452-c5ff4f008c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:55:18.206976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94c34c-c710-4bed-9452-c5ff4f008c00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:55:18.207656 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94c34c-c710-4bed-9452-c5ff4f008c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:55:18.207867 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94c34c-c710-4bed-9452-c5ff4f008c00 admin admin] PATH_INFO: `/v3/projects/770852aef3624c71a91b2de6d214f78c/users/fb6b1f7a25d74c94ad109fa6b97796b9/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:55:18.227377 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f94c34c-c710-4bed-9452-c5ff4f008c00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=770852aef3624c71a91b2de6d214f78c, user_id=fb6b1f7a25d74c94ad109fa6b97796b9, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:55:18.227377 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f94c34c-c710-4bed-9452-c5ff4f008c00 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:55:18.426958 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1192/2406] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:55:18 2022] PUT /identity/v3/projects/770852aef3624c71a91b2de6d214f78c/users/fb6b1f7a25d74c94ad109fa6b97796b9/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:55:18.440528 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247fa3f-f63b-412d-b5e8-31c28deaa8fd None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:55:18.441297 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247fa3f-f63b-412d-b5e8-31c28deaa8fd None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:55:18.441504 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247fa3f-f63b-412d-b5e8-31c28deaa8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:55:18.488811 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-3247fa3f-f63b-412d-b5e8-31c28deaa8fd None None] MFA Rules not processed for user `fb6b1f7a25d74c94ad109fa6b97796b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:55:18.490258 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-3247fa3f-f63b-412d-b5e8-31c28deaa8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:55:18.567690 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1215/2407] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:55:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:55:18.584830 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f94c34c-c710-4bed-9452-c5ff4f008c00 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:55:18.586892 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-0f94c34c-c710-4bed-9452-c5ff4f008c00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:55:18.657709 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f94c34c-c710-4bed-9452-c5ff4f008c00 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:55:18.661392 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4242dc-34c7-4939-8ff5-76b8c9e2db6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:55:18.662000 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4242dc-34c7-4939-8ff5-76b8c9e2db6e service cinder] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:55:18.662282 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4242dc-34c7-4939-8ff5-76b8c9e2db6e service cinder] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:55:18.662558 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4242dc-34c7-4939-8ff5-76b8c9e2db6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:55:18.672133 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4242dc-34c7-4939-8ff5-76b8c9e2db6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:55:18.673564 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4242dc-34c7-4939-8ff5-76b8c9e2db6e service cinder] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:55:18.684149 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1193/2408] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:55:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:55:18.723890 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247fa3f-f63b-412d-b5e8-31c28deaa8fd None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:55:18.808394 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247fa3f-f63b-412d-b5e8-31c28deaa8fd None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:55:18.813217 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645b6cd-b85d-4cb8-b46c-e7b44ac68b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:55:18.813844 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645b6cd-b85d-4cb8-b46c-e7b44ac68b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:55:18.814148 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645b6cd-b85d-4cb8-b46c-e7b44ac68b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:55:18.814419 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645b6cd-b85d-4cb8-b46c-e7b44ac68b69 admin admin] PATH_INFO: `/v3/users/fb6b1f7a25d74c94ad109fa6b97796b9` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:55:18.815613 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645b6cd-b85d-4cb8-b46c-e7b44ac68b69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb6b1f7a25d74c94ad109fa6b97796b9)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:55:18.817601 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645b6cd-b85d-4cb8-b46c-e7b44ac68b69 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:55:18.962323 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:19.170223 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-2645b6cd-b85d-4cb8-b46c-e7b44ac68b69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb6b1f7a25d74c94ad109fa6b97796b9'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:55:19.178682 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-2645b6cd-b85d-4cb8-b46c-e7b44ac68b69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb6b1f7a25d74c94ad109fa6b97796b9'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:55:19.281640 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-2645b6cd-b85d-4cb8-b46c-e7b44ac68b69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb6b1f7a25d74c94ad109fa6b97796b9'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:55:19.282442 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-2645b6cd-b85d-4cb8-b46c-e7b44ac68b69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb6b1f7a25d74c94ad109fa6b97796b9'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:55:19.296689 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-2645b6cd-b85d-4cb8-b46c-e7b44ac68b69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb6b1f7a25d74c94ad109fa6b97796b9'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:55:19.303158 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1216/2409] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:55:18 2022] DELETE /identity/v3/users/fb6b1f7a25d74c94ad109fa6b97796b9 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:55:19.307855 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c246104-e3fa-4d0e-874c-d1db73e60131 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:55:19.308335 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c246104-e3fa-4d0e-874c-d1db73e60131 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:55:19.308432 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c246104-e3fa-4d0e-874c-d1db73e60131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:55:19.336409 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-7c246104-e3fa-4d0e-874c-d1db73e60131 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:55:19.337687 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-7c246104-e3fa-4d0e-874c-d1db73e60131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:55:19.408187 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1194/2410] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:55:19.418385 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645b6cd-b85d-4cb8-b46c-e7b44ac68b69 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:55:19.420495 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-2645b6cd-b85d-4cb8-b46c-e7b44ac68b69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:55:19.482264 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:19.486218 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645b6cd-b85d-4cb8-b46c-e7b44ac68b69 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:55:19.490115 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02484a25-6ec6-41e3-be3e-f7d8eb546339 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:55:19.491376 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02484a25-6ec6-41e3-be3e-f7d8eb546339 service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:55:19.492633 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02484a25-6ec6-41e3-be3e-f7d8eb546339 service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:55:19.492937 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02484a25-6ec6-41e3-be3e-f7d8eb546339 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:55:19.504543 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02484a25-6ec6-41e3-be3e-f7d8eb546339 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:55:19.507224 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02484a25-6ec6-41e3-be3e-f7d8eb546339 service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:55:19.518598 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1217/2411] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:55:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:55:20.131256 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c246104-e3fa-4d0e-874c-d1db73e60131 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:55:20.132466 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-7c246104-e3fa-4d0e-874c-d1db73e60131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:55:20.151908 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c246104-e3fa-4d0e-874c-d1db73e60131 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:55:20.162296 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118af9b-ea9c-42f2-b48d-afdf4eb28f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:55:20.164661 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118af9b-ea9c-42f2-b48d-afdf4eb28f7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:55:20.165449 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118af9b-ea9c-42f2-b48d-afdf4eb28f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:55:20.166014 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118af9b-ea9c-42f2-b48d-afdf4eb28f7d admin admin] PATH_INFO: `/v3/projects/770852aef3624c71a91b2de6d214f78c` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:55:20.167172 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118af9b-ea9c-42f2-b48d-afdf4eb28f7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=770852aef3624c71a91b2de6d214f78c)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:55:20.169322 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118af9b-ea9c-42f2-b48d-afdf4eb28f7d admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:55:20.327186 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-6118af9b-ea9c-42f2-b48d-afdf4eb28f7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '770852aef3624c71a91b2de6d214f78c', 'request_id': 'req-6118af9b-ea9c-42f2-b48d-afdf4eb28f7d'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:55:20.334373 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-6118af9b-ea9c-42f2-b48d-afdf4eb28f7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '770852aef3624c71a91b2de6d214f78c', 'request_id': 'req-6118af9b-ea9c-42f2-b48d-afdf4eb28f7d'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:55:20.441692 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-6118af9b-ea9c-42f2-b48d-afdf4eb28f7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '770852aef3624c71a91b2de6d214f78c', 'request_id': 'req-6118af9b-ea9c-42f2-b48d-afdf4eb28f7d'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:55:20.459989 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-6118af9b-ea9c-42f2-b48d-afdf4eb28f7d admin admin] The token cache is being invalidate because project 770852aef3624c71a91b2de6d214f78c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:55:20.460780 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-6118af9b-ea9c-42f2-b48d-afdf4eb28f7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:55:20.460894 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-6118af9b-ea9c-42f2-b48d-afdf4eb28f7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:55:20.462355 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1195/2412] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:55:20 2022] DELETE /identity/v3/projects/770852aef3624c71a91b2de6d214f78c => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:55:20.469197 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2f2d4-96b1-4f64-ac46-0dc85cec6af0 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:55:20.469513 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2f2d4-96b1-4f64-ac46-0dc85cec6af0 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:55:20.469878 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2f2d4-96b1-4f64-ac46-0dc85cec6af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:55:20.497241 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-8ad2f2d4-96b1-4f64-ac46-0dc85cec6af0 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:55:20.498498 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-8ad2f2d4-96b1-4f64-ac46-0dc85cec6af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:55:20.581381 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1218/2413] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:55:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:55:20.591863 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8b467-467d-4ef8-a78d-cfcd6ce25209 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:55:20.592115 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8b467-467d-4ef8-a78d-cfcd6ce25209 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:55:20.592519 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8b467-467d-4ef8-a78d-cfcd6ce25209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:55:20.622899 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-cad8b467-467d-4ef8-a78d-cfcd6ce25209 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:55:20.624219 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-cad8b467-467d-4ef8-a78d-cfcd6ce25209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:55:20.633033 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1196/2414] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:55:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:55:20.637351 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2f2d4-96b1-4f64-ac46-0dc85cec6af0 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:55:20.649064 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2f2d4-96b1-4f64-ac46-0dc85cec6af0 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:55:20.654362 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656558e-1a52-4d99-946e-48bdcf1a18c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:55:20.655132 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656558e-1a52-4d99-946e-48bdcf1a18c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:55:20.655413 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656558e-1a52-4d99-946e-48bdcf1a18c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:55:20.655677 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656558e-1a52-4d99-946e-48bdcf1a18c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:55:20.656498 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e656558e-1a52-4d99-946e-48bdcf1a18c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:55:20.657010 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e656558e-1a52-4d99-946e-48bdcf1a18c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:55:20.659172 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e656558e-1a52-4d99-946e-48bdcf1a18c1 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:55:20.676925 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1219/2415] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:55:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:55:20.682624 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad8b467-467d-4ef8-a78d-cfcd6ce25209 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:55:20.692161 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad8b467-467d-4ef8-a78d-cfcd6ce25209 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:55:20.697554 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc0d49-346f-4ea9-93a0-4e7db5dea09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:55:20.698308 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc0d49-346f-4ea9-93a0-4e7db5dea09b admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:55:20.698630 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc0d49-346f-4ea9-93a0-4e7db5dea09b admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:55:20.699074 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc0d49-346f-4ea9-93a0-4e7db5dea09b admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:55:20.699762 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc0d49-346f-4ea9-93a0-4e7db5dea09b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:55:20.701657 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc0d49-346f-4ea9-93a0-4e7db5dea09b admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:55:20.859008 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1197/2416] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:55:20 2022] POST /identity/v3/projects => generated 373 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:55:20.863807 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656558e-1a52-4d99-946e-48bdcf1a18c1 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:55:20.876481 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656558e-1a52-4d99-946e-48bdcf1a18c1 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:55:20.883546 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:20.948603 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86b379-ad1e-424f-923a-59a2c2a13776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:55:20.949232 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86b379-ad1e-424f-923a-59a2c2a13776 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:55:20.949538 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86b379-ad1e-424f-923a-59a2c2a13776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:55:20.949814 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86b379-ad1e-424f-923a-59a2c2a13776 admin admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:55:20.950565 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86b379-ad1e-424f-923a-59a2c2a13776 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:55:20.952999 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86b379-ad1e-424f-923a-59a2c2a13776 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:55:21.097421 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1220/2417] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:55:20 2022] POST /identity/v3/users => generated 287 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 07:55:21.107311 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc0d49-346f-4ea9-93a0-4e7db5dea09b admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:55:21.119032 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc0d49-346f-4ea9-93a0-4e7db5dea09b admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:55:21.123858 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9c0a7-e4ed-4bcf-9faa-c3319d7b4ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:55:21.124477 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9c0a7-e4ed-4bcf-9faa-c3319d7b4ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:55:21.124774 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9c0a7-e4ed-4bcf-9faa-c3319d7b4ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:55:21.125044 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9c0a7-e4ed-4bcf-9faa-c3319d7b4ad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:55:21.125759 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c9c0a7-e4ed-4bcf-9faa-c3319d7b4ad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:55:21.127426 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c9c0a7-e4ed-4bcf-9faa-c3319d7b4ad4 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:55:21.136121 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:21.141487 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1198/2418] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 07:55:21.150152 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86b379-ad1e-424f-923a-59a2c2a13776 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:55:21.160468 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86b379-ad1e-424f-923a-59a2c2a13776 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:55:21.165566 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05512e71-7738-45fc-9e2b-ea440724680a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:55:21.166170 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05512e71-7738-45fc-9e2b-ea440724680a admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:55:21.166447 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05512e71-7738-45fc-9e2b-ea440724680a admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:55:21.166717 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05512e71-7738-45fc-9e2b-ea440724680a admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:55:21.167403 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05512e71-7738-45fc-9e2b-ea440724680a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:55:21.168994 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05512e71-7738-45fc-9e2b-ea440724680a admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:55:21.184504 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1221/2419] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:55:21.185804 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9c0a7-e4ed-4bcf-9faa-c3319d7b4ad4 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:55:21.198119 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9c0a7-e4ed-4bcf-9faa-c3319d7b4ad4 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:55:21.203611 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d66ee0-0153-4c28-bb69-6e6ba5fb9e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:55:21.204287 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d66ee0-0153-4c28-bb69-6e6ba5fb9e4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:55:21.204616 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d66ee0-0153-4c28-bb69-6e6ba5fb9e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:55:21.204892 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d66ee0-0153-4c28-bb69-6e6ba5fb9e4c admin admin] PATH_INFO: `/v3/projects/17031b1ed4104b4fac9fe03aff41b0cd/users/c82f2803ed1447edab12e9ee905273ea/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:55:21.223022 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d66ee0-0153-4c28-bb69-6e6ba5fb9e4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=17031b1ed4104b4fac9fe03aff41b0cd, user_id=c82f2803ed1447edab12e9ee905273ea, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:55:21.226274 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d66ee0-0153-4c28-bb69-6e6ba5fb9e4c admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:55:21.355416 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1199/2420] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:55:21 2022] PUT /identity/v3/projects/17031b1ed4104b4fac9fe03aff41b0cd/users/c82f2803ed1447edab12e9ee905273ea/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:55:21.360712 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f1c37-f388-437a-b895-bdb090a0fe8f None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:55:21.361019 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f1c37-f388-437a-b895-bdb090a0fe8f None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:55:21.362399 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f1c37-f388-437a-b895-bdb090a0fe8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:55:21.367881 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:21.385243 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-321f1c37-f388-437a-b895-bdb090a0fe8f None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:55:21.386485 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-321f1c37-f388-437a-b895-bdb090a0fe8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:55:21.460879 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1222/2421] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:55:21.472927 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d66ee0-0153-4c28-bb69-6e6ba5fb9e4c admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:55:21.476586 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-32d66ee0-0153-4c28-bb69-6e6ba5fb9e4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:55:21.546638 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d66ee0-0153-4c28-bb69-6e6ba5fb9e4c admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:55:21.550425 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea48e1-b69e-4a4d-82f8-ba5fa6511f06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:55:21.551087 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea48e1-b69e-4a4d-82f8-ba5fa6511f06 service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:55:21.551374 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea48e1-b69e-4a4d-82f8-ba5fa6511f06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:55:21.551647 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea48e1-b69e-4a4d-82f8-ba5fa6511f06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:55:21.567795 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea48e1-b69e-4a4d-82f8-ba5fa6511f06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:55:21.570530 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea48e1-b69e-4a4d-82f8-ba5fa6511f06 service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:55:21.581309 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1200/2422] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:55:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 07:55:22.554231 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96723fb5-ba5e-4a15-afee-b848d7af195c None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:55:22.555557 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96723fb5-ba5e-4a15-afee-b848d7af195c None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:55:22.555840 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96723fb5-ba5e-4a15-afee-b848d7af195c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:55:22.576745 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-96723fb5-ba5e-4a15-afee-b848d7af195c None None] MFA Rules not processed for user `0e024988791d4079888cc50db9c0b240`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:55:22.582757 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-96723fb5-ba5e-4a15-afee-b848d7af195c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:55:22.621548 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:22.641776 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1223/2423] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:55:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:55:23.059384 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:24.394866 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:25.915154 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cfada3-47c5-4a38-8813-dbd88c5da4b5 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:55:25.915154 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cfada3-47c5-4a38-8813-dbd88c5da4b5 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:55:25.915879 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cfada3-47c5-4a38-8813-dbd88c5da4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:55:25.946811 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-18cfada3-47c5-4a38-8813-dbd88c5da4b5 None None] MFA Rules not processed for user `104001160e274732be5e9f75dfee5501`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:55:25.949090 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-18cfada3-47c5-4a38-8813-dbd88c5da4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:55:26.066179 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1201/2424] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:55:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:55:26.074721 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:27.258480 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:27.986231 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:29.672505 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e744f7-19b5-46ca-bcca-5efdb78ea274 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:55:29.673411 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e744f7-19b5-46ca-bcca-5efdb78ea274 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:55:29.673527 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e744f7-19b5-46ca-bcca-5efdb78ea274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:55:29.728561 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-10e744f7-19b5-46ca-bcca-5efdb78ea274 None None] MFA Rules not processed for user `30dc2621143f4604b53bb44b82e8efbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:55:29.730781 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-10e744f7-19b5-46ca-bcca-5efdb78ea274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:55:29.792068 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:29.891420 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1224/2425] 10.222.0.42 () {58 vars in 967 bytes} [Fri Aug 26 07:55:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:55:29.934445 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cfada3-47c5-4a38-8813-dbd88c5da4b5 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:55:29.941921 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-18cfada3-47c5-4a38-8813-dbd88c5da4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:55:30.130857 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cfada3-47c5-4a38-8813-dbd88c5da4b5 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:55:30.138244 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124bb82b-38ef-4a1e-af06-6bbc5f936e52 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3142255c263e44a189db82c621f87e7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:55:30.138700 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124bb82b-38ef-4a1e-af06-6bbc5f936e52 service swift] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:55:30.139308 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124bb82b-38ef-4a1e-af06-6bbc5f936e52 service swift] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:55:30.139308 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124bb82b-38ef-4a1e-af06-6bbc5f936e52 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:55:30.150503 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124bb82b-38ef-4a1e-af06-6bbc5f936e52 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:55:30.152817 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124bb82b-38ef-4a1e-af06-6bbc5f936e52 service swift] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:55:30.168541 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1202/2426] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 26 07:55:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 07:55:30.407662 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:31.098500 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95917e88-39c2-49ca-b115-7908de6e3933 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:55:31.099151 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95917e88-39c2-49ca-b115-7908de6e3933 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:55:31.099151 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95917e88-39c2-49ca-b115-7908de6e3933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:55:31.155556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-95917e88-39c2-49ca-b115-7908de6e3933 None None] MFA Rules not processed for user `c82f2803ed1447edab12e9ee905273ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:55:31.156805 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-95917e88-39c2-49ca-b115-7908de6e3933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:55:31.265419 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1225/2427] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:55:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:55:31.270103 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124bb82b-38ef-4a1e-af06-6bbc5f936e52 service swift] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:55:31.281585 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124bb82b-38ef-4a1e-af06-6bbc5f936e52 service swift] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:55:31.286493 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca4e2e-68a7-45c1-8fa9-0042e59948d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:55:31.287171 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca4e2e-68a7-45c1-8fa9-0042e59948d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:55:31.288398 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca4e2e-68a7-45c1-8fa9-0042e59948d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:55:31.288398 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca4e2e-68a7-45c1-8fa9-0042e59948d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:55:31.288873 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca4e2e-68a7-45c1-8fa9-0042e59948d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:55:31.290971 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca4e2e-68a7-45c1-8fa9-0042e59948d9 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:55:31.483916 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1203/2428] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:55:31 2022] POST /identity/v3/projects => generated 371 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 07:55:31.488260 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95917e88-39c2-49ca-b115-7908de6e3933 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:55:31.501457 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95917e88-39c2-49ca-b115-7908de6e3933 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:55:31.563537 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b507ae-9049-44cf-8b25-2be1a14a80bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:55:31.564157 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b507ae-9049-44cf-8b25-2be1a14a80bc admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:55:31.564433 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b507ae-9049-44cf-8b25-2be1a14a80bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:55:31.564704 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b507ae-9049-44cf-8b25-2be1a14a80bc admin admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:55:31.565350 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b507ae-9049-44cf-8b25-2be1a14a80bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:55:31.567299 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b507ae-9049-44cf-8b25-2be1a14a80bc admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:55:31.660549 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1226/2429] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:55:31 2022] POST /identity/v3/users => generated 292 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:55:31.665179 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca4e2e-68a7-45c1-8fa9-0042e59948d9 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:55:31.677156 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca4e2e-68a7-45c1-8fa9-0042e59948d9 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:55:31.682326 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b65de-34df-4af8-8a0e-9c7c04bfa812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:55:31.683067 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b65de-34df-4af8-8a0e-9c7c04bfa812 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:55:31.683351 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b65de-34df-4af8-8a0e-9c7c04bfa812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:55:31.683758 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b65de-34df-4af8-8a0e-9c7c04bfa812 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:55:31.684483 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b65de-34df-4af8-8a0e-9c7c04bfa812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:55:31.686104 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b65de-34df-4af8-8a0e-9c7c04bfa812 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:55:31.718400 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1204/2430] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 07:55:31.720070 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b507ae-9049-44cf-8b25-2be1a14a80bc admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:55:31.735635 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b507ae-9049-44cf-8b25-2be1a14a80bc admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:55:31.746376 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0bffe-f7df-4110-b3e5-ec495219007b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:55:31.747271 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0bffe-f7df-4110-b3e5-ec495219007b admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:55:31.747625 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0bffe-f7df-4110-b3e5-ec495219007b admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:55:31.747972 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0bffe-f7df-4110-b3e5-ec495219007b admin admin] PATH_INFO: `/v3/projects/ba3c8244370545039094a60a261011c2/users/217344fc9e414867b3a013674b529407/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:55:31.765250 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb0bffe-f7df-4110-b3e5-ec495219007b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba3c8244370545039094a60a261011c2, user_id=217344fc9e414867b3a013674b529407, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:55:31.772525 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb0bffe-f7df-4110-b3e5-ec495219007b admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:55:31.911012 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1227/2431] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:55:31 2022] PUT /identity/v3/projects/ba3c8244370545039094a60a261011c2/users/217344fc9e414867b3a013674b529407/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:55:31.917156 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b65de-34df-4af8-8a0e-9c7c04bfa812 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:55:31.928425 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b65de-34df-4af8-8a0e-9c7c04bfa812 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:55:32.003572 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2fee0-d116-4a1e-9846-5a7b672014f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:55:32.004771 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2fee0-d116-4a1e-9846-5a7b672014f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:55:32.006596 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2fee0-d116-4a1e-9846-5a7b672014f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:55:32.007223 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2fee0-d116-4a1e-9846-5a7b672014f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:55:32.008201 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2fee0-d116-4a1e-9846-5a7b672014f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:55:32.010307 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2fee0-d116-4a1e-9846-5a7b672014f9 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:55:32.027446 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1205/2432] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:55:32.034114 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0bffe-f7df-4110-b3e5-ec495219007b admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:55:32.045730 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0bffe-f7df-4110-b3e5-ec495219007b admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:55:32.050920 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492522e1-fbf3-472d-9548-94dc7802d395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:55:32.051879 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492522e1-fbf3-472d-9548-94dc7802d395 admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:55:32.052219 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492522e1-fbf3-472d-9548-94dc7802d395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:55:32.053201 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492522e1-fbf3-472d-9548-94dc7802d395 admin admin] PATH_INFO: `/v3/projects/ba3c8244370545039094a60a261011c2/users/217344fc9e414867b3a013674b529407/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:55:32.055670 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492522e1-fbf3-472d-9548-94dc7802d395 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba3c8244370545039094a60a261011c2, user_id=217344fc9e414867b3a013674b529407, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:55:32.058533 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492522e1-fbf3-472d-9548-94dc7802d395 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:55:32.088565 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1228/2433] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:55:32 2022] PUT /identity/v3/projects/ba3c8244370545039094a60a261011c2/users/217344fc9e414867b3a013674b529407/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:55:32.603190 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:33.232000 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:35.351766 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:35.933062 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:39.574690 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:39.950468 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:40.293067 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b23191-e770-40a5-afa4-3d49a789fbad None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:55:40.293067 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b23191-e770-40a5-afa4-3d49a789fbad None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:55:40.293067 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b23191-e770-40a5-afa4-3d49a789fbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:55:40.329860 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-e8b23191-e770-40a5-afa4-3d49a789fbad None None] MFA Rules not processed for user `217344fc9e414867b3a013674b529407`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:55:40.332670 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-e8b23191-e770-40a5-afa4-3d49a789fbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:55:40.423406 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1206/2434] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:55:40 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:55:40.453409 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492522e1-fbf3-472d-9548-94dc7802d395 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:55:40.457518 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-492522e1-fbf3-472d-9548-94dc7802d395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:55:40.574743 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492522e1-fbf3-472d-9548-94dc7802d395 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:55:40.588245 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a159ed7-fbb1-4604-aa99-d936d55655ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc92c0a0a2cc4722868e6877bac93ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:55:40.588245 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a159ed7-fbb1-4604-aa99-d936d55655ae service nova] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:55:40.588245 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a159ed7-fbb1-4604-aa99-d936d55655ae service nova] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:55:40.588245 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a159ed7-fbb1-4604-aa99-d936d55655ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:55:40.675091 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a159ed7-fbb1-4604-aa99-d936d55655ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:55:40.675091 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a159ed7-fbb1-4604-aa99-d936d55655ae service nova] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:55:40.686149 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1229/2435] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:55:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:55:41.723341 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:43.419160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:44.763482 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53d1d3-dcd6-407b-850f-35978866b526 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:55:44.764050 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53d1d3-dcd6-407b-850f-35978866b526 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:55:44.764050 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53d1d3-dcd6-407b-850f-35978866b526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:55:44.789716 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-6f53d1d3-dcd6-407b-850f-35978866b526 None None] MFA Rules not processed for user `c82f2803ed1447edab12e9ee905273ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:55:44.791806 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-6f53d1d3-dcd6-407b-850f-35978866b526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:55:44.803142 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1207/2436] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:55:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:55:44.818699 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:45.706459 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:46.555637 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:46.807897 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:46.904322 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:47.394451 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:47.737347 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:48.436136 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:49.073222 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:49.456158 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:58.713490 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=58 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:55:59.973128 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:INSERT=4,keystone:SELECT=73 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:56:00.816419 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a159ed7-fbb1-4604-aa99-d936d55655ae service nova] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:56:00.819033 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-8a159ed7-fbb1-4604-aa99-d936d55655ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:56:00.904622 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a159ed7-fbb1-4604-aa99-d936d55655ae service nova] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:56:00.908678 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76a5f8-295e-4f2f-97f5-d34bc2640571 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:56:00.909303 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76a5f8-295e-4f2f-97f5-d34bc2640571 service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:56:00.909584 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76a5f8-295e-4f2f-97f5-d34bc2640571 service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:56:00.909859 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76a5f8-295e-4f2f-97f5-d34bc2640571 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:56:00.912551 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-ea76a5f8-295e-4f2f-97f5-d34bc2640571 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:56:01.030051 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea76a5f8-295e-4f2f-97f5-d34bc2640571 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:56:01.030932 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea76a5f8-295e-4f2f-97f5-d34bc2640571 service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:56:01.050158 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1230/2437] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:56:00 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:56:11.040366 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=50 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:56:14.536534 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94e4e2-5815-44a1-bbff-97bbf54da9c6 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:56:14.537136 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94e4e2-5815-44a1-bbff-97bbf54da9c6 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:56:14.537136 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94e4e2-5815-44a1-bbff-97bbf54da9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:56:14.557972 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-3e94e4e2-5815-44a1-bbff-97bbf54da9c6 None None] MFA Rules not processed for user `6013bd3435a7414a9fca40d17ba91ba2`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:56:14.559244 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-3e94e4e2-5815-44a1-bbff-97bbf54da9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:56:14.633695 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1208/2438] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:56:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:56:18.367322 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d457c0-937b-434e-81a3-860b52e5f21c None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:56:18.367930 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d457c0-937b-434e-81a3-860b52e5f21c None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:56:18.367930 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d457c0-937b-434e-81a3-860b52e5f21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:56:18.388356 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-22d457c0-937b-434e-81a3-860b52e5f21c None None] MFA Rules not processed for user `c9de80eade38407c99f00c5acf45e2bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:56:18.391816 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-22d457c0-937b-434e-81a3-860b52e5f21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:56:18.468056 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1231/2439] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:56:18 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:56:24.618687 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=25 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:56:28.452474 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=25 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:56:40.674419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94e4e2-5815-44a1-bbff-97bbf54da9c6 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:56:40.685549 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94e4e2-5815-44a1-bbff-97bbf54da9c6 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:56:40.689870 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da7a31-f688-40bd-a5d2-668528ff8c9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:56:40.691571 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da7a31-f688-40bd-a5d2-668528ff8c9d service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:56:40.692232 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da7a31-f688-40bd-a5d2-668528ff8c9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:56:40.692803 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da7a31-f688-40bd-a5d2-668528ff8c9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:56:40.706609 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da7a31-f688-40bd-a5d2-668528ff8c9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:56:40.706609 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da7a31-f688-40bd-a5d2-668528ff8c9d service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:56:40.720360 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1209/2440] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:56:40 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:56:46.603791 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007de1a-726e-4bd4-8e77-8f90f70bf0e7 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:56:46.604630 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007de1a-726e-4bd4-8e77-8f90f70bf0e7 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:56:46.604794 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007de1a-726e-4bd4-8e77-8f90f70bf0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:56:46.634116 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-8007de1a-726e-4bd4-8e77-8f90f70bf0e7 None None] MFA Rules not processed for user `cc96be5baacf490bad43962fa4a24e4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:56:46.636149 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-8007de1a-726e-4bd4-8e77-8f90f70bf0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:56:46.701801 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1232/2441] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:56:46 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:56:50.714401 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=6 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:56:51.182054 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da7a31-f688-40bd-a5d2-668528ff8c9d service neutron] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:56:51.196431 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da7a31-f688-40bd-a5d2-668528ff8c9d service neutron] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:56:51.202422 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa204b-284a-4075-8dcb-fb3b7fb74418 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:56:51.203568 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa204b-284a-4075-8dcb-fb3b7fb74418 service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:56:51.203870 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa204b-284a-4075-8dcb-fb3b7fb74418 service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:56:51.207321 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa204b-284a-4075-8dcb-fb3b7fb74418 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:56:51.210876 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-41fa204b-284a-4075-8dcb-fb3b7fb74418 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:56:51.227776 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa204b-284a-4075-8dcb-fb3b7fb74418 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:56:51.229336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa204b-284a-4075-8dcb-fb3b7fb74418 service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:56:51.244530 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1210/2442] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:56:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:56:52.481931 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007de1a-726e-4bd4-8e77-8f90f70bf0e7 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:56:52.492868 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007de1a-726e-4bd4-8e77-8f90f70bf0e7 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:56:52.496528 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73724c-7f50-4133-9d22-2721b97778f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:56:52.497131 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73724c-7f50-4133-9d22-2721b97778f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:56:52.497409 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73724c-7f50-4133-9d22-2721b97778f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:56:52.497686 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73724c-7f50-4133-9d22-2721b97778f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:56:52.499494 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-bf73724c-7f50-4133-9d22-2721b97778f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:56:52.513720 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73724c-7f50-4133-9d22-2721b97778f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:56:52.515168 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73724c-7f50-4133-9d22-2721b97778f5 service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:56:52.526975 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1233/2443] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:56:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:57:01.236775 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=6 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:57:02.521853 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=31 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:57:06.178475 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa204b-284a-4075-8dcb-fb3b7fb74418 service neutron] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:57:06.202300 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa204b-284a-4075-8dcb-fb3b7fb74418 service neutron] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:57:06.210722 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108c35f-fd80-45a5-a373-3d6e924b6888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:57:06.211932 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108c35f-fd80-45a5-a373-3d6e924b6888 service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:57:06.212325 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108c35f-fd80-45a5-a373-3d6e924b6888 service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:57:06.212909 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108c35f-fd80-45a5-a373-3d6e924b6888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:57:06.215860 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-5108c35f-fd80-45a5-a373-3d6e924b6888 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:57:06.239314 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108c35f-fd80-45a5-a373-3d6e924b6888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:57:06.243055 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108c35f-fd80-45a5-a373-3d6e924b6888 service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:57:06.264554 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1211/2444] 10.222.0.42 () {60 vars in 1396 bytes} [Fri Aug 26 07:57:06 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3266 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:57:14.583171 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73724c-7f50-4133-9d22-2721b97778f5 service neutron] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:57:14.584661 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-bf73724c-7f50-4133-9d22-2721b97778f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:57:14.649939 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73724c-7f50-4133-9d22-2721b97778f5 service neutron] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:57:14.660123 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202df384-a76e-4e53-96d8-f59da6f915b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:57:14.660839 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202df384-a76e-4e53-96d8-f59da6f915b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:57:14.661141 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202df384-a76e-4e53-96d8-f59da6f915b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:57:14.661393 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202df384-a76e-4e53-96d8-f59da6f915b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:57:14.663532 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-202df384-a76e-4e53-96d8-f59da6f915b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:57:14.677703 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202df384-a76e-4e53-96d8-f59da6f915b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:57:14.680562 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202df384-a76e-4e53-96d8-f59da6f915b7 service cinder] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:57:14.712054 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1234/2445] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:57:14 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:57:16.256702 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=6 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:57:18.245741 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023504c-b78b-4015-ab8e-779636213cb6 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:57:18.246850 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023504c-b78b-4015-ab8e-779636213cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:57:18.247398 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023504c-b78b-4015-ab8e-779636213cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:57:18.274044 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-a023504c-b78b-4015-ab8e-779636213cb6 None None] MFA Rules not processed for user `0e024988791d4079888cc50db9c0b240`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:57:18.275338 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-a023504c-b78b-4015-ab8e-779636213cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:57:18.367300 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1212/2446] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:57:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:57:18.819173 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202df384-a76e-4e53-96d8-f59da6f915b7 service cinder] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:57:18.835499 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202df384-a76e-4e53-96d8-f59da6f915b7 service cinder] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:57:18.842261 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721e76b-6831-464e-a7cd-ad9556fc0831 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:57:18.843284 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721e76b-6831-464e-a7cd-ad9556fc0831 service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:57:18.843751 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721e76b-6831-464e-a7cd-ad9556fc0831 service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:57:18.844223 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721e76b-6831-464e-a7cd-ad9556fc0831 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:57:18.848385 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-7721e76b-6831-464e-a7cd-ad9556fc0831 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:57:18.865106 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7721e76b-6831-464e-a7cd-ad9556fc0831 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:57:18.866602 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7721e76b-6831-464e-a7cd-ad9556fc0831 service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:57:18.876520 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1235/2447] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:57:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 07:57:19.394621 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a023504c-b78b-4015-ab8e-779636213cb6 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:57:19.396851 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-a023504c-b78b-4015-ab8e-779636213cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:57:19.498527 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a023504c-b78b-4015-ab8e-779636213cb6 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:57:19.507204 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0668e-7b75-444e-997e-55303e31a902 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c2bc293f1b4daca83e8d6dff66a316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:57:19.507204 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0668e-7b75-444e-997e-55303e31a902 service placement] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:57:19.507204 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0668e-7b75-444e-997e-55303e31a902 service placement] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:57:19.507204 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0668e-7b75-444e-997e-55303e31a902 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:57:19.509600 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-0dd0668e-7b75-444e-997e-55303e31a902 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:57:19.527298 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd0668e-7b75-444e-997e-55303e31a902 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:57:19.528902 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd0668e-7b75-444e-997e-55303e31a902 service placement] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:57:19.542221 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1213/2448] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:57:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:57:26.230648 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721e76b-6831-464e-a7cd-ad9556fc0831 service neutron] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:57:26.233351 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-7721e76b-6831-464e-a7cd-ad9556fc0831 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:57:26.260883 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721e76b-6831-464e-a7cd-ad9556fc0831 service neutron] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:57:26.267600 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccaf7cf-5979-48e0-a9ad-c4ede9f11359 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc92c0a0a2cc4722868e6877bac93ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:57:26.268413 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccaf7cf-5979-48e0-a9ad-c4ede9f11359 service nova] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:57:26.268725 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccaf7cf-5979-48e0-a9ad-c4ede9f11359 service nova] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:57:26.269052 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccaf7cf-5979-48e0-a9ad-c4ede9f11359 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:57:26.271126 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-dccaf7cf-5979-48e0-a9ad-c4ede9f11359 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:57:26.288739 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccaf7cf-5979-48e0-a9ad-c4ede9f11359 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:57:26.290393 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccaf7cf-5979-48e0-a9ad-c4ede9f11359 service nova] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:57:26.304705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1236/2449] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:57:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:57:29.536298 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=57 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:57:30.780612 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0668e-7b75-444e-997e-55303e31a902 service placement] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:57:30.792709 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0668e-7b75-444e-997e-55303e31a902 service placement] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:57:30.796414 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e967f5-3f03-46af-a238-389c76de658b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:57:30.797032 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e967f5-3f03-46af-a238-389c76de658b service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:57:30.797308 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e967f5-3f03-46af-a238-389c76de658b service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:57:30.797779 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e967f5-3f03-46af-a238-389c76de658b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:57:30.799744 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-d5e967f5-3f03-46af-a238-389c76de658b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:57:30.812123 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e967f5-3f03-46af-a238-389c76de658b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:57:30.814633 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e967f5-3f03-46af-a238-389c76de658b service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:57:30.824582 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1214/2450] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:57:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:57:36.298034 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=38 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:57:40.820272 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=6 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:57:42.457275 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccaf7cf-5979-48e0-a9ad-c4ede9f11359 service nova] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:57:42.472480 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccaf7cf-5979-48e0-a9ad-c4ede9f11359 service nova] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:57:42.479496 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4442e22-a4ab-4bdf-b60a-c991f4fc9f71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc92c0a0a2cc4722868e6877bac93ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:57:42.480330 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4442e22-a4ab-4bdf-b60a-c991f4fc9f71 service nova] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:57:42.480702 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4442e22-a4ab-4bdf-b60a-c991f4fc9f71 service nova] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:57:42.481119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4442e22-a4ab-4bdf-b60a-c991f4fc9f71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:57:42.483743 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-b4442e22-a4ab-4bdf-b60a-c991f4fc9f71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:57:42.504515 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4442e22-a4ab-4bdf-b60a-c991f4fc9f71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:57:42.506345 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4442e22-a4ab-4bdf-b60a-c991f4fc9f71 service nova] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:57:42.523977 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1237/2451] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:57:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:57:43.129280 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e967f5-3f03-46af-a238-389c76de658b service neutron] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:57:43.133421 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-d5e967f5-3f03-46af-a238-389c76de658b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:57:43.160388 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e967f5-3f03-46af-a238-389c76de658b service neutron] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:57:43.171378 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac64b9b-3cff-4d64-ae25-f876de223eac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c2bc293f1b4daca83e8d6dff66a316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:57:43.172032 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac64b9b-3cff-4d64-ae25-f876de223eac service placement] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:57:43.172308 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac64b9b-3cff-4d64-ae25-f876de223eac service placement] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:57:43.172579 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac64b9b-3cff-4d64-ae25-f876de223eac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:57:43.175267 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-aac64b9b-3cff-4d64-ae25-f876de223eac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:57:43.194388 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac64b9b-3cff-4d64-ae25-f876de223eac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:57:43.196483 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac64b9b-3cff-4d64-ae25-f876de223eac service placement] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:57:43.212371 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1215/2452] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:57:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:57:43.304832 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4442e22-a4ab-4bdf-b60a-c991f4fc9f71 service nova] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:57:43.307475 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-b4442e22-a4ab-4bdf-b60a-c991f4fc9f71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:57:43.411986 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4442e22-a4ab-4bdf-b60a-c991f4fc9f71 service nova] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:57:43.422849 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e57b2c-16c2-4be5-a36b-c32475f181cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:57:43.424407 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e57b2c-16c2-4be5-a36b-c32475f181cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:57:43.424691 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e57b2c-16c2-4be5-a36b-c32475f181cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:57:43.425041 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e57b2c-16c2-4be5-a36b-c32475f181cf admin admin] PATH_INFO: `/v3/users/6013bd3435a7414a9fca40d17ba91ba2` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:57:43.426320 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e57b2c-16c2-4be5-a36b-c32475f181cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=6013bd3435a7414a9fca40d17ba91ba2)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:57:43.428363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e57b2c-16c2-4be5-a36b-c32475f181cf admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:57:43.800198 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-23e57b2c-16c2-4be5-a36b-c32475f181cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6013bd3435a7414a9fca40d17ba91ba2'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:57:43.814906 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-23e57b2c-16c2-4be5-a36b-c32475f181cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6013bd3435a7414a9fca40d17ba91ba2'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:57:43.885229 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-23e57b2c-16c2-4be5-a36b-c32475f181cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6013bd3435a7414a9fca40d17ba91ba2'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:57:43.885872 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-23e57b2c-16c2-4be5-a36b-c32475f181cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6013bd3435a7414a9fca40d17ba91ba2'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:57:43.905979 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-23e57b2c-16c2-4be5-a36b-c32475f181cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6013bd3435a7414a9fca40d17ba91ba2'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:57:43.914719 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1238/2453] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:57:43 2022] DELETE /identity/v3/users/6013bd3435a7414a9fca40d17ba91ba2 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:57:44.258307 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac64b9b-3cff-4d64-ae25-f876de223eac service placement] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:57:44.274080 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac64b9b-3cff-4d64-ae25-f876de223eac service placement] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:57:44.342378 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1af724-0ecd-4342-8523-4b30d9617056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:57:44.342916 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1af724-0ecd-4342-8523-4b30d9617056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:57:44.343230 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1af724-0ecd-4342-8523-4b30d9617056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:57:44.343503 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1af724-0ecd-4342-8523-4b30d9617056 admin admin] PATH_INFO: `/v3/projects/69a3531472224652bcd42d0c38dfa807` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:57:44.345315 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1af724-0ecd-4342-8523-4b30d9617056 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69a3531472224652bcd42d0c38dfa807)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:57:44.347896 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1af724-0ecd-4342-8523-4b30d9617056 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:57:44.513004 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-bf1af724-0ecd-4342-8523-4b30d9617056 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69a3531472224652bcd42d0c38dfa807', 'request_id': 'req-bf1af724-0ecd-4342-8523-4b30d9617056'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:57:44.524047 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-bf1af724-0ecd-4342-8523-4b30d9617056 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69a3531472224652bcd42d0c38dfa807', 'request_id': 'req-bf1af724-0ecd-4342-8523-4b30d9617056'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:57:44.588025 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-bf1af724-0ecd-4342-8523-4b30d9617056 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69a3531472224652bcd42d0c38dfa807', 'request_id': 'req-bf1af724-0ecd-4342-8523-4b30d9617056'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:57:44.603626 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-bf1af724-0ecd-4342-8523-4b30d9617056 admin admin] The token cache is being invalidate because project 69a3531472224652bcd42d0c38dfa807 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:57:44.603844 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-bf1af724-0ecd-4342-8523-4b30d9617056 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:57:44.604549 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-bf1af724-0ecd-4342-8523-4b30d9617056 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:57:44.606145 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1216/2454] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:57:44 2022] DELETE /identity/v3/projects/69a3531472224652bcd42d0c38dfa807 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:57:44.612038 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7bc3e3-3927-4e72-a5c7-88d03d94fcf2 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:57:44.612384 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7bc3e3-3927-4e72-a5c7-88d03d94fcf2 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:57:44.612695 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7bc3e3-3927-4e72-a5c7-88d03d94fcf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:57:44.632861 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-da7bc3e3-3927-4e72-a5c7-88d03d94fcf2 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:57:44.634180 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-da7bc3e3-3927-4e72-a5c7-88d03d94fcf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:57:44.710110 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1239/2455] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:57:44.783290 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7472d3e-fc41-44c0-8962-e4ca5ddd2ae2 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:57:44.783719 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7472d3e-fc41-44c0-8962-e4ca5ddd2ae2 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:57:44.783995 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7472d3e-fc41-44c0-8962-e4ca5ddd2ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:57:44.804740 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-d7472d3e-fc41-44c0-8962-e4ca5ddd2ae2 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:57:44.806142 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-d7472d3e-fc41-44c0-8962-e4ca5ddd2ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:57:44.813880 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1217/2456] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:57:44.818727 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7bc3e3-3927-4e72-a5c7-88d03d94fcf2 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:57:44.829811 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7bc3e3-3927-4e72-a5c7-88d03d94fcf2 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:57:44.835033 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760eb23-f76a-47b5-98b6-a066d9d7a736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:57:44.835646 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760eb23-f76a-47b5-98b6-a066d9d7a736 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:57:44.835923 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760eb23-f76a-47b5-98b6-a066d9d7a736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:57:44.836195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760eb23-f76a-47b5-98b6-a066d9d7a736 admin admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:57:44.836848 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760eb23-f76a-47b5-98b6-a066d9d7a736 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:57:44.837155 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760eb23-f76a-47b5-98b6-a066d9d7a736 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:57:44.838754 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760eb23-f76a-47b5-98b6-a066d9d7a736 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:57:44.840453 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:57:44.853040 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1240/2457] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 07:57:44.857869 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7472d3e-fc41-44c0-8962-e4ca5ddd2ae2 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:57:44.868962 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7472d3e-fc41-44c0-8962-e4ca5ddd2ae2 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:57:44.873812 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24307fc3-fbc8-4697-8e7e-cd9c1d0d2632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:57:44.874438 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24307fc3-fbc8-4697-8e7e-cd9c1d0d2632 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:57:44.874718 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24307fc3-fbc8-4697-8e7e-cd9c1d0d2632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:57:44.875034 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24307fc3-fbc8-4697-8e7e-cd9c1d0d2632 admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:57:44.875682 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24307fc3-fbc8-4697-8e7e-cd9c1d0d2632 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:57:44.878884 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24307fc3-fbc8-4697-8e7e-cd9c1d0d2632 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:57:45.030356 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1218/2458] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:57:44 2022] POST /identity/v3/projects => generated 383 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:57:45.036985 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760eb23-f76a-47b5-98b6-a066d9d7a736 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:57:45.051711 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760eb23-f76a-47b5-98b6-a066d9d7a736 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:57:45.152034 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7046c36c-e6d2-4267-be03-80163006e6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:57:45.153015 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7046c36c-e6d2-4267-be03-80163006e6ab admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:57:45.153310 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7046c36c-e6d2-4267-be03-80163006e6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:57:45.153655 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7046c36c-e6d2-4267-be03-80163006e6ab admin admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:57:45.154339 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7046c36c-e6d2-4267-be03-80163006e6ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:57:45.159735 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7046c36c-e6d2-4267-be03-80163006e6ab admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:57:45.359604 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1241/2459] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:57:45 2022] POST /identity/v3/users => generated 292 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:57:45.365203 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24307fc3-fbc8-4697-8e7e-cd9c1d0d2632 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:57:45.386088 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24307fc3-fbc8-4697-8e7e-cd9c1d0d2632 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:57:45.393043 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f154c-d5c5-4607-bbf8-355914dd612f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:57:45.393951 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f154c-d5c5-4607-bbf8-355914dd612f admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:57:45.394394 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f154c-d5c5-4607-bbf8-355914dd612f admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:57:45.394803 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f154c-d5c5-4607-bbf8-355914dd612f admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:57:45.395915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f154c-d5c5-4607-bbf8-355914dd612f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:57:45.399106 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f154c-d5c5-4607-bbf8-355914dd612f admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:57:45.418144 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1219/2460] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:57:45.424312 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7046c36c-e6d2-4267-be03-80163006e6ab admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:57:45.443808 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7046c36c-e6d2-4267-be03-80163006e6ab admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:57:45.450207 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07047a45-ac61-4599-906c-a0b0aa55221b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:57:45.450857 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07047a45-ac61-4599-906c-a0b0aa55221b admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:57:45.451185 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07047a45-ac61-4599-906c-a0b0aa55221b admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:57:45.451465 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07047a45-ac61-4599-906c-a0b0aa55221b admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:57:45.452172 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07047a45-ac61-4599-906c-a0b0aa55221b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:57:45.463864 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07047a45-ac61-4599-906c-a0b0aa55221b admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:57:45.484451 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1242/2461] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:57:45.491813 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f154c-d5c5-4607-bbf8-355914dd612f admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:57:45.512446 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f154c-d5c5-4607-bbf8-355914dd612f admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:57:45.523670 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9380dda-91cb-4edd-bcea-1c8cbb5eb3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:57:45.528164 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9380dda-91cb-4edd-bcea-1c8cbb5eb3a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:57:45.528164 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9380dda-91cb-4edd-bcea-1c8cbb5eb3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:57:45.528164 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9380dda-91cb-4edd-bcea-1c8cbb5eb3a5 admin admin] PATH_INFO: `/v3/projects/41d9c715141c46028f9a0da822bfea76/users/53157861be9f45e6a6f4c5f1eeb3b6fc/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:57:45.552710 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9380dda-91cb-4edd-bcea-1c8cbb5eb3a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41d9c715141c46028f9a0da822bfea76, user_id=53157861be9f45e6a6f4c5f1eeb3b6fc, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:57:45.557263 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9380dda-91cb-4edd-bcea-1c8cbb5eb3a5 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:57:45.664112 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1220/2462] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:57:45 2022] PUT /identity/v3/projects/41d9c715141c46028f9a0da822bfea76/users/53157861be9f45e6a6f4c5f1eeb3b6fc/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 07:57:45.669930 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d01bc7-4ef1-45fb-a808-8b2f4841d953 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:57:45.670255 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d01bc7-4ef1-45fb-a808-8b2f4841d953 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:57:45.670572 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d01bc7-4ef1-45fb-a808-8b2f4841d953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:57:45.706507 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-a1d01bc7-4ef1-45fb-a808-8b2f4841d953 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:57:45.708433 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-a1d01bc7-4ef1-45fb-a808-8b2f4841d953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:57:45.838211 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1243/2463] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:57:45.856921 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9380dda-91cb-4edd-bcea-1c8cbb5eb3a5 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:57:45.859938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-c9380dda-91cb-4edd-bcea-1c8cbb5eb3a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:57:45.890807 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:57:45.957655 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9380dda-91cb-4edd-bcea-1c8cbb5eb3a5 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:57:45.962145 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ca32f0-b9a6-44f3-9e32-44d44a26a9d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:57:45.962786 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca32f0-b9a6-44f3-9e32-44d44a26a9d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:57:45.963192 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca32f0-b9a6-44f3-9e32-44d44a26a9d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:57:45.963480 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca32f0-b9a6-44f3-9e32-44d44a26a9d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:57:45.974632 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ca32f0-b9a6-44f3-9e32-44d44a26a9d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:57:45.976239 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ca32f0-b9a6-44f3-9e32-44d44a26a9d7 service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:57:45.988875 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1221/2464] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:57:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:57:48.811494 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d01bc7-4ef1-45fb-a808-8b2f4841d953 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:57:48.820587 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d01bc7-4ef1-45fb-a808-8b2f4841d953 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:57:48.824137 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320c327-bae6-4460-b35c-39abf4e856b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:57:48.824766 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320c327-bae6-4460-b35c-39abf4e856b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:57:48.825129 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320c327-bae6-4460-b35c-39abf4e856b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:57:48.825436 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320c327-bae6-4460-b35c-39abf4e856b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:57:48.827594 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-8320c327-bae6-4460-b35c-39abf4e856b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:57:48.843133 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320c327-bae6-4460-b35c-39abf4e856b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:57:48.846794 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320c327-bae6-4460-b35c-39abf4e856b9 service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:57:48.859157 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1244/2465] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:57:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 07:57:55.968241 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46956781-b7cd-47de-a5cc-77040a2efcdc None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:57:55.968241 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46956781-b7cd-47de-a5cc-77040a2efcdc None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:57:55.968241 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46956781-b7cd-47de-a5cc-77040a2efcdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:57:55.974781 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320c327-bae6-4460-b35c-39abf4e856b9 service neutron] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:57:55.977306 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-8320c327-bae6-4460-b35c-39abf4e856b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:57:55.986915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-46956781-b7cd-47de-a5cc-77040a2efcdc None None] MFA Rules not processed for user `53157861be9f45e6a6f4c5f1eeb3b6fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:57:55.988579 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-46956781-b7cd-47de-a5cc-77040a2efcdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:57:55.996818 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320c327-bae6-4460-b35c-39abf4e856b9 service neutron] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:57:56.003650 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97030ed5-66b4-4a76-bb60-c8d39c119ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:57:56.004592 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97030ed5-66b4-4a76-bb60-c8d39c119ef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:57:56.006734 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97030ed5-66b4-4a76-bb60-c8d39c119ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:57:56.007786 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97030ed5-66b4-4a76-bb60-c8d39c119ef3 admin admin] PATH_INFO: `/v3/users/c9de80eade38407c99f00c5acf45e2bb` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:57:56.009966 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97030ed5-66b4-4a76-bb60-c8d39c119ef3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9de80eade38407c99f00c5acf45e2bb)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:57:56.013149 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97030ed5-66b4-4a76-bb60-c8d39c119ef3 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:57:56.088481 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1222/2466] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:57:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:57:56.093480 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46956781-b7cd-47de-a5cc-77040a2efcdc None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:57:56.113104 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46956781-b7cd-47de-a5cc-77040a2efcdc None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:57:56.118111 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b58527-0268-4feb-9334-f9b82e3d971c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:57:56.118728 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b58527-0268-4feb-9334-f9b82e3d971c admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:57:56.119031 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b58527-0268-4feb-9334-f9b82e3d971c admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:57:56.119305 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b58527-0268-4feb-9334-f9b82e3d971c admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:57:56.119937 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b58527-0268-4feb-9334-f9b82e3d971c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:57:56.121972 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b58527-0268-4feb-9334-f9b82e3d971c admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:57:56.267866 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1223/2467] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:57:56 2022] POST /identity/v3/projects => generated 383 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 07:57:56.277621 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b58527-0268-4feb-9334-f9b82e3d971c admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:57:56.346413 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-97030ed5-66b4-4a76-bb60-c8d39c119ef3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9de80eade38407c99f00c5acf45e2bb'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:57:56.360937 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:57:56.365325 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-97030ed5-66b4-4a76-bb60-c8d39c119ef3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9de80eade38407c99f00c5acf45e2bb'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:57:56.412191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b58527-0268-4feb-9334-f9b82e3d971c admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:57:56.421814 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23cd736-091d-42e1-bfc8-9898d70a89bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:57:56.422904 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23cd736-091d-42e1-bfc8-9898d70a89bf admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:57:56.423427 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23cd736-091d-42e1-bfc8-9898d70a89bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:57:56.423883 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23cd736-091d-42e1-bfc8-9898d70a89bf admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:57:56.424954 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23cd736-091d-42e1-bfc8-9898d70a89bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:57:56.429032 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23cd736-091d-42e1-bfc8-9898d70a89bf admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:57:56.487779 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-97030ed5-66b4-4a76-bb60-c8d39c119ef3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9de80eade38407c99f00c5acf45e2bb'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:57:56.489165 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-97030ed5-66b4-4a76-bb60-c8d39c119ef3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9de80eade38407c99f00c5acf45e2bb'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:57:56.521277 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-97030ed5-66b4-4a76-bb60-c8d39c119ef3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9de80eade38407c99f00c5acf45e2bb'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:57:56.534486 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1245/2468] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 07:57:55 2022] DELETE /identity/v3/users/c9de80eade38407c99f00c5acf45e2bb => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:57:56.634052 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1224/2469] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:57:56 2022] POST /identity/v3/users => generated 298 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:57:56.643118 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97030ed5-66b4-4a76-bb60-c8d39c119ef3 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:57:56.645528 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-97030ed5-66b4-4a76-bb60-c8d39c119ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:57:56.808012 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97030ed5-66b4-4a76-bb60-c8d39c119ef3 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:57:56.824292 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c3c59-5e16-4508-9044-757485b77b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:57:56.824942 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c3c59-5e16-4508-9044-757485b77b17 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:57:56.825658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c3c59-5e16-4508-9044-757485b77b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:57:56.825658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c3c59-5e16-4508-9044-757485b77b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:57:56.826266 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c3c59-5e16-4508-9044-757485b77b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:57:56.828006 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c3c59-5e16-4508-9044-757485b77b17 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:57:56.841990 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1246/2470] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:57:56.846678 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23cd736-091d-42e1-bfc8-9898d70a89bf admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:57:56.858665 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23cd736-091d-42e1-bfc8-9898d70a89bf admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:57:56.871653 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e5390-40f6-42e8-af8f-31870eff387d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:57:56.872888 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e5390-40f6-42e8-af8f-31870eff387d admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:57:56.872888 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e5390-40f6-42e8-af8f-31870eff387d admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:57:56.873233 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e5390-40f6-42e8-af8f-31870eff387d admin admin] PATH_INFO: `/v3/projects/380b9ff2b1b74aada9b6d486e2cbe07d/users/72e21792024344a797796a53d9131cef/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:57:56.896633 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:57:56.903587 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e5390-40f6-42e8-af8f-31870eff387d admin admin] RBAC: Authorizing `identity:create_grant(project_id=380b9ff2b1b74aada9b6d486e2cbe07d, user_id=72e21792024344a797796a53d9131cef, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:57:56.909792 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e5390-40f6-42e8-af8f-31870eff387d admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:57:57.055233 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c3c59-5e16-4508-9044-757485b77b17 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:57:57.056987 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1225/2471] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:57:56 2022] PUT /identity/v3/projects/380b9ff2b1b74aada9b6d486e2cbe07d/users/72e21792024344a797796a53d9131cef/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:57:57.060105 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-e96c3c59-5e16-4508-9044-757485b77b17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:57:57.062163 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e5390-40f6-42e8-af8f-31870eff387d admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:57:57.076489 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c3c59-5e16-4508-9044-757485b77b17 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:57:57.174233 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e5390-40f6-42e8-af8f-31870eff387d admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:57:57.180403 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc63e7e-d254-4d8c-8a64-55d6bbdda762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:57:57.181129 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc63e7e-d254-4d8c-8a64-55d6bbdda762 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:57:57.181486 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc63e7e-d254-4d8c-8a64-55d6bbdda762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:57:57.181756 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc63e7e-d254-4d8c-8a64-55d6bbdda762 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:57:57.185886 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc63e7e-d254-4d8c-8a64-55d6bbdda762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:57:57.187831 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc63e7e-d254-4d8c-8a64-55d6bbdda762 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:57:57.196320 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f390ef-d650-45cf-adaf-b812236e486c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:57:57.197158 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f390ef-d650-45cf-adaf-b812236e486c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:57:57.197441 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f390ef-d650-45cf-adaf-b812236e486c admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:57:57.197966 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f390ef-d650-45cf-adaf-b812236e486c admin admin] PATH_INFO: `/v3/projects/d8dbe1196024439d8d5b0a510c514546` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:57:57.199189 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f390ef-d650-45cf-adaf-b812236e486c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8dbe1196024439d8d5b0a510c514546)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:57:57.202079 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f390ef-d650-45cf-adaf-b812236e486c admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:57:57.203188 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1226/2472] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:57:57.206494 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc63e7e-d254-4d8c-8a64-55d6bbdda762 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:57:57.224484 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc63e7e-d254-4d8c-8a64-55d6bbdda762 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:57:57.232440 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7354311-a6fc-408a-b4e6-3932f59d22af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:57:57.233521 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7354311-a6fc-408a-b4e6-3932f59d22af admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:57:57.233972 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7354311-a6fc-408a-b4e6-3932f59d22af admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:57:57.234398 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7354311-a6fc-408a-b4e6-3932f59d22af admin admin] PATH_INFO: `/v3/projects/380b9ff2b1b74aada9b6d486e2cbe07d/users/72e21792024344a797796a53d9131cef/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:57:57.237942 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7354311-a6fc-408a-b4e6-3932f59d22af admin admin] RBAC: Authorizing `identity:create_grant(project_id=380b9ff2b1b74aada9b6d486e2cbe07d, user_id=72e21792024344a797796a53d9131cef, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:57:57.242576 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7354311-a6fc-408a-b4e6-3932f59d22af admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:57:57.261288 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1227/2473] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:57:57 2022] PUT /identity/v3/projects/380b9ff2b1b74aada9b6d486e2cbe07d/users/72e21792024344a797796a53d9131cef/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:57:57.403474 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-f8f390ef-d650-45cf-adaf-b812236e486c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8dbe1196024439d8d5b0a510c514546', 'request_id': 'req-f8f390ef-d650-45cf-adaf-b812236e486c'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:57:57.413679 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-f8f390ef-d650-45cf-adaf-b812236e486c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8dbe1196024439d8d5b0a510c514546', 'request_id': 'req-f8f390ef-d650-45cf-adaf-b812236e486c'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:57:57.422409 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-f8f390ef-d650-45cf-adaf-b812236e486c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8dbe1196024439d8d5b0a510c514546', 'request_id': 'req-f8f390ef-d650-45cf-adaf-b812236e486c'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:57:57.561173 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:57:57.570848 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-f8f390ef-d650-45cf-adaf-b812236e486c admin admin] The token cache is being invalidate because project d8dbe1196024439d8d5b0a510c514546 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 07:57:57.577569 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-f8f390ef-d650-45cf-adaf-b812236e486c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:57:57.577569 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-f8f390ef-d650-45cf-adaf-b812236e486c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 07:57:57.577569 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1247/2474] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 07:57:57 2022] DELETE /identity/v3/projects/d8dbe1196024439d8d5b0a510c514546 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:57:57.585091 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7d180-5cea-4bfe-86b7-b111f80a5468 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:57:57.585091 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7d180-5cea-4bfe-86b7-b111f80a5468 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:57:57.585091 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7d180-5cea-4bfe-86b7-b111f80a5468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:57:57.629184 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-77b7d180-5cea-4bfe-86b7-b111f80a5468 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:57:57.631925 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-77b7d180-5cea-4bfe-86b7-b111f80a5468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:57:57.772745 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1228/2475] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:57:57.781367 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ccb34c-9a1a-499d-87c8-6f455d14e01d None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:57:57.782826 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ccb34c-9a1a-499d-87c8-6f455d14e01d None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:57:57.783378 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ccb34c-9a1a-499d-87c8-6f455d14e01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:57:57.812006 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-85ccb34c-9a1a-499d-87c8-6f455d14e01d None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:57:57.814111 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-85ccb34c-9a1a-499d-87c8-6f455d14e01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:57:57.823854 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1248/2476] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:57:57.829915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b7d180-5cea-4bfe-86b7-b111f80a5468 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:57:57.842484 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b7d180-5cea-4bfe-86b7-b111f80a5468 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:57:57.849110 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fbcb7f-f5b9-40f5-826d-b18fb3305592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:57:57.849824 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbcb7f-f5b9-40f5-826d-b18fb3305592 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:57:57.850187 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbcb7f-f5b9-40f5-826d-b18fb3305592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:57:57.850535 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbcb7f-f5b9-40f5-826d-b18fb3305592 admin admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:57:57.851320 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fbcb7f-f5b9-40f5-826d-b18fb3305592 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 07:57:57.851697 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fbcb7f-f5b9-40f5-826d-b18fb3305592 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:57:57.853434 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fbcb7f-f5b9-40f5-826d-b18fb3305592 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:57:57.877199 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1229/2477] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 07:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 07:57:57.882008 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ccb34c-9a1a-499d-87c8-6f455d14e01d None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:57:57.896329 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ccb34c-9a1a-499d-87c8-6f455d14e01d None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:57:57.903623 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb9244-dc18-4302-8d4b-1d2b0938c15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:57:57.905401 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb9244-dc18-4302-8d4b-1d2b0938c15e admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:57:57.905869 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb9244-dc18-4302-8d4b-1d2b0938c15e admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:57:57.906381 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb9244-dc18-4302-8d4b-1d2b0938c15e admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:57:57.908199 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb9244-dc18-4302-8d4b-1d2b0938c15e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:57:57.911870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb9244-dc18-4302-8d4b-1d2b0938c15e admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:57:58.141917 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1249/2478] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 07:57:57 2022] POST /identity/v3/projects => generated 377 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:57:58.147257 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fbcb7f-f5b9-40f5-826d-b18fb3305592 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:57:58.165967 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fbcb7f-f5b9-40f5-826d-b18fb3305592 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:57:58.236623 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b5394-b554-4fce-a602-993b5a441b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:57:58.237693 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b5394-b554-4fce-a602-993b5a441b6a admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:57:58.238118 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b5394-b554-4fce-a602-993b5a441b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:57:58.238503 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b5394-b554-4fce-a602-993b5a441b6a admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:57:58.239384 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b5394-b554-4fce-a602-993b5a441b6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:57:58.241594 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b5394-b554-4fce-a602-993b5a441b6a admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:57:58.251005 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:57:58.413039 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1230/2479] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 07:57:58 2022] POST /identity/v3/users => generated 289 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 07:57:58.418666 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb9244-dc18-4302-8d4b-1d2b0938c15e admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:57:58.444020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb9244-dc18-4302-8d4b-1d2b0938c15e admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:57:58.455438 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad56a5b-06b5-4be5-9399-68d35597be2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:57:58.456952 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad56a5b-06b5-4be5-9399-68d35597be2a admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:57:58.457765 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad56a5b-06b5-4be5-9399-68d35597be2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:57:58.458780 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad56a5b-06b5-4be5-9399-68d35597be2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:57:58.460235 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad56a5b-06b5-4be5-9399-68d35597be2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:57:58.464126 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad56a5b-06b5-4be5-9399-68d35597be2a admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:57:58.496666 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1250/2480] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 07:57:58.501833 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b5394-b554-4fce-a602-993b5a441b6a admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:57:58.522198 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b5394-b554-4fce-a602-993b5a441b6a admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:57:58.533303 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad90e28-061b-4755-a9a1-d90649c94451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:57:58.535093 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad90e28-061b-4755-a9a1-d90649c94451 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:57:58.535745 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad90e28-061b-4755-a9a1-d90649c94451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:57:58.536234 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad90e28-061b-4755-a9a1-d90649c94451 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:57:58.537173 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad90e28-061b-4755-a9a1-d90649c94451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:57:58.540215 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad90e28-061b-4755-a9a1-d90649c94451 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:57:58.565455 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1231/2481] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 07:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 07:57:58.570376 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad56a5b-06b5-4be5-9399-68d35597be2a admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:57:58.582634 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad56a5b-06b5-4be5-9399-68d35597be2a admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:57:58.587979 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b6e44-779c-4a5b-b7e5-0ead0f4b0c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:57:58.591242 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b6e44-779c-4a5b-b7e5-0ead0f4b0c75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:57:58.591242 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b6e44-779c-4a5b-b7e5-0ead0f4b0c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:57:58.591242 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b6e44-779c-4a5b-b7e5-0ead0f4b0c75 admin admin] PATH_INFO: `/v3/projects/e747d455c2f94bd39079cd63d78ce103/users/d0e5d7a2d5604c4fbc1ea74f4a263e79/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:57:58.616402 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b6e44-779c-4a5b-b7e5-0ead0f4b0c75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e747d455c2f94bd39079cd63d78ce103, user_id=d0e5d7a2d5604c4fbc1ea74f4a263e79, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:57:58.618137 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b6e44-779c-4a5b-b7e5-0ead0f4b0c75 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:57:58.773806 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1251/2482] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 07:57:58 2022] PUT /identity/v3/projects/e747d455c2f94bd39079cd63d78ce103/users/d0e5d7a2d5604c4fbc1ea74f4a263e79/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 07:57:58.777750 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f5b92-a64c-43f7-801d-e086c77e446e None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:57:58.778997 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f5b92-a64c-43f7-801d-e086c77e446e None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:57:58.779837 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f5b92-a64c-43f7-801d-e086c77e446e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:57:58.818155 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-d95f5b92-a64c-43f7-801d-e086c77e446e None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:57:58.820610 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-d95f5b92-a64c-43f7-801d-e086c77e446e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:57:58.975593 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1232/2483] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:57:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:57:58.996970 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b6e44-779c-4a5b-b7e5-0ead0f4b0c75 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:57:58.998812 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-0f3b6e44-779c-4a5b-b7e5-0ead0f4b0c75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:57:59.089412 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b6e44-779c-4a5b-b7e5-0ead0f4b0c75 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:57:59.096903 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cae0d-7b58-4ab9-a07f-399b03e6a93e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:57:59.097654 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cae0d-7b58-4ab9-a07f-399b03e6a93e service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:57:59.098013 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cae0d-7b58-4ab9-a07f-399b03e6a93e service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:57:59.098355 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cae0d-7b58-4ab9-a07f-399b03e6a93e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:57:59.109631 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332cae0d-7b58-4ab9-a07f-399b03e6a93e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:57:59.111003 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332cae0d-7b58-4ab9-a07f-399b03e6a93e service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:57:59.121800 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1252/2484] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:57:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:58:07.707784 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c0a12-82b5-471f-a077-4faf2786feb9 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:58:07.709389 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c0a12-82b5-471f-a077-4faf2786feb9 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:58:07.710023 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c0a12-82b5-471f-a077-4faf2786feb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:58:07.756216 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-b38c0a12-82b5-471f-a077-4faf2786feb9 None None] MFA Rules not processed for user `72e21792024344a797796a53d9131cef`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:58:07.757426 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-b38c0a12-82b5-471f-a077-4faf2786feb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:58:07.919710 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1233/2485] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:58:07 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 07:58:07.936768 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cae0d-7b58-4ab9-a07f-399b03e6a93e service neutron] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:58:07.938863 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-332cae0d-7b58-4ab9-a07f-399b03e6a93e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:58:08.031818 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cae0d-7b58-4ab9-a07f-399b03e6a93e service neutron] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:58:08.037036 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7241e-22ed-4b35-8052-96fec2428a6a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df7725203304d8fbe3a768656cabf23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:58:08.037967 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7241e-22ed-4b35-8052-96fec2428a6a service glance] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:58:08.038424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7241e-22ed-4b35-8052-96fec2428a6a service glance] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:58:08.038864 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7241e-22ed-4b35-8052-96fec2428a6a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:58:08.041027 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-ece7241e-22ed-4b35-8052-96fec2428a6a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:58:08.150028 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:58:08.165753 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece7241e-22ed-4b35-8052-96fec2428a6a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:58:08.169585 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece7241e-22ed-4b35-8052-96fec2428a6a service glance] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:58:08.189882 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1253/2486] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:58:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 07:58:08.712758 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d794d0-9325-4031-8e87-d4cfa87fb3ac None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:58:08.714656 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d794d0-9325-4031-8e87-d4cfa87fb3ac None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:58:08.715147 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d794d0-9325-4031-8e87-d4cfa87fb3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:58:08.744336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-12d794d0-9325-4031-8e87-d4cfa87fb3ac None None] MFA Rules not processed for user `30dc2621143f4604b53bb44b82e8efbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:58:08.747037 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-12d794d0-9325-4031-8e87-d4cfa87fb3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:58:08.860513 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1234/2487] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Aug 26 07:58:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:58:08.862389 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bb45f-5540-4fe2-96a5-ffe957e77d7e None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:58:08.862685 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bb45f-5540-4fe2-96a5-ffe957e77d7e None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:58:08.862964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bb45f-5540-4fe2-96a5-ffe957e77d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:58:08.900756 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-500bb45f-5540-4fe2-96a5-ffe957e77d7e None None] MFA Rules not processed for user `d0e5d7a2d5604c4fbc1ea74f4a263e79`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:58:08.904716 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-500bb45f-5540-4fe2-96a5-ffe957e77d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:58:09.011916 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1254/2488] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:58:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:58:09.032796 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d794d0-9325-4031-8e87-d4cfa87fb3ac None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:58:09.035272 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-12d794d0-9325-4031-8e87-d4cfa87fb3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:58:09.048707 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:58:09.137442 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500bb45f-5540-4fe2-96a5-ffe957e77d7e None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:58:09.139616 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-500bb45f-5540-4fe2-96a5-ffe957e77d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:58:09.140098 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d794d0-9325-4031-8e87-d4cfa87fb3ac None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:58:09.150740 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ef286-7920-4527-ba7e-a3d7fc82e689 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc92c0a0a2cc4722868e6877bac93ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:58:09.151502 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ef286-7920-4527-ba7e-a3d7fc82e689 service nova] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:58:09.151943 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ef286-7920-4527-ba7e-a3d7fc82e689 service nova] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:58:09.152237 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ef286-7920-4527-ba7e-a3d7fc82e689 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:58:09.162307 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ef286-7920-4527-ba7e-a3d7fc82e689 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:58:09.164304 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ef286-7920-4527-ba7e-a3d7fc82e689 service nova] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:58:09.177349 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1235/2489] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:58:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 07:58:09.302829 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500bb45f-5540-4fe2-96a5-ffe957e77d7e None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:58:09.311618 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22c8ab-7079-4605-a09c-6336565e0d36 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3142255c263e44a189db82c621f87e7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:58:09.313857 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22c8ab-7079-4605-a09c-6336565e0d36 service swift] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:58:09.314360 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22c8ab-7079-4605-a09c-6336565e0d36 service swift] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:58:09.314852 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22c8ab-7079-4605-a09c-6336565e0d36 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:58:09.330263 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a22c8ab-7079-4605-a09c-6336565e0d36 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:58:09.333228 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a22c8ab-7079-4605-a09c-6336565e0d36 service swift] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:58:09.344507 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1255/2490] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 26 07:58:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 26 07:58:13.599230 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bbe595-9189-4b04-b612-1022f622c694 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:58:13.599714 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bbe595-9189-4b04-b612-1022f622c694 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:58:13.606584 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bbe595-9189-4b04-b612-1022f622c694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:58:13.638582 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-15bbe595-9189-4b04-b612-1022f622c694 None None] MFA Rules not processed for user `30dc2621143f4604b53bb44b82e8efbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:58:13.642441 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-15bbe595-9189-4b04-b612-1022f622c694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:58:13.675364 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1236/2491] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Aug 26 07:58:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:58:13.704568 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22c8ab-7079-4605-a09c-6336565e0d36 service swift] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:58:13.704568 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22c8ab-7079-4605-a09c-6336565e0d36 service swift] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:58:13.724483 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bbe595-9189-4b04-b612-1022f622c694 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:58:13.747919 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd03c06-52f0-4ea3-9ad9-8603199facb8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3142255c263e44a189db82c621f87e7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:58:13.747919 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd03c06-52f0-4ea3-9ad9-8603199facb8 service swift] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:58:13.747919 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd03c06-52f0-4ea3-9ad9-8603199facb8 service swift] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:58:13.747919 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd03c06-52f0-4ea3-9ad9-8603199facb8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:58:13.752574 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bbe595-9189-4b04-b612-1022f622c694 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:58:13.779661 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd03c06-52f0-4ea3-9ad9-8603199facb8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:58:13.785436 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33496ead-3fb7-41dc-a060-387b1c3966af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc92c0a0a2cc4722868e6877bac93ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:58:13.790799 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33496ead-3fb7-41dc-a060-387b1c3966af service nova] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:58:13.792255 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33496ead-3fb7-41dc-a060-387b1c3966af service nova] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:58:13.792536 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33496ead-3fb7-41dc-a060-387b1c3966af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:58:13.793604 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd03c06-52f0-4ea3-9ad9-8603199facb8 service swift] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:58:13.799602 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-33496ead-3fb7-41dc-a060-387b1c3966af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:58:13.815222 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1256/2492] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 26 07:58:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 07:58:13.851962 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33496ead-3fb7-41dc-a060-387b1c3966af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:58:13.854269 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33496ead-3fb7-41dc-a060-387b1c3966af service nova] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:58:13.868511 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1237/2493] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:58:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:58:14.130948 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b3504-1183-45c7-9482-4683e9bed84f None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:58:14.132457 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b3504-1183-45c7-9482-4683e9bed84f None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:58:14.132882 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b3504-1183-45c7-9482-4683e9bed84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:58:14.163890 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-7b8b3504-1183-45c7-9482-4683e9bed84f None None] MFA Rules not processed for user `d0e5d7a2d5604c4fbc1ea74f4a263e79`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:58:14.165152 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-7b8b3504-1183-45c7-9482-4683e9bed84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:58:14.175178 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1257/2494] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:58:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:58:23.869669 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=39 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:58:24.150249 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=77 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:58:26.197285 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5854f6-a033-4f24-978b-e311a7960b74 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:58:26.198322 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5854f6-a033-4f24-978b-e311a7960b74 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:58:26.198768 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5854f6-a033-4f24-978b-e311a7960b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:58:26.241388 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-0a5854f6-a033-4f24-978b-e311a7960b74 None None] MFA Rules not processed for user `53157861be9f45e6a6f4c5f1eeb3b6fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:58:26.243233 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-0a5854f6-a033-4f24-978b-e311a7960b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:58:26.272579 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1238/2495] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:58:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:58:26.899942 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b3504-1183-45c7-9482-4683e9bed84f None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:58:26.901966 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-7b8b3504-1183-45c7-9482-4683e9bed84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:58:27.034619 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b3504-1183-45c7-9482-4683e9bed84f None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:58:27.058371 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24af2a-3413-4e2b-95c3-2c5c1599aada service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:58:27.059054 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24af2a-3413-4e2b-95c3-2c5c1599aada service cinder] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:58:27.059340 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24af2a-3413-4e2b-95c3-2c5c1599aada service cinder] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:58:27.059612 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24af2a-3413-4e2b-95c3-2c5c1599aada service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:58:27.078606 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-6e24af2a-3413-4e2b-95c3-2c5c1599aada service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:58:27.233156 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e24af2a-3413-4e2b-95c3-2c5c1599aada service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:58:27.234765 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e24af2a-3413-4e2b-95c3-2c5c1599aada service cinder] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:58:27.246402 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1258/2496] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:58:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:58:27.596817 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5854f6-a033-4f24-978b-e311a7960b74 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:58:27.611123 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-0a5854f6-a033-4f24-978b-e311a7960b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:58:27.612113 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5854f6-a033-4f24-978b-e311a7960b74 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:58:27.615822 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127cd2b-d3d2-4fef-ab85-243632b7e45b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:58:27.616436 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127cd2b-d3d2-4fef-ab85-243632b7e45b service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:58:27.616712 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127cd2b-d3d2-4fef-ab85-243632b7e45b service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:58:27.616983 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127cd2b-d3d2-4fef-ab85-243632b7e45b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:58:27.618734 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-2127cd2b-d3d2-4fef-ab85-243632b7e45b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:58:27.630413 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127cd2b-d3d2-4fef-ab85-243632b7e45b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:58:27.631896 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127cd2b-d3d2-4fef-ab85-243632b7e45b service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:58:27.642000 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1239/2497] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:58:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:58:32.304928 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46044175-430b-4812-8e71-2cf17690f6d8 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:58:32.305475 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46044175-430b-4812-8e71-2cf17690f6d8 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:58:32.305475 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46044175-430b-4812-8e71-2cf17690f6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:58:32.332990 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-46044175-430b-4812-8e71-2cf17690f6d8 None None] MFA Rules not processed for user `104001160e274732be5e9f75dfee5501`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:58:32.335307 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-46044175-430b-4812-8e71-2cf17690f6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:58:32.401788 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1259/2498] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:58:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:58:37.637296 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=9 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:58:37.879985 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb915f-a2c8-4e35-82bc-9771ac74d6cd None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:58:37.880460 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb915f-a2c8-4e35-82bc-9771ac74d6cd None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:58:37.880834 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb915f-a2c8-4e35-82bc-9771ac74d6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:58:37.903583 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-83fb915f-a2c8-4e35-82bc-9771ac74d6cd None None] MFA Rules not processed for user `30dc2621143f4604b53bb44b82e8efbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:58:37.905913 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-83fb915f-a2c8-4e35-82bc-9771ac74d6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:58:37.917759 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1240/2499] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Aug 26 07:58:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:58:37.929571 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46044175-430b-4812-8e71-2cf17690f6d8 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:58:37.943506 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46044175-430b-4812-8e71-2cf17690f6d8 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:58:37.949174 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac4a3b1-1f2c-4109-bfae-be683a233b2e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3142255c263e44a189db82c621f87e7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:58:37.950322 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4a3b1-1f2c-4109-bfae-be683a233b2e service swift] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:58:37.950670 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4a3b1-1f2c-4109-bfae-be683a233b2e service swift] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:58:37.950943 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4a3b1-1f2c-4109-bfae-be683a233b2e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:58:37.962373 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac4a3b1-1f2c-4109-bfae-be683a233b2e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:58:37.964794 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac4a3b1-1f2c-4109-bfae-be683a233b2e service swift] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:58:37.975947 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1260/2500] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 26 07:58:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 07:58:47.972883 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=79 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:58:48.403271 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=3 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:58:48.665032 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c2295-0319-45a3-8dad-ed2497b75caa None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:58:48.665911 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c2295-0319-45a3-8dad-ed2497b75caa None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:58:48.666645 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c2295-0319-45a3-8dad-ed2497b75caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:58:48.726820 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-958c2295-0319-45a3-8dad-ed2497b75caa None None] MFA Rules not processed for user `30dc2621143f4604b53bb44b82e8efbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:58:48.728841 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-958c2295-0319-45a3-8dad-ed2497b75caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:58:48.761971 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1241/2501] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Aug 26 07:58:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:58:48.804971 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac4a3b1-1f2c-4109-bfae-be683a233b2e service swift] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:58:48.828967 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac4a3b1-1f2c-4109-bfae-be683a233b2e service swift] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:58:48.839756 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340c4a1-957d-454f-a92d-38649f9de8b5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3142255c263e44a189db82c621f87e7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:58:48.840923 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340c4a1-957d-454f-a92d-38649f9de8b5 service swift] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:58:48.841416 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340c4a1-957d-454f-a92d-38649f9de8b5 service swift] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:58:48.842942 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340c4a1-957d-454f-a92d-38649f9de8b5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:58:48.856492 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0340c4a1-957d-454f-a92d-38649f9de8b5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:58:48.860354 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0340c4a1-957d-454f-a92d-38649f9de8b5 service swift] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:58:48.881543 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1261/2502] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 26 07:58:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 07:58:57.486618 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b06ba-9a24-495b-9137-b1b5608573a4 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:58:57.487886 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b06ba-9a24-495b-9137-b1b5608573a4 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:58:57.491316 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b06ba-9a24-495b-9137-b1b5608573a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:58:57.528280 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-769b06ba-9a24-495b-9137-b1b5608573a4 None None] MFA Rules not processed for user `0e024988791d4079888cc50db9c0b240`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:58:57.533164 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-769b06ba-9a24-495b-9137-b1b5608573a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:58:57.542303 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1242/2503] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 07:58:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:58:58.869115 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=6 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:59:07.519564 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=6 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:59:12.190731 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4778d5e-0b17-4c91-8fee-36cb840cefa3 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:59:12.191306 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4778d5e-0b17-4c91-8fee-36cb840cefa3 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:59:12.191432 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4778d5e-0b17-4c91-8fee-36cb840cefa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:59:12.214622 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-c4778d5e-0b17-4c91-8fee-36cb840cefa3 None None] MFA Rules not processed for user `30dc2621143f4604b53bb44b82e8efbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 07:59:12.215889 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-c4778d5e-0b17-4c91-8fee-36cb840cefa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 07:59:12.224304 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1262/2504] 10.222.0.42 () {58 vars in 967 bytes} [Fri Aug 26 07:59:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 07:59:12.250597 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b06ba-9a24-495b-9137-b1b5608573a4 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:59:12.269984 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b06ba-9a24-495b-9137-b1b5608573a4 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:59:12.279945 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39462f6-bc48-41bd-b526-381093d408bc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3142255c263e44a189db82c621f87e7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:59:12.280800 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39462f6-bc48-41bd-b526-381093d408bc service swift] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:59:12.281192 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39462f6-bc48-41bd-b526-381093d408bc service swift] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:59:12.281569 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39462f6-bc48-41bd-b526-381093d408bc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:59:12.293909 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39462f6-bc48-41bd-b526-381093d408bc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:59:12.296379 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39462f6-bc48-41bd-b526-381093d408bc service swift] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:59:12.308782 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1243/2505] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 26 07:59:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 07:59:22.210789 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=3 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:59:22.303617 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=6 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 07:59:26.085579 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4778d5e-0b17-4c91-8fee-36cb840cefa3 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 07:59:26.097087 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4778d5e-0b17-4c91-8fee-36cb840cefa3 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 07:59:26.102286 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd880c-36ef-429d-a387-cc4d7cce1d35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 07:59:26.103024 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd880c-36ef-429d-a387-cc4d7cce1d35 service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 07:59:26.103628 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd880c-36ef-429d-a387-cc4d7cce1d35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 07:59:26.103927 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd880c-36ef-429d-a387-cc4d7cce1d35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 07:59:26.116734 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd880c-36ef-429d-a387-cc4d7cce1d35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 07:59:26.117971 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd880c-36ef-429d-a387-cc4d7cce1d35 service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 07:59:26.130688 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1263/2506] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 07:59:26 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 07:59:36.124698 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=6 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:00:03.210233 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39462f6-bc48-41bd-b526-381093d408bc service swift] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:03.211708 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-e39462f6-bc48-41bd-b526-381093d408bc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:00:03.380532 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39462f6-bc48-41bd-b526-381093d408bc service swift] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:03.389457 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ce21f-c607-4b75-9ad2-be4e642635b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c2bc293f1b4daca83e8d6dff66a316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:03.390262 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ce21f-c607-4b75-9ad2-be4e642635b9 service placement] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:03.390546 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ce21f-c607-4b75-9ad2-be4e642635b9 service placement] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:03.390817 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ce21f-c607-4b75-9ad2-be4e642635b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:03.392860 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-419ce21f-c607-4b75-9ad2-be4e642635b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:00:03.406462 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419ce21f-c607-4b75-9ad2-be4e642635b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:03.408133 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419ce21f-c607-4b75-9ad2-be4e642635b9 service placement] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:03.421595 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1244/2507] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:00:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:00:08.989811 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd880c-36ef-429d-a387-cc4d7cce1d35 service neutron] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:09.031724 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd880c-36ef-429d-a387-cc4d7cce1d35 service neutron] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:09.035886 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6255832-f790-4cdb-8eca-2becac0184d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:09.040409 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6255832-f790-4cdb-8eca-2becac0184d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:09.040409 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6255832-f790-4cdb-8eca-2becac0184d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:09.040409 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6255832-f790-4cdb-8eca-2becac0184d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:09.040409 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-c6255832-f790-4cdb-8eca-2becac0184d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:00:09.077564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6255832-f790-4cdb-8eca-2becac0184d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:09.080536 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6255832-f790-4cdb-8eca-2becac0184d9 service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:09.101742 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1264/2508] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:00:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:00:13.414208 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=63 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:00:13.463396 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ce21f-c607-4b75-9ad2-be4e642635b9 service placement] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:13.477155 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ce21f-c607-4b75-9ad2-be4e642635b9 service placement] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:13.483800 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483d638-7e83-4cd6-9fbc-bfc52f223494 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c2bc293f1b4daca83e8d6dff66a316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:13.484426 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483d638-7e83-4cd6-9fbc-bfc52f223494 service placement] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:13.484709 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483d638-7e83-4cd6-9fbc-bfc52f223494 service placement] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:13.484986 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483d638-7e83-4cd6-9fbc-bfc52f223494 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:13.486870 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-8483d638-7e83-4cd6-9fbc-bfc52f223494 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:00:13.499670 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483d638-7e83-4cd6-9fbc-bfc52f223494 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:13.501607 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483d638-7e83-4cd6-9fbc-bfc52f223494 service placement] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:13.515024 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1245/2509] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:00:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:00:13.656390 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6255832-f790-4cdb-8eca-2becac0184d9 service neutron] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:13.658000 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-c6255832-f790-4cdb-8eca-2becac0184d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:00:13.670937 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6255832-f790-4cdb-8eca-2becac0184d9 service neutron] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:13.675990 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c191a65-d9ac-436f-99b6-f18c00082632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:13.676625 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c191a65-d9ac-436f-99b6-f18c00082632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:13.676910 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c191a65-d9ac-436f-99b6-f18c00082632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:13.677178 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c191a65-d9ac-436f-99b6-f18c00082632 admin admin] PATH_INFO: `/v3/users/cc96be5baacf490bad43962fa4a24e4a` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:13.678303 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c191a65-d9ac-436f-99b6-f18c00082632 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc96be5baacf490bad43962fa4a24e4a)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:13.680274 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c191a65-d9ac-436f-99b6-f18c00082632 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:13.890741 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-8c191a65-d9ac-436f-99b6-f18c00082632 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc96be5baacf490bad43962fa4a24e4a'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:00:13.901523 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-8c191a65-d9ac-436f-99b6-f18c00082632 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc96be5baacf490bad43962fa4a24e4a'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:00:14.036906 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-8c191a65-d9ac-436f-99b6-f18c00082632 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc96be5baacf490bad43962fa4a24e4a'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:00:14.037615 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-8c191a65-d9ac-436f-99b6-f18c00082632 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc96be5baacf490bad43962fa4a24e4a'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:00:14.052997 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-8c191a65-d9ac-436f-99b6-f18c00082632 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc96be5baacf490bad43962fa4a24e4a'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:00:14.059960 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1265/2510] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 08:00:13 2022] DELETE /identity/v3/users/cc96be5baacf490bad43962fa4a24e4a => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:00:14.375554 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483d638-7e83-4cd6-9fbc-bfc52f223494 service placement] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:14.388417 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483d638-7e83-4cd6-9fbc-bfc52f223494 service placement] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:14.502191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b821b175-2754-44cc-96b8-233ddaafe0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:14.502919 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821b175-2754-44cc-96b8-233ddaafe0dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:14.503147 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821b175-2754-44cc-96b8-233ddaafe0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:14.503465 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821b175-2754-44cc-96b8-233ddaafe0dd admin admin] PATH_INFO: `/v3/projects/5a9014c6a95949ff917046133886ed98` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:14.504599 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b821b175-2754-44cc-96b8-233ddaafe0dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a9014c6a95949ff917046133886ed98)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:14.506511 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b821b175-2754-44cc-96b8-233ddaafe0dd admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:14.623326 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-b821b175-2754-44cc-96b8-233ddaafe0dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a9014c6a95949ff917046133886ed98', 'request_id': 'req-b821b175-2754-44cc-96b8-233ddaafe0dd'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:00:14.629216 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-b821b175-2754-44cc-96b8-233ddaafe0dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a9014c6a95949ff917046133886ed98', 'request_id': 'req-b821b175-2754-44cc-96b8-233ddaafe0dd'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:00:14.717102 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-b821b175-2754-44cc-96b8-233ddaafe0dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a9014c6a95949ff917046133886ed98', 'request_id': 'req-b821b175-2754-44cc-96b8-233ddaafe0dd'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:00:14.732004 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-b821b175-2754-44cc-96b8-233ddaafe0dd admin admin] The token cache is being invalidate because project 5a9014c6a95949ff917046133886ed98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:00:14.736229 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-b821b175-2754-44cc-96b8-233ddaafe0dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:00:14.736229 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-b821b175-2754-44cc-96b8-233ddaafe0dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:00:14.736229 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1246/2511] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 08:00:14 2022] DELETE /identity/v3/projects/5a9014c6a95949ff917046133886ed98 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:00:14.739411 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc3ae1-44a5-4eb0-8398-ba4ec0ee3049 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:14.739871 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc3ae1-44a5-4eb0-8398-ba4ec0ee3049 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:14.739963 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc3ae1-44a5-4eb0-8398-ba4ec0ee3049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:14.800394 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-36fc3ae1-44a5-4eb0-8398-ba4ec0ee3049 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:00:14.801643 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-36fc3ae1-44a5-4eb0-8398-ba4ec0ee3049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:00:14.836509 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:00:14.862975 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1266/2512] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:00:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:00:14.871285 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ae11f-8649-42f5-97e9-1c1528882908 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:14.871755 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ae11f-8649-42f5-97e9-1c1528882908 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:14.872042 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ae11f-8649-42f5-97e9-1c1528882908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:14.892084 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-e67ae11f-8649-42f5-97e9-1c1528882908 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:00:14.896516 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-e67ae11f-8649-42f5-97e9-1c1528882908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:00:14.901232 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1247/2513] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:00:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:00:14.906238 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc3ae1-44a5-4eb0-8398-ba4ec0ee3049 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:14.916085 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc3ae1-44a5-4eb0-8398-ba4ec0ee3049 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:14.921384 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67577cd-57dc-4077-a7da-e585ead1b799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:14.921989 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67577cd-57dc-4077-a7da-e585ead1b799 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:14.922272 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67577cd-57dc-4077-a7da-e585ead1b799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:14.922572 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67577cd-57dc-4077-a7da-e585ead1b799 admin admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:14.923276 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67577cd-57dc-4077-a7da-e585ead1b799 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:00:14.923638 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67577cd-57dc-4077-a7da-e585ead1b799 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:14.925229 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67577cd-57dc-4077-a7da-e585ead1b799 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:14.937690 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1267/2514] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 08:00:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:00:14.946152 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ae11f-8649-42f5-97e9-1c1528882908 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:14.961982 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ae11f-8649-42f5-97e9-1c1528882908 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:14.970087 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0228f-833c-4098-bc0f-0020160b6b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:14.970773 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0228f-833c-4098-bc0f-0020160b6b1d admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:14.971143 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0228f-833c-4098-bc0f-0020160b6b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:14.971589 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0228f-833c-4098-bc0f-0020160b6b1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:14.972734 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c0228f-833c-4098-bc0f-0020160b6b1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:14.976176 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c0228f-833c-4098-bc0f-0020160b6b1d admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:15.115363 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1248/2515] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 08:00:14 2022] POST /identity/v3/projects => generated 363 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:00:15.119822 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67577cd-57dc-4077-a7da-e585ead1b799 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:15.133361 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67577cd-57dc-4077-a7da-e585ead1b799 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:15.211671 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f2abd-ae7d-482e-a2b5-dfa2431a8a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:15.212294 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f2abd-ae7d-482e-a2b5-dfa2431a8a01 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:15.212698 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f2abd-ae7d-482e-a2b5-dfa2431a8a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:15.213003 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f2abd-ae7d-482e-a2b5-dfa2431a8a01 admin admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:15.213630 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f2abd-ae7d-482e-a2b5-dfa2431a8a01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:15.217257 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f2abd-ae7d-482e-a2b5-dfa2431a8a01 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:15.348527 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1268/2516] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 08:00:15 2022] POST /identity/v3/users => generated 282 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:00:15.352660 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0228f-833c-4098-bc0f-0020160b6b1d admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:15.363574 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0228f-833c-4098-bc0f-0020160b6b1d admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:15.371349 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc5541-06b0-4978-b3d6-5b5fcbffbd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:15.371349 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc5541-06b0-4978-b3d6-5b5fcbffbd16 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:15.371349 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc5541-06b0-4978-b3d6-5b5fcbffbd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:15.371349 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc5541-06b0-4978-b3d6-5b5fcbffbd16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:15.371840 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dc5541-06b0-4978-b3d6-5b5fcbffbd16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:15.372303 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dc5541-06b0-4978-b3d6-5b5fcbffbd16 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:15.382664 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1249/2517] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:00:15.387390 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f2abd-ae7d-482e-a2b5-dfa2431a8a01 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:15.397540 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f2abd-ae7d-482e-a2b5-dfa2431a8a01 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:15.406059 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e0e99-6cb7-4a18-89c1-55dca705924c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:15.412941 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e0e99-6cb7-4a18-89c1-55dca705924c admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:15.412941 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e0e99-6cb7-4a18-89c1-55dca705924c admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:15.412941 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e0e99-6cb7-4a18-89c1-55dca705924c admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:15.412941 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e0e99-6cb7-4a18-89c1-55dca705924c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:15.412941 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e0e99-6cb7-4a18-89c1-55dca705924c admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:15.421232 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1269/2518] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:00:15.426498 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc5541-06b0-4978-b3d6-5b5fcbffbd16 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:15.437604 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc5541-06b0-4978-b3d6-5b5fcbffbd16 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:15.442313 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fe6e0-6b92-4691-9e8b-1400fdeb9326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:15.442982 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fe6e0-6b92-4691-9e8b-1400fdeb9326 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:15.443292 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fe6e0-6b92-4691-9e8b-1400fdeb9326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:15.443566 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fe6e0-6b92-4691-9e8b-1400fdeb9326 admin admin] PATH_INFO: `/v3/projects/62702c664d34413cbb081a350a917ae0/users/1d1efb22df3e4e1a8bbb267e2919bfa6/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:15.460523 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4fe6e0-6b92-4691-9e8b-1400fdeb9326 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62702c664d34413cbb081a350a917ae0, user_id=1d1efb22df3e4e1a8bbb267e2919bfa6, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:15.463555 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4fe6e0-6b92-4691-9e8b-1400fdeb9326 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:15.550467 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1250/2519] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 08:00:15 2022] PUT /identity/v3/projects/62702c664d34413cbb081a350a917ae0/users/1d1efb22df3e4e1a8bbb267e2919bfa6/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:00:15.562166 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7880ce0-281d-4995-b717-7410e6760d8c None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:15.562455 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7880ce0-281d-4995-b717-7410e6760d8c None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:15.562851 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7880ce0-281d-4995-b717-7410e6760d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:15.594768 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-f7880ce0-281d-4995-b717-7410e6760d8c None None] MFA Rules not processed for user `1d1efb22df3e4e1a8bbb267e2919bfa6`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:00:15.596027 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-f7880ce0-281d-4995-b717-7410e6760d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:00:15.696186 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1270/2520] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:00:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:00:15.700974 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fe6e0-6b92-4691-9e8b-1400fdeb9326 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:15.750792 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:00:15.798442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fe6e0-6b92-4691-9e8b-1400fdeb9326 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:15.804125 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba516af-e09c-4e2e-a9ba-1a64146b0a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:15.804770 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba516af-e09c-4e2e-a9ba-1a64146b0a65 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:15.805048 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba516af-e09c-4e2e-a9ba-1a64146b0a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:15.805315 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba516af-e09c-4e2e-a9ba-1a64146b0a65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:15.806136 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba516af-e09c-4e2e-a9ba-1a64146b0a65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:15.808109 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba516af-e09c-4e2e-a9ba-1a64146b0a65 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:15.925598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1251/2521] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 08:00:15 2022] POST /identity/v3/projects => generated 365 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:00:15.929918 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7880ce0-281d-4995-b717-7410e6760d8c None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:15.941759 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7880ce0-281d-4995-b717-7410e6760d8c None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:15.977886 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:00:16.006762 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6cf40-acc0-452e-ba85-3200a064176c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:16.006762 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6cf40-acc0-452e-ba85-3200a064176c admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:16.006762 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6cf40-acc0-452e-ba85-3200a064176c admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:16.006762 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6cf40-acc0-452e-ba85-3200a064176c admin admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:16.007303 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f6cf40-acc0-452e-ba85-3200a064176c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:16.008291 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f6cf40-acc0-452e-ba85-3200a064176c admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:16.123258 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1271/2522] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 08:00:15 2022] POST /identity/v3/users => generated 289 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:00:16.124551 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba516af-e09c-4e2e-a9ba-1a64146b0a65 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:16.135732 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba516af-e09c-4e2e-a9ba-1a64146b0a65 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:16.140615 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2cd22-59d0-492f-9f52-9e78f01a1129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:16.141237 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2cd22-59d0-492f-9f52-9e78f01a1129 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:16.141517 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2cd22-59d0-492f-9f52-9e78f01a1129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:16.141827 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2cd22-59d0-492f-9f52-9e78f01a1129 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:16.142513 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d2cd22-59d0-492f-9f52-9e78f01a1129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:16.144303 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d2cd22-59d0-492f-9f52-9e78f01a1129 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:16.157432 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1252/2523] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:00:16.165219 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6cf40-acc0-452e-ba85-3200a064176c admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:16.177150 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6cf40-acc0-452e-ba85-3200a064176c admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:16.181926 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343ffbb-ae3d-4b09-8a9a-2465db9fbec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:16.182663 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343ffbb-ae3d-4b09-8a9a-2465db9fbec5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:16.183041 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343ffbb-ae3d-4b09-8a9a-2465db9fbec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:16.183614 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343ffbb-ae3d-4b09-8a9a-2465db9fbec5 admin admin] PATH_INFO: `/v3/projects/934c44cc33e049c689e9ff790f14b60c/users/57e165b88b914ccd819971d75a307338/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:16.200847 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343ffbb-ae3d-4b09-8a9a-2465db9fbec5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=934c44cc33e049c689e9ff790f14b60c, user_id=57e165b88b914ccd819971d75a307338, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:16.203599 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343ffbb-ae3d-4b09-8a9a-2465db9fbec5 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:16.291262 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1272/2524] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 08:00:16 2022] PUT /identity/v3/projects/934c44cc33e049c689e9ff790f14b60c/users/57e165b88b914ccd819971d75a307338/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:00:16.302929 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2cd22-59d0-492f-9f52-9e78f01a1129 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:16.318075 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2cd22-59d0-492f-9f52-9e78f01a1129 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:16.382690 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f266e6c-bdff-4bdc-afdc-c10074eebc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:16.383351 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f266e6c-bdff-4bdc-afdc-c10074eebc39 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:16.383632 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f266e6c-bdff-4bdc-afdc-c10074eebc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:16.383903 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f266e6c-bdff-4bdc-afdc-c10074eebc39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:16.384551 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f266e6c-bdff-4bdc-afdc-c10074eebc39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:16.386730 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f266e6c-bdff-4bdc-afdc-c10074eebc39 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:16.397072 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1253/2525] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 08:00:16.401692 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343ffbb-ae3d-4b09-8a9a-2465db9fbec5 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:16.413227 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343ffbb-ae3d-4b09-8a9a-2465db9fbec5 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:16.418569 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c12ead-e5a4-4ff8-8307-bc44a9468c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:16.419255 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c12ead-e5a4-4ff8-8307-bc44a9468c34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:16.419544 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c12ead-e5a4-4ff8-8307-bc44a9468c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:16.419793 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c12ead-e5a4-4ff8-8307-bc44a9468c34 admin admin] PATH_INFO: `/v3/projects/934c44cc33e049c689e9ff790f14b60c/users/57e165b88b914ccd819971d75a307338/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:16.421721 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c12ead-e5a4-4ff8-8307-bc44a9468c34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=934c44cc33e049c689e9ff790f14b60c, user_id=57e165b88b914ccd819971d75a307338, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:16.424365 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c12ead-e5a4-4ff8-8307-bc44a9468c34 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:16.434608 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1273/2526] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 08:00:16 2022] PUT /identity/v3/projects/934c44cc33e049c689e9ff790f14b60c/users/57e165b88b914ccd819971d75a307338/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:00:16.446228 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4f784-92fe-48bc-a880-3e3498b9d1a5 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:16.446614 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4f784-92fe-48bc-a880-3e3498b9d1a5 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:16.446894 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4f784-92fe-48bc-a880-3e3498b9d1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:16.477550 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-9ea4f784-92fe-48bc-a880-3e3498b9d1a5 None None] MFA Rules not processed for user `57e165b88b914ccd819971d75a307338`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:00:16.478793 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-9ea4f784-92fe-48bc-a880-3e3498b9d1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:00:16.553392 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1254/2527] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:00:16 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:00:16.567552 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c12ead-e5a4-4ff8-8307-bc44a9468c34 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:16.569376 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-37c12ead-e5a4-4ff8-8307-bc44a9468c34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:00:16.659486 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c12ead-e5a4-4ff8-8307-bc44a9468c34 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:16.666636 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83437831-c288-4505-b6d4-be7a30b67d54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:16.667950 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83437831-c288-4505-b6d4-be7a30b67d54 service cinder] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:16.668455 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83437831-c288-4505-b6d4-be7a30b67d54 service cinder] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:16.668946 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83437831-c288-4505-b6d4-be7a30b67d54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:16.684092 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83437831-c288-4505-b6d4-be7a30b67d54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:16.685563 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83437831-c288-4505-b6d4-be7a30b67d54 service cinder] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:16.697615 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1274/2528] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:00:16 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:00:17.970209 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4f784-92fe-48bc-a880-3e3498b9d1a5 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:17.981538 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:00:18.053886 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4f784-92fe-48bc-a880-3e3498b9d1a5 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:18.062241 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d7cd4-7b93-48ee-af97-4ff420a09487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:18.071104 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d7cd4-7b93-48ee-af97-4ff420a09487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:18.071104 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d7cd4-7b93-48ee-af97-4ff420a09487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:18.071104 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d7cd4-7b93-48ee-af97-4ff420a09487 admin admin] PATH_INFO: `/v3/users/1d1efb22df3e4e1a8bbb267e2919bfa6` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:18.071104 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d7cd4-7b93-48ee-af97-4ff420a09487 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d1efb22df3e4e1a8bbb267e2919bfa6)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:18.071104 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d7cd4-7b93-48ee-af97-4ff420a09487 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:18.495203 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-510d7cd4-7b93-48ee-af97-4ff420a09487 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d1efb22df3e4e1a8bbb267e2919bfa6'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:00:18.496471 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-510d7cd4-7b93-48ee-af97-4ff420a09487 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d1efb22df3e4e1a8bbb267e2919bfa6'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:00:18.616627 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-510d7cd4-7b93-48ee-af97-4ff420a09487 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d1efb22df3e4e1a8bbb267e2919bfa6'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:00:18.621289 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-510d7cd4-7b93-48ee-af97-4ff420a09487 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d1efb22df3e4e1a8bbb267e2919bfa6'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:00:18.629184 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-510d7cd4-7b93-48ee-af97-4ff420a09487 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d1efb22df3e4e1a8bbb267e2919bfa6'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:00:18.657182 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1255/2529] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 08:00:17 2022] DELETE /identity/v3/users/1d1efb22df3e4e1a8bbb267e2919bfa6 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:00:18.661894 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6dcfa-7968-4c62-8ab5-55bd4de2656f None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:18.662449 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6dcfa-7968-4c62-8ab5-55bd4de2656f None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:18.662449 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6dcfa-7968-4c62-8ab5-55bd4de2656f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:18.682952 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-f6e6dcfa-7968-4c62-8ab5-55bd4de2656f None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:00:18.687561 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-f6e6dcfa-7968-4c62-8ab5-55bd4de2656f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:00:18.765005 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1275/2530] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:00:18.777138 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d7cd4-7b93-48ee-af97-4ff420a09487 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:18.778675 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-510d7cd4-7b93-48ee-af97-4ff420a09487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:00:18.873726 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d7cd4-7b93-48ee-af97-4ff420a09487 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:18.877443 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541be20-b091-40f5-a67b-0df3354467bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:18.878059 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541be20-b091-40f5-a67b-0df3354467bb service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:18.878348 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541be20-b091-40f5-a67b-0df3354467bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:18.878612 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541be20-b091-40f5-a67b-0df3354467bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:18.888329 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7541be20-b091-40f5-a67b-0df3354467bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:18.889750 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7541be20-b091-40f5-a67b-0df3354467bb service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:18.899939 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1256/2531] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:00:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:00:19.433660 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6dcfa-7968-4c62-8ab5-55bd4de2656f None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:19.437371 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-f6e6dcfa-7968-4c62-8ab5-55bd4de2656f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:00:19.456167 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6dcfa-7968-4c62-8ab5-55bd4de2656f None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:19.466189 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6158d6-85fc-4d2d-8183-b2d9179af11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:19.467505 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6158d6-85fc-4d2d-8183-b2d9179af11b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:19.468173 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6158d6-85fc-4d2d-8183-b2d9179af11b admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:19.468886 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6158d6-85fc-4d2d-8183-b2d9179af11b admin admin] PATH_INFO: `/v3/projects/62702c664d34413cbb081a350a917ae0` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:19.471287 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6158d6-85fc-4d2d-8183-b2d9179af11b admin admin] RBAC: Authorizing `identity:delete_project(project_id=62702c664d34413cbb081a350a917ae0)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:19.476247 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6158d6-85fc-4d2d-8183-b2d9179af11b admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:19.493328 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:00:19.669063 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-bd6158d6-85fc-4d2d-8183-b2d9179af11b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62702c664d34413cbb081a350a917ae0', 'request_id': 'req-bd6158d6-85fc-4d2d-8183-b2d9179af11b'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:00:19.675924 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-bd6158d6-85fc-4d2d-8183-b2d9179af11b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62702c664d34413cbb081a350a917ae0', 'request_id': 'req-bd6158d6-85fc-4d2d-8183-b2d9179af11b'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:00:19.684354 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-bd6158d6-85fc-4d2d-8183-b2d9179af11b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62702c664d34413cbb081a350a917ae0', 'request_id': 'req-bd6158d6-85fc-4d2d-8183-b2d9179af11b'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:00:19.778376 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-bd6158d6-85fc-4d2d-8183-b2d9179af11b admin admin] The token cache is being invalidate because project 62702c664d34413cbb081a350a917ae0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:00:19.778376 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-bd6158d6-85fc-4d2d-8183-b2d9179af11b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:00:19.778376 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-bd6158d6-85fc-4d2d-8183-b2d9179af11b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:00:19.779483 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1276/2532] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 08:00:19 2022] DELETE /identity/v3/projects/62702c664d34413cbb081a350a917ae0 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:00:19.784070 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541be20-b091-40f5-a67b-0df3354467bb service neutron] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:19.795277 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541be20-b091-40f5-a67b-0df3354467bb service neutron] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:19.814445 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:00:19.865126 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333477a-8280-44b9-b9e9-ba74dcae2f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:19.865396 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333477a-8280-44b9-b9e9-ba74dcae2f7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:19.865611 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333477a-8280-44b9-b9e9-ba74dcae2f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:19.866084 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333477a-8280-44b9-b9e9-ba74dcae2f7f admin admin] PATH_INFO: `/v3/users/57e165b88b914ccd819971d75a307338` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:19.867959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1333477a-8280-44b9-b9e9-ba74dcae2f7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=57e165b88b914ccd819971d75a307338)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:19.869830 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1333477a-8280-44b9-b9e9-ba74dcae2f7f admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:20.070881 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-1333477a-8280-44b9-b9e9-ba74dcae2f7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57e165b88b914ccd819971d75a307338'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:00:20.071572 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-1333477a-8280-44b9-b9e9-ba74dcae2f7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57e165b88b914ccd819971d75a307338'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:00:20.139447 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-1333477a-8280-44b9-b9e9-ba74dcae2f7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57e165b88b914ccd819971d75a307338'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:00:20.140217 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-1333477a-8280-44b9-b9e9-ba74dcae2f7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57e165b88b914ccd819971d75a307338'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:00:20.150435 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-1333477a-8280-44b9-b9e9-ba74dcae2f7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57e165b88b914ccd819971d75a307338'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:00:20.179737 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1257/2533] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 08:00:19 2022] DELETE /identity/v3/users/57e165b88b914ccd819971d75a307338 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:00:20.706932 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6158d6-85fc-4d2d-8183-b2d9179af11b admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:20.712560 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-bd6158d6-85fc-4d2d-8183-b2d9179af11b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:00:20.740068 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6158d6-85fc-4d2d-8183-b2d9179af11b admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:20.829428 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5d64d-dc05-454e-b2fd-990714c04650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:20.830086 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5d64d-dc05-454e-b2fd-990714c04650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:20.830378 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5d64d-dc05-454e-b2fd-990714c04650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:20.830683 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5d64d-dc05-454e-b2fd-990714c04650 admin admin] PATH_INFO: `/v3/projects/934c44cc33e049c689e9ff790f14b60c` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:20.831931 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee5d64d-dc05-454e-b2fd-990714c04650 admin admin] RBAC: Authorizing `identity:delete_project(project_id=934c44cc33e049c689e9ff790f14b60c)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:20.833927 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee5d64d-dc05-454e-b2fd-990714c04650 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:20.995514 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-8ee5d64d-dc05-454e-b2fd-990714c04650 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '934c44cc33e049c689e9ff790f14b60c', 'request_id': 'req-8ee5d64d-dc05-454e-b2fd-990714c04650'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:00:21.002437 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-8ee5d64d-dc05-454e-b2fd-990714c04650 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '934c44cc33e049c689e9ff790f14b60c', 'request_id': 'req-8ee5d64d-dc05-454e-b2fd-990714c04650'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:00:21.010086 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-8ee5d64d-dc05-454e-b2fd-990714c04650 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '934c44cc33e049c689e9ff790f14b60c', 'request_id': 'req-8ee5d64d-dc05-454e-b2fd-990714c04650'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:00:21.101419 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-8ee5d64d-dc05-454e-b2fd-990714c04650 admin admin] The token cache is being invalidate because project 934c44cc33e049c689e9ff790f14b60c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:00:21.101712 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-8ee5d64d-dc05-454e-b2fd-990714c04650 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:00:21.102371 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-8ee5d64d-dc05-454e-b2fd-990714c04650 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:00:21.103919 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1277/2534] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 08:00:20 2022] DELETE /identity/v3/projects/934c44cc33e049c689e9ff790f14b60c => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:00:21.110188 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf446f2-6ccc-4c1a-96fc-dd05cf3dfcce None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:21.110956 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf446f2-6ccc-4c1a-96fc-dd05cf3dfcce None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:21.110956 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf446f2-6ccc-4c1a-96fc-dd05cf3dfcce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:21.134182 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-adf446f2-6ccc-4c1a-96fc-dd05cf3dfcce None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:00:21.135461 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-adf446f2-6ccc-4c1a-96fc-dd05cf3dfcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:00:21.223606 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1258/2535] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:00:21.234939 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a01dad-e2c7-44aa-8c6b-aaac558fb7b1 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:21.235447 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a01dad-e2c7-44aa-8c6b-aaac558fb7b1 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:21.236306 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a01dad-e2c7-44aa-8c6b-aaac558fb7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:21.268838 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-72a01dad-e2c7-44aa-8c6b-aaac558fb7b1 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:00:21.270061 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-72a01dad-e2c7-44aa-8c6b-aaac558fb7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:00:21.280308 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1278/2536] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:00:21.296033 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf446f2-6ccc-4c1a-96fc-dd05cf3dfcce None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:21.310478 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf446f2-6ccc-4c1a-96fc-dd05cf3dfcce None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:21.316295 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0470a83-f751-4df8-8813-4ea2249dfeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:21.319298 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0470a83-f751-4df8-8813-4ea2249dfeec admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:21.319298 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0470a83-f751-4df8-8813-4ea2249dfeec admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:21.319298 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0470a83-f751-4df8-8813-4ea2249dfeec admin admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:21.319298 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0470a83-f751-4df8-8813-4ea2249dfeec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:00:21.319298 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0470a83-f751-4df8-8813-4ea2249dfeec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:21.320963 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0470a83-f751-4df8-8813-4ea2249dfeec admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:21.335412 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1259/2537] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 08:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:00:21.343298 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a01dad-e2c7-44aa-8c6b-aaac558fb7b1 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:21.356806 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a01dad-e2c7-44aa-8c6b-aaac558fb7b1 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:21.362262 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d945c-2ef2-47e6-8eb1-37e5741eb804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:21.363170 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d945c-2ef2-47e6-8eb1-37e5741eb804 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:21.363476 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d945c-2ef2-47e6-8eb1-37e5741eb804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:21.363763 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d945c-2ef2-47e6-8eb1-37e5741eb804 admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:21.364810 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d945c-2ef2-47e6-8eb1-37e5741eb804 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:21.367172 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d945c-2ef2-47e6-8eb1-37e5741eb804 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:21.389064 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:00:21.541112 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1279/2538] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 08:00:21 2022] POST /identity/v3/projects => generated 377 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:00:21.546368 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0470a83-f751-4df8-8813-4ea2249dfeec admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:21.558719 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0470a83-f751-4df8-8813-4ea2249dfeec admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:21.584180 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:00:21.621696 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403ec4c-d9f7-4c4e-ba0c-f7f7458219bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:21.622318 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403ec4c-d9f7-4c4e-ba0c-f7f7458219bb admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:21.622601 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403ec4c-d9f7-4c4e-ba0c-f7f7458219bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:21.622878 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403ec4c-d9f7-4c4e-ba0c-f7f7458219bb admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:21.623538 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403ec4c-d9f7-4c4e-ba0c-f7f7458219bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:21.625486 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403ec4c-d9f7-4c4e-ba0c-f7f7458219bb admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:21.712775 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1260/2539] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 08:00:21 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:00:21.718331 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d945c-2ef2-47e6-8eb1-37e5741eb804 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:21.732428 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d945c-2ef2-47e6-8eb1-37e5741eb804 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:21.740021 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131bf4a7-f845-47a2-a6c6-0fc5bebfa6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:21.740639 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bf4a7-f845-47a2-a6c6-0fc5bebfa6d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:21.740920 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bf4a7-f845-47a2-a6c6-0fc5bebfa6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:21.741194 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bf4a7-f845-47a2-a6c6-0fc5bebfa6d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:21.741848 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131bf4a7-f845-47a2-a6c6-0fc5bebfa6d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:21.743664 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131bf4a7-f845-47a2-a6c6-0fc5bebfa6d2 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:21.754280 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1280/2540] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:00:21.758621 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403ec4c-d9f7-4c4e-ba0c-f7f7458219bb admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:21.774346 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403ec4c-d9f7-4c4e-ba0c-f7f7458219bb admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:21.775180 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b075a-cf9e-442b-9581-f26ea3de1ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:21.775814 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b075a-cf9e-442b-9581-f26ea3de1ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:21.776101 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b075a-cf9e-442b-9581-f26ea3de1ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:21.776347 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b075a-cf9e-442b-9581-f26ea3de1ec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:21.777817 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b075a-cf9e-442b-9581-f26ea3de1ec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:21.779453 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b075a-cf9e-442b-9581-f26ea3de1ec2 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:21.792318 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1261/2541] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:00:21.796888 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131bf4a7-f845-47a2-a6c6-0fc5bebfa6d2 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:21.807910 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131bf4a7-f845-47a2-a6c6-0fc5bebfa6d2 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:21.815039 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79cae1b-32b7-402c-a76a-56bd01a1a51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:21.816432 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cae1b-32b7-402c-a76a-56bd01a1a51d admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:21.816951 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cae1b-32b7-402c-a76a-56bd01a1a51d admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:21.817377 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cae1b-32b7-402c-a76a-56bd01a1a51d admin admin] PATH_INFO: `/v3/projects/1c52f26471654b6c9f4f8e6b26d9b57d/users/24da442c7f15437d9616063001323749/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:21.845299 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79cae1b-32b7-402c-a76a-56bd01a1a51d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c52f26471654b6c9f4f8e6b26d9b57d, user_id=24da442c7f15437d9616063001323749, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:21.850338 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79cae1b-32b7-402c-a76a-56bd01a1a51d admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:21.929073 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1281/2542] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 08:00:21 2022] PUT /identity/v3/projects/1c52f26471654b6c9f4f8e6b26d9b57d/users/24da442c7f15437d9616063001323749/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:00:21.941031 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1fef0-aa5f-406d-8ef6-105880ea9039 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:21.941590 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1fef0-aa5f-406d-8ef6-105880ea9039 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:21.942026 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1fef0-aa5f-406d-8ef6-105880ea9039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:21.973247 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-92b1fef0-aa5f-406d-8ef6-105880ea9039 None None] MFA Rules not processed for user `24da442c7f15437d9616063001323749`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:00:21.979168 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-92b1fef0-aa5f-406d-8ef6-105880ea9039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:00:22.055523 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1262/2543] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:00:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:00:22.060081 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79cae1b-32b7-402c-a76a-56bd01a1a51d admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:22.131130 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79cae1b-32b7-402c-a76a-56bd01a1a51d admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:22.135864 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b4f30-78ee-47df-8559-c9c415b94e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:22.137323 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b4f30-78ee-47df-8559-c9c415b94e3b admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:22.137323 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b4f30-78ee-47df-8559-c9c415b94e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:22.137628 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b4f30-78ee-47df-8559-c9c415b94e3b admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:22.138195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b4f30-78ee-47df-8559-c9c415b94e3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:22.140127 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b4f30-78ee-47df-8559-c9c415b94e3b admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:22.267376 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1282/2544] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 08:00:22 2022] POST /identity/v3/projects => generated 375 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:00:22.272796 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1fef0-aa5f-406d-8ef6-105880ea9039 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:22.289130 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1fef0-aa5f-406d-8ef6-105880ea9039 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:22.371345 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ad696-d70d-4211-a68f-c14c1d6b6a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:22.372596 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ad696-d70d-4211-a68f-c14c1d6b6a97 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:22.372596 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ad696-d70d-4211-a68f-c14c1d6b6a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:22.375477 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ad696-d70d-4211-a68f-c14c1d6b6a97 admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:22.375477 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229ad696-d70d-4211-a68f-c14c1d6b6a97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:22.379154 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229ad696-d70d-4211-a68f-c14c1d6b6a97 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:22.490591 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1263/2545] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 08:00:22 2022] POST /identity/v3/users => generated 294 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:00:22.495082 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b4f30-78ee-47df-8559-c9c415b94e3b admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:22.506697 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b4f30-78ee-47df-8559-c9c415b94e3b admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:22.512191 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b60a2b-5f23-4eb5-b3a8-e98c96ce62cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:22.512911 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b60a2b-5f23-4eb5-b3a8-e98c96ce62cf admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:22.513287 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b60a2b-5f23-4eb5-b3a8-e98c96ce62cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:22.513728 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b60a2b-5f23-4eb5-b3a8-e98c96ce62cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:22.514485 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b60a2b-5f23-4eb5-b3a8-e98c96ce62cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:22.516230 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b60a2b-5f23-4eb5-b3a8-e98c96ce62cf admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:22.528278 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1283/2546] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:00:22.532599 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ad696-d70d-4211-a68f-c14c1d6b6a97 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:22.545040 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ad696-d70d-4211-a68f-c14c1d6b6a97 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:22.550274 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a1df0-7330-4ff2-86b1-5a5332575af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:22.550954 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a1df0-7330-4ff2-86b1-5a5332575af6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:22.551348 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a1df0-7330-4ff2-86b1-5a5332575af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:22.551637 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a1df0-7330-4ff2-86b1-5a5332575af6 admin admin] PATH_INFO: `/v3/projects/42522b07eb9641a4a43e45fcc5ed21de/users/774100c078de401d9a97a41025d3b7ce/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:22.572065 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a1df0-7330-4ff2-86b1-5a5332575af6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42522b07eb9641a4a43e45fcc5ed21de, user_id=774100c078de401d9a97a41025d3b7ce, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:22.575466 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a1df0-7330-4ff2-86b1-5a5332575af6 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:22.704066 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:00:22.709009 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1264/2547] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 08:00:22 2022] PUT /identity/v3/projects/42522b07eb9641a4a43e45fcc5ed21de/users/774100c078de401d9a97a41025d3b7ce/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:00:22.713425 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b60a2b-5f23-4eb5-b3a8-e98c96ce62cf admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:22.729492 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b60a2b-5f23-4eb5-b3a8-e98c96ce62cf admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:22.813839 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b698385-5deb-405c-9738-23e289bdba86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:22.814969 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b698385-5deb-405c-9738-23e289bdba86 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:22.815409 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b698385-5deb-405c-9738-23e289bdba86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:22.815892 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b698385-5deb-405c-9738-23e289bdba86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:22.817038 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b698385-5deb-405c-9738-23e289bdba86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:22.820089 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b698385-5deb-405c-9738-23e289bdba86 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:22.839213 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1284/2548] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:00:22.844207 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a1df0-7330-4ff2-86b1-5a5332575af6 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:22.857655 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a1df0-7330-4ff2-86b1-5a5332575af6 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:22.862445 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda85365-30f5-4e60-a1c0-79acd693224e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:22.863191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda85365-30f5-4e60-a1c0-79acd693224e admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:22.863470 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda85365-30f5-4e60-a1c0-79acd693224e admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:22.863745 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda85365-30f5-4e60-a1c0-79acd693224e admin admin] PATH_INFO: `/v3/projects/42522b07eb9641a4a43e45fcc5ed21de/users/774100c078de401d9a97a41025d3b7ce/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:22.865730 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda85365-30f5-4e60-a1c0-79acd693224e admin admin] RBAC: Authorizing `identity:create_grant(project_id=42522b07eb9641a4a43e45fcc5ed21de, user_id=774100c078de401d9a97a41025d3b7ce, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:22.868426 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda85365-30f5-4e60-a1c0-79acd693224e admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:22.880343 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1265/2549] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 08:00:22 2022] PUT /identity/v3/projects/42522b07eb9641a4a43e45fcc5ed21de/users/774100c078de401d9a97a41025d3b7ce/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:00:22.897379 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12fbdc-154e-4b57-b280-f72558385f6e None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:22.897379 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12fbdc-154e-4b57-b280-f72558385f6e None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:22.897379 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12fbdc-154e-4b57-b280-f72558385f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:22.936032 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-bc12fbdc-154e-4b57-b280-f72558385f6e None None] MFA Rules not processed for user `774100c078de401d9a97a41025d3b7ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:00:22.938048 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-bc12fbdc-154e-4b57-b280-f72558385f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:00:22.970084 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:00:23.055061 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1285/2550] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:00:22 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:00:23.074218 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda85365-30f5-4e60-a1c0-79acd693224e admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:23.076877 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-eda85365-30f5-4e60-a1c0-79acd693224e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:00:23.153932 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda85365-30f5-4e60-a1c0-79acd693224e admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:23.157869 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fecac-636e-41d8-88eb-0d0c348728d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:23.158492 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fecac-636e-41d8-88eb-0d0c348728d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:23.158772 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fecac-636e-41d8-88eb-0d0c348728d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:23.159087 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fecac-636e-41d8-88eb-0d0c348728d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:23.224958 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3fecac-636e-41d8-88eb-0d0c348728d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:23.226433 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3fecac-636e-41d8-88eb-0d0c348728d5 service cinder] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:23.237303 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1266/2551] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:00:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:00:29.902492 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12fbdc-154e-4b57-b280-f72558385f6e None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:29.904410 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-bc12fbdc-154e-4b57-b280-f72558385f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:00:29.921289 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12fbdc-154e-4b57-b280-f72558385f6e None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:29.925321 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e413671-c37b-4597-842f-24420fb11eb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:29.925960 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e413671-c37b-4597-842f-24420fb11eb5 service cinder] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:29.926242 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e413671-c37b-4597-842f-24420fb11eb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:29.926530 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e413671-c37b-4597-842f-24420fb11eb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:29.942473 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e413671-c37b-4597-842f-24420fb11eb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:29.952698 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e413671-c37b-4597-842f-24420fb11eb5 service cinder] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:29.955392 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1286/2552] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:00:29 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 08:00:33.232445 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=53,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:00:38.171751 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fecac-636e-41d8-88eb-0d0c348728d5 service cinder] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:38.173593 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-5c3fecac-636e-41d8-88eb-0d0c348728d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:00:38.256821 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fecac-636e-41d8-88eb-0d0c348728d5 service cinder] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:38.262944 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ecece-c13e-4cda-9f66-6e1371b9c97f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:38.263958 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ecece-c13e-4cda-9f66-6e1371b9c97f service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:38.264429 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ecece-c13e-4cda-9f66-6e1371b9c97f service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:38.264878 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ecece-c13e-4cda-9f66-6e1371b9c97f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:38.267759 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-8d2ecece-c13e-4cda-9f66-6e1371b9c97f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:00:38.359501 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ecece-c13e-4cda-9f66-6e1371b9c97f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:38.361124 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ecece-c13e-4cda-9f66-6e1371b9c97f service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:38.371693 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1267/2553] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:00:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:00:39.950380 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=26 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:00:43.068965 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e413671-c37b-4597-842f-24420fb11eb5 service cinder] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:43.070480 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-2e413671-c37b-4597-842f-24420fb11eb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:00:43.087965 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e413671-c37b-4597-842f-24420fb11eb5 service cinder] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:43.094126 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f31a6-5d26-456f-aae6-365b0ac350f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:43.094781 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f31a6-5d26-456f-aae6-365b0ac350f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:43.095090 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f31a6-5d26-456f-aae6-365b0ac350f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:43.095369 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f31a6-5d26-456f-aae6-365b0ac350f5 admin admin] PATH_INFO: `/v3/users/0e024988791d4079888cc50db9c0b240` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:43.096572 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52f31a6-5d26-456f-aae6-365b0ac350f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e024988791d4079888cc50db9c0b240)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:43.098498 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52f31a6-5d26-456f-aae6-365b0ac350f5 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:43.472261 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-d52f31a6-5d26-456f-aae6-365b0ac350f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e024988791d4079888cc50db9c0b240'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:00:43.482656 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-d52f31a6-5d26-456f-aae6-365b0ac350f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e024988791d4079888cc50db9c0b240'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:00:43.662121 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-d52f31a6-5d26-456f-aae6-365b0ac350f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e024988791d4079888cc50db9c0b240'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:00:43.662941 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-d52f31a6-5d26-456f-aae6-365b0ac350f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e024988791d4079888cc50db9c0b240'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:00:43.688313 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-d52f31a6-5d26-456f-aae6-365b0ac350f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e024988791d4079888cc50db9c0b240'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:00:43.702797 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1287/2554] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 08:00:43 2022] DELETE /identity/v3/users/0e024988791d4079888cc50db9c0b240 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:00:43.982432 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ecece-c13e-4cda-9f66-6e1371b9c97f service neutron] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:43.993779 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ecece-c13e-4cda-9f66-6e1371b9c97f service neutron] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:44.082959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112a770-a14a-418b-b26e-22c939634319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:44.083740 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112a770-a14a-418b-b26e-22c939634319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:44.084052 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112a770-a14a-418b-b26e-22c939634319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:44.084407 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112a770-a14a-418b-b26e-22c939634319 admin admin] PATH_INFO: `/v3/projects/6cae0dfd8d2045f186a515e71a316f14` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:44.086049 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8112a770-a14a-418b-b26e-22c939634319 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cae0dfd8d2045f186a515e71a316f14)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:44.088892 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8112a770-a14a-418b-b26e-22c939634319 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:44.199101 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-8112a770-a14a-418b-b26e-22c939634319 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cae0dfd8d2045f186a515e71a316f14', 'request_id': 'req-8112a770-a14a-418b-b26e-22c939634319'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:00:44.201914 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:00:44.208553 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-8112a770-a14a-418b-b26e-22c939634319 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cae0dfd8d2045f186a515e71a316f14', 'request_id': 'req-8112a770-a14a-418b-b26e-22c939634319'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:00:44.301752 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-8112a770-a14a-418b-b26e-22c939634319 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cae0dfd8d2045f186a515e71a316f14', 'request_id': 'req-8112a770-a14a-418b-b26e-22c939634319'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:00:44.318726 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-8112a770-a14a-418b-b26e-22c939634319 admin admin] The token cache is being invalidate because project 6cae0dfd8d2045f186a515e71a316f14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:00:44.318726 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-8112a770-a14a-418b-b26e-22c939634319 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:00:44.319331 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-8112a770-a14a-418b-b26e-22c939634319 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:00:44.321600 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1268/2555] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 08:00:43 2022] DELETE /identity/v3/projects/6cae0dfd8d2045f186a515e71a316f14 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:00:44.328548 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c37bc-5dae-455d-8da3-d0de747b86fa None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:44.329070 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c37bc-5dae-455d-8da3-d0de747b86fa None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:44.329170 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c37bc-5dae-455d-8da3-d0de747b86fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:44.352042 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-295c37bc-5dae-455d-8da3-d0de747b86fa None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:00:44.353283 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-295c37bc-5dae-455d-8da3-d0de747b86fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:00:44.428097 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1288/2556] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:00:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:00:44.438533 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c176d7-55b7-428c-a172-bbc620f81c2c None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:44.438957 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c176d7-55b7-428c-a172-bbc620f81c2c None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:44.439388 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c176d7-55b7-428c-a172-bbc620f81c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:44.460219 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-71c176d7-55b7-428c-a172-bbc620f81c2c None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:00:44.461511 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-71c176d7-55b7-428c-a172-bbc620f81c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:00:44.471708 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1269/2557] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:00:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:00:44.477843 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c37bc-5dae-455d-8da3-d0de747b86fa None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:44.489140 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c37bc-5dae-455d-8da3-d0de747b86fa None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:44.494496 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38e052-6cc7-49d6-bed5-13e2c0fe5a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:44.495149 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38e052-6cc7-49d6-bed5-13e2c0fe5a7b admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:44.495423 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38e052-6cc7-49d6-bed5-13e2c0fe5a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:44.495752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38e052-6cc7-49d6-bed5-13e2c0fe5a7b admin admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:44.496408 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a38e052-6cc7-49d6-bed5-13e2c0fe5a7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:00:44.496807 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a38e052-6cc7-49d6-bed5-13e2c0fe5a7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:44.498649 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a38e052-6cc7-49d6-bed5-13e2c0fe5a7b admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:44.513215 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1289/2558] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 08:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:00:44.518137 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c176d7-55b7-428c-a172-bbc620f81c2c None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:44.532274 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c176d7-55b7-428c-a172-bbc620f81c2c None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:44.544103 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f828ff-4e56-4d51-8822-ae65b8c4427e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:44.544744 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f828ff-4e56-4d51-8822-ae65b8c4427e admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:44.545023 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f828ff-4e56-4d51-8822-ae65b8c4427e admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:44.545296 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f828ff-4e56-4d51-8822-ae65b8c4427e admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:44.545943 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f828ff-4e56-4d51-8822-ae65b8c4427e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:44.549830 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f828ff-4e56-4d51-8822-ae65b8c4427e admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:44.669174 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1270/2559] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 08:00:44 2022] POST /identity/v3/projects => generated 365 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:00:44.673593 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38e052-6cc7-49d6-bed5-13e2c0fe5a7b admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:44.685505 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38e052-6cc7-49d6-bed5-13e2c0fe5a7b admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:44.755828 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03b273-c944-4a85-aba6-1be914e91b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:44.756458 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03b273-c944-4a85-aba6-1be914e91b64 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:44.756842 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03b273-c944-4a85-aba6-1be914e91b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:44.757428 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03b273-c944-4a85-aba6-1be914e91b64 admin admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:44.758268 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03b273-c944-4a85-aba6-1be914e91b64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:44.762778 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03b273-c944-4a85-aba6-1be914e91b64 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:44.771100 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:00:44.879179 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1290/2560] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 08:00:44 2022] POST /identity/v3/users => generated 283 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:00:44.883820 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f828ff-4e56-4d51-8822-ae65b8c4427e admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:44.895499 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f828ff-4e56-4d51-8822-ae65b8c4427e admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:44.900968 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc9b246-8cea-4d39-9d81-76dca399a352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:44.901566 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9b246-8cea-4d39-9d81-76dca399a352 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:44.901852 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9b246-8cea-4d39-9d81-76dca399a352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:44.902132 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9b246-8cea-4d39-9d81-76dca399a352 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:44.902781 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc9b246-8cea-4d39-9d81-76dca399a352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:44.904580 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc9b246-8cea-4d39-9d81-76dca399a352 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:44.915468 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1271/2561] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:00:44.919846 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03b273-c944-4a85-aba6-1be914e91b64 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:44.930753 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03b273-c944-4a85-aba6-1be914e91b64 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:44.940301 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88bd4a-ca74-45b8-9e78-fcc8786fd3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:44.940935 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88bd4a-ca74-45b8-9e78-fcc8786fd3f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:44.941210 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88bd4a-ca74-45b8-9e78-fcc8786fd3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:44.941479 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88bd4a-ca74-45b8-9e78-fcc8786fd3f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:44.942127 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d88bd4a-ca74-45b8-9e78-fcc8786fd3f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:44.943902 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d88bd4a-ca74-45b8-9e78-fcc8786fd3f8 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:44.956377 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1291/2562] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:00:44.960918 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc9b246-8cea-4d39-9d81-76dca399a352 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:44.972320 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc9b246-8cea-4d39-9d81-76dca399a352 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:44.977119 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5661864-5ae6-439d-856d-78af823b8812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:44.977781 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5661864-5ae6-439d-856d-78af823b8812 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:44.978061 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5661864-5ae6-439d-856d-78af823b8812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:44.978334 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5661864-5ae6-439d-856d-78af823b8812 admin admin] PATH_INFO: `/v3/projects/95f82cc1b02544e9a7d4ee4f70291cf9/users/14a8bbb5573a4a57a1ee6aa1ded95e58/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:44.999138 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5661864-5ae6-439d-856d-78af823b8812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95f82cc1b02544e9a7d4ee4f70291cf9, user_id=14a8bbb5573a4a57a1ee6aa1ded95e58, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:45.001821 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5661864-5ae6-439d-856d-78af823b8812 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:45.087392 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1272/2563] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 08:00:44 2022] PUT /identity/v3/projects/95f82cc1b02544e9a7d4ee4f70291cf9/users/14a8bbb5573a4a57a1ee6aa1ded95e58/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:00:45.100734 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b1df8-c7e8-4b63-947c-28b231ad04bb None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:45.101025 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b1df8-c7e8-4b63-947c-28b231ad04bb None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:45.101296 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b1df8-c7e8-4b63-947c-28b231ad04bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:45.133030 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-ec3b1df8-c7e8-4b63-947c-28b231ad04bb None None] MFA Rules not processed for user `14a8bbb5573a4a57a1ee6aa1ded95e58`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:00:45.134268 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-ec3b1df8-c7e8-4b63-947c-28b231ad04bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:00:45.209342 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1292/2564] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:00:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:00:45.214318 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5661864-5ae6-439d-856d-78af823b8812 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:45.294193 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5661864-5ae6-439d-856d-78af823b8812 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:45.299181 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3249b2-0bad-4fc9-b746-76f9a8beafe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:45.299801 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3249b2-0bad-4fc9-b746-76f9a8beafe8 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:45.300079 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3249b2-0bad-4fc9-b746-76f9a8beafe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:45.300347 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3249b2-0bad-4fc9-b746-76f9a8beafe8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:45.300988 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3249b2-0bad-4fc9-b746-76f9a8beafe8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:45.303032 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3249b2-0bad-4fc9-b746-76f9a8beafe8 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:45.425157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1273/2565] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 08:00:45 2022] POST /identity/v3/projects => generated 365 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:00:45.429248 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b1df8-c7e8-4b63-947c-28b231ad04bb None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:45.443867 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b1df8-c7e8-4b63-947c-28b231ad04bb None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:45.507983 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac3b73-c9a3-4a7f-9455-0f8f30099599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:45.508477 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac3b73-c9a3-4a7f-9455-0f8f30099599 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:45.508822 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac3b73-c9a3-4a7f-9455-0f8f30099599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:45.509100 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac3b73-c9a3-4a7f-9455-0f8f30099599 admin admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:45.509748 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac3b73-c9a3-4a7f-9455-0f8f30099599 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:45.511713 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac3b73-c9a3-4a7f-9455-0f8f30099599 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:45.628036 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1293/2566] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 08:00:45 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:00:45.633557 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3249b2-0bad-4fc9-b746-76f9a8beafe8 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:45.646559 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3249b2-0bad-4fc9-b746-76f9a8beafe8 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:45.652546 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5cd26-bb35-4ef9-8781-8df23d7c135d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:45.653291 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5cd26-bb35-4ef9-8781-8df23d7c135d admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:45.653642 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5cd26-bb35-4ef9-8781-8df23d7c135d admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:45.654585 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5cd26-bb35-4ef9-8781-8df23d7c135d admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:45.654752 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5cd26-bb35-4ef9-8781-8df23d7c135d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:45.656469 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5cd26-bb35-4ef9-8781-8df23d7c135d admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:45.670543 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1274/2567] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:00:45.681321 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac3b73-c9a3-4a7f-9455-0f8f30099599 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:45.694266 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac3b73-c9a3-4a7f-9455-0f8f30099599 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:45.699702 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dcc32e-9cfb-4250-a23e-76c22b51f9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:45.700440 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dcc32e-9cfb-4250-a23e-76c22b51f9a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:45.700762 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dcc32e-9cfb-4250-a23e-76c22b51f9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:45.701034 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dcc32e-9cfb-4250-a23e-76c22b51f9a5 admin admin] PATH_INFO: `/v3/projects/314c4123e1b842fa94ee72e208ba172a/users/016ba4b12cb84f68ad06053cf4295bbb/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:45.723816 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dcc32e-9cfb-4250-a23e-76c22b51f9a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=314c4123e1b842fa94ee72e208ba172a, user_id=016ba4b12cb84f68ad06053cf4295bbb, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:45.726498 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dcc32e-9cfb-4250-a23e-76c22b51f9a5 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:45.851004 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1294/2568] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 08:00:45 2022] PUT /identity/v3/projects/314c4123e1b842fa94ee72e208ba172a/users/016ba4b12cb84f68ad06053cf4295bbb/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:00:45.856106 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5cd26-bb35-4ef9-8781-8df23d7c135d admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:45.868750 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5cd26-bb35-4ef9-8781-8df23d7c135d admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:45.925077 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:00:45.936383 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9fe53f-91f0-4776-bfee-7f758b5426d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:45.937075 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fe53f-91f0-4776-bfee-7f758b5426d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:45.937358 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fe53f-91f0-4776-bfee-7f758b5426d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:45.937629 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fe53f-91f0-4776-bfee-7f758b5426d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:45.938280 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9fe53f-91f0-4776-bfee-7f758b5426d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:45.940016 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9fe53f-91f0-4776-bfee-7f758b5426d4 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:45.953261 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1275/2569] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:00:45.957681 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dcc32e-9cfb-4250-a23e-76c22b51f9a5 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:45.971532 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dcc32e-9cfb-4250-a23e-76c22b51f9a5 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:45.977097 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba35b9ff-37c3-4193-a41b-5a86ce1729af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:45.977779 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35b9ff-37c3-4193-a41b-5a86ce1729af admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:45.978058 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35b9ff-37c3-4193-a41b-5a86ce1729af admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:45.978334 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35b9ff-37c3-4193-a41b-5a86ce1729af admin admin] PATH_INFO: `/v3/projects/314c4123e1b842fa94ee72e208ba172a/users/016ba4b12cb84f68ad06053cf4295bbb/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:45.980477 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba35b9ff-37c3-4193-a41b-5a86ce1729af admin admin] RBAC: Authorizing `identity:create_grant(project_id=314c4123e1b842fa94ee72e208ba172a, user_id=016ba4b12cb84f68ad06053cf4295bbb, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:45.983227 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba35b9ff-37c3-4193-a41b-5a86ce1729af admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:45.998242 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1295/2570] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 08:00:45 2022] PUT /identity/v3/projects/314c4123e1b842fa94ee72e208ba172a/users/016ba4b12cb84f68ad06053cf4295bbb/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:00:46.009002 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b9187-37bc-400c-b0b3-d598b305ec62 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:46.009536 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b9187-37bc-400c-b0b3-d598b305ec62 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:46.009666 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b9187-37bc-400c-b0b3-d598b305ec62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:46.041643 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-a34b9187-37bc-400c-b0b3-d598b305ec62 None None] MFA Rules not processed for user `016ba4b12cb84f68ad06053cf4295bbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:00:46.042785 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-a34b9187-37bc-400c-b0b3-d598b305ec62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:00:46.126189 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1276/2571] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:00:46 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:00:46.141134 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba35b9ff-37c3-4193-a41b-5a86ce1729af admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:46.143069 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-ba35b9ff-37c3-4193-a41b-5a86ce1729af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:00:46.168215 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:00:46.206190 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba35b9ff-37c3-4193-a41b-5a86ce1729af admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:46.210184 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f1387-9e6b-447b-b948-9695533c0c6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:46.210796 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f1387-9e6b-447b-b948-9695533c0c6e service cinder] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:46.211104 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f1387-9e6b-447b-b948-9695533c0c6e service cinder] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:46.211378 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f1387-9e6b-447b-b948-9695533c0c6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:46.222720 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07f1387-9e6b-447b-b948-9695533c0c6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:46.224962 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07f1387-9e6b-447b-b948-9695533c0c6e service cinder] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:46.240484 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1296/2572] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:00:46 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:00:46.478287 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b9187-37bc-400c-b0b3-d598b305ec62 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:00:46.489419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b9187-37bc-400c-b0b3-d598b305ec62 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:00:46.493381 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db6842-24eb-4a2d-a0f5-8cdc37888ed7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:00:46.494001 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db6842-24eb-4a2d-a0f5-8cdc37888ed7 service cinder] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:00:46.494285 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db6842-24eb-4a2d-a0f5-8cdc37888ed7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:00:46.495689 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db6842-24eb-4a2d-a0f5-8cdc37888ed7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:00:46.591443 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db6842-24eb-4a2d-a0f5-8cdc37888ed7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:00:46.593925 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db6842-24eb-4a2d-a0f5-8cdc37888ed7 service cinder] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:00:46.611322 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1277/2573] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:00:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 08:00:56.270506 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=17 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:00:56.602343 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=68 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:01.113545 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f1387-9e6b-447b-b948-9695533c0c6e service cinder] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:01.115030 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-d07f1387-9e6b-447b-b948-9695533c0c6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:01.207906 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f1387-9e6b-447b-b948-9695533c0c6e service cinder] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:01.217522 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efcff4c-c56f-4407-beaf-688a255ce7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:01.220530 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efcff4c-c56f-4407-beaf-688a255ce7ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:01.220530 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efcff4c-c56f-4407-beaf-688a255ce7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:01.220530 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efcff4c-c56f-4407-beaf-688a255ce7ac admin admin] PATH_INFO: `/v3/users/24da442c7f15437d9616063001323749` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:01.220530 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efcff4c-c56f-4407-beaf-688a255ce7ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=24da442c7f15437d9616063001323749)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:01.222568 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efcff4c-c56f-4407-beaf-688a255ce7ac admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:01.502703 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-8efcff4c-c56f-4407-beaf-688a255ce7ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24da442c7f15437d9616063001323749'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:01.512497 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-8efcff4c-c56f-4407-beaf-688a255ce7ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24da442c7f15437d9616063001323749'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:01.610323 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-8efcff4c-c56f-4407-beaf-688a255ce7ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24da442c7f15437d9616063001323749'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:01.610977 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-8efcff4c-c56f-4407-beaf-688a255ce7ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24da442c7f15437d9616063001323749'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:01.625486 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-8efcff4c-c56f-4407-beaf-688a255ce7ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24da442c7f15437d9616063001323749'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:01.631900 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1297/2574] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 08:01:01 2022] DELETE /identity/v3/users/24da442c7f15437d9616063001323749 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:01:01.637399 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb507b1-f4ed-466f-ac28-e865da43a900 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:01.637934 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb507b1-f4ed-466f-ac28-e865da43a900 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:01.637934 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb507b1-f4ed-466f-ac28-e865da43a900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:01.665881 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-3bb507b1-f4ed-466f-ac28-e865da43a900 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:01:01.665881 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-3bb507b1-f4ed-466f-ac28-e865da43a900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:01.747445 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1278/2575] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:01:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:01:01.758846 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efcff4c-c56f-4407-beaf-688a255ce7ac admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:01.761660 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-8efcff4c-c56f-4407-beaf-688a255ce7ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:01.835536 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efcff4c-c56f-4407-beaf-688a255ce7ac admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:01.840515 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ade0b1-2575-4d2f-a12d-ce28d5bc74a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:01.841148 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ade0b1-2575-4d2f-a12d-ce28d5bc74a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:01.841433 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ade0b1-2575-4d2f-a12d-ce28d5bc74a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:01.841709 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ade0b1-2575-4d2f-a12d-ce28d5bc74a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:01.863758 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ade0b1-2575-4d2f-a12d-ce28d5bc74a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:01.865262 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ade0b1-2575-4d2f-a12d-ce28d5bc74a2 service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:01.876902 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1298/2576] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:01:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:01:02.440368 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb507b1-f4ed-466f-ac28-e865da43a900 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:02.442508 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-3bb507b1-f4ed-466f-ac28-e865da43a900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:02.460024 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb507b1-f4ed-466f-ac28-e865da43a900 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:02.466258 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87124f3-ab47-4109-a7be-4b673d0c557e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:02.466849 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87124f3-ab47-4109-a7be-4b673d0c557e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:02.467155 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87124f3-ab47-4109-a7be-4b673d0c557e admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:02.467436 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87124f3-ab47-4109-a7be-4b673d0c557e admin admin] PATH_INFO: `/v3/projects/1c52f26471654b6c9f4f8e6b26d9b57d` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:02.468634 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87124f3-ab47-4109-a7be-4b673d0c557e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c52f26471654b6c9f4f8e6b26d9b57d)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:02.470579 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87124f3-ab47-4109-a7be-4b673d0c557e admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:02.629012 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-c87124f3-ab47-4109-a7be-4b673d0c557e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c52f26471654b6c9f4f8e6b26d9b57d', 'request_id': 'req-c87124f3-ab47-4109-a7be-4b673d0c557e'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:02.635326 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-c87124f3-ab47-4109-a7be-4b673d0c557e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c52f26471654b6c9f4f8e6b26d9b57d', 'request_id': 'req-c87124f3-ab47-4109-a7be-4b673d0c557e'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:02.710666 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-c87124f3-ab47-4109-a7be-4b673d0c557e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c52f26471654b6c9f4f8e6b26d9b57d', 'request_id': 'req-c87124f3-ab47-4109-a7be-4b673d0c557e'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:02.723324 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-c87124f3-ab47-4109-a7be-4b673d0c557e admin admin] The token cache is being invalidate because project 1c52f26471654b6c9f4f8e6b26d9b57d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:01:02.723616 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-c87124f3-ab47-4109-a7be-4b673d0c557e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:02.724296 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-c87124f3-ab47-4109-a7be-4b673d0c557e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:02.725834 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1279/2577] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 08:01:02 2022] DELETE /identity/v3/projects/1c52f26471654b6c9f4f8e6b26d9b57d => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:01:02.730133 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ade0b1-2575-4d2f-a12d-ce28d5bc74a2 service neutron] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:02.740257 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ade0b1-2575-4d2f-a12d-ce28d5bc74a2 service neutron] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:02.761101 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:02.805303 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c682f-f0e7-4b6e-b780-082d1a20e3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:02.805946 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c682f-f0e7-4b6e-b780-082d1a20e3a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:02.806882 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c682f-f0e7-4b6e-b780-082d1a20e3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:02.807801 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c682f-f0e7-4b6e-b780-082d1a20e3a2 admin admin] PATH_INFO: `/v3/users/774100c078de401d9a97a41025d3b7ce` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:02.809028 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c682f-f0e7-4b6e-b780-082d1a20e3a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=774100c078de401d9a97a41025d3b7ce)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:02.811005 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c682f-f0e7-4b6e-b780-082d1a20e3a2 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:03.025519 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-3d7c682f-f0e7-4b6e-b780-082d1a20e3a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '774100c078de401d9a97a41025d3b7ce'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:03.038594 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-3d7c682f-f0e7-4b6e-b780-082d1a20e3a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '774100c078de401d9a97a41025d3b7ce'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:03.152531 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-3d7c682f-f0e7-4b6e-b780-082d1a20e3a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '774100c078de401d9a97a41025d3b7ce'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:03.153424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-3d7c682f-f0e7-4b6e-b780-082d1a20e3a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '774100c078de401d9a97a41025d3b7ce'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:03.170513 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-3d7c682f-f0e7-4b6e-b780-082d1a20e3a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '774100c078de401d9a97a41025d3b7ce'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:03.177093 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1299/2578] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 08:01:02 2022] DELETE /identity/v3/users/774100c078de401d9a97a41025d3b7ce => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:01:03.662974 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87124f3-ab47-4109-a7be-4b673d0c557e admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:03.665341 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-c87124f3-ab47-4109-a7be-4b673d0c557e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:03.682507 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87124f3-ab47-4109-a7be-4b673d0c557e admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:03.774604 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e2d36-02f2-4298-9d9f-62ca11f2d528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:03.776545 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e2d36-02f2-4298-9d9f-62ca11f2d528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:03.776999 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e2d36-02f2-4298-9d9f-62ca11f2d528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:03.777380 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e2d36-02f2-4298-9d9f-62ca11f2d528 admin admin] PATH_INFO: `/v3/projects/42522b07eb9641a4a43e45fcc5ed21de` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:03.779389 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e2d36-02f2-4298-9d9f-62ca11f2d528 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42522b07eb9641a4a43e45fcc5ed21de)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:03.783200 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e2d36-02f2-4298-9d9f-62ca11f2d528 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:03.920821 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:03.938711 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-e10e2d36-02f2-4298-9d9f-62ca11f2d528 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42522b07eb9641a4a43e45fcc5ed21de', 'request_id': 'req-e10e2d36-02f2-4298-9d9f-62ca11f2d528'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:03.944395 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-e10e2d36-02f2-4298-9d9f-62ca11f2d528 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42522b07eb9641a4a43e45fcc5ed21de', 'request_id': 'req-e10e2d36-02f2-4298-9d9f-62ca11f2d528'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:03.983577 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c682f-f0e7-4b6e-b780-082d1a20e3a2 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:03.985123 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-3d7c682f-f0e7-4b6e-b780-082d1a20e3a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:03.998209 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c682f-f0e7-4b6e-b780-082d1a20e3a2 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:04.064838 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-e10e2d36-02f2-4298-9d9f-62ca11f2d528 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42522b07eb9641a4a43e45fcc5ed21de', 'request_id': 'req-e10e2d36-02f2-4298-9d9f-62ca11f2d528'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:04.072757 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f477a3e5-1d97-4980-901d-25398f7b60f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:04.073674 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477a3e5-1d97-4980-901d-25398f7b60f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:04.073959 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477a3e5-1d97-4980-901d-25398f7b60f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:04.074451 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477a3e5-1d97-4980-901d-25398f7b60f0 admin admin] PATH_INFO: `/v3/users/14a8bbb5573a4a57a1ee6aa1ded95e58` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:04.076326 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f477a3e5-1d97-4980-901d-25398f7b60f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14a8bbb5573a4a57a1ee6aa1ded95e58)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:04.083230 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-e10e2d36-02f2-4298-9d9f-62ca11f2d528 admin admin] The token cache is being invalidate because project 42522b07eb9641a4a43e45fcc5ed21de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:01:04.083230 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-e10e2d36-02f2-4298-9d9f-62ca11f2d528 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:04.083230 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-e10e2d36-02f2-4298-9d9f-62ca11f2d528 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:04.083670 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f477a3e5-1d97-4980-901d-25398f7b60f0 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:04.083838 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1280/2579] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 08:01:03 2022] DELETE /identity/v3/projects/42522b07eb9641a4a43e45fcc5ed21de => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:01:04.086046 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e928003-de5a-4d95-b9b2-e4e2807b8273 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:04.086334 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e928003-de5a-4d95-b9b2-e4e2807b8273 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:04.086621 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e928003-de5a-4d95-b9b2-e4e2807b8273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:04.108924 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-8e928003-de5a-4d95-b9b2-e4e2807b8273 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:01:04.111889 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-8e928003-de5a-4d95-b9b2-e4e2807b8273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:04.119644 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1281/2580] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:01:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:01:04.127674 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e415d-a23d-4ea2-9e3b-9bf5f7c9e8dd None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:04.127961 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e415d-a23d-4ea2-9e3b-9bf5f7c9e8dd None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:04.128243 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e415d-a23d-4ea2-9e3b-9bf5f7c9e8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:04.149208 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-0e9e415d-a23d-4ea2-9e3b-9bf5f7c9e8dd None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:01:04.150580 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-0e9e415d-a23d-4ea2-9e3b-9bf5f7c9e8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:04.158603 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1282/2581] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:01:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:01:04.163824 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e415d-a23d-4ea2-9e3b-9bf5f7c9e8dd None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:04.173681 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e415d-a23d-4ea2-9e3b-9bf5f7c9e8dd None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:04.180816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f0fac-32a5-4548-aaa2-6f9908c21e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:04.180816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f0fac-32a5-4548-aaa2-6f9908c21e24 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:04.180816 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f0fac-32a5-4548-aaa2-6f9908c21e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:04.181927 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f0fac-32a5-4548-aaa2-6f9908c21e24 admin admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:04.183924 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f0fac-32a5-4548-aaa2-6f9908c21e24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:01:04.184467 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f0fac-32a5-4548-aaa2-6f9908c21e24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:04.186327 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f0fac-32a5-4548-aaa2-6f9908c21e24 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:04.202731 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1283/2582] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 08:01:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:01:04.207484 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f0fac-32a5-4548-aaa2-6f9908c21e24 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:04.218426 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f0fac-32a5-4548-aaa2-6f9908c21e24 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:04.223186 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920bace-4084-4bf8-b7c7-eb99cf17cce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:04.223801 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920bace-4084-4bf8-b7c7-eb99cf17cce1 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:04.224081 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920bace-4084-4bf8-b7c7-eb99cf17cce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:04.224354 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920bace-4084-4bf8-b7c7-eb99cf17cce1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:04.224980 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f920bace-4084-4bf8-b7c7-eb99cf17cce1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:04.226910 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f920bace-4084-4bf8-b7c7-eb99cf17cce1 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:04.440247 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1284/2583] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 08:01:04 2022] POST /identity/v3/projects => generated 387 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:01:04.448258 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920bace-4084-4bf8-b7c7-eb99cf17cce1 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:04.523307 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920bace-4084-4bf8-b7c7-eb99cf17cce1 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:04.531042 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b15209-146d-44a2-aa64-29f358498c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:04.532076 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b15209-146d-44a2-aa64-29f358498c40 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:04.532552 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b15209-146d-44a2-aa64-29f358498c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:04.533779 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b15209-146d-44a2-aa64-29f358498c40 admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:04.534166 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b15209-146d-44a2-aa64-29f358498c40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:04.537921 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b15209-146d-44a2-aa64-29f358498c40 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:04.626861 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:04.629452 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-f477a3e5-1d97-4980-901d-25398f7b60f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14a8bbb5573a4a57a1ee6aa1ded95e58'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:04.637077 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-f477a3e5-1d97-4980-901d-25398f7b60f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14a8bbb5573a4a57a1ee6aa1ded95e58'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:04.773862 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1285/2584] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 08:01:04 2022] POST /identity/v3/users => generated 294 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:01:04.782072 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b15209-146d-44a2-aa64-29f358498c40 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:04.792924 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b15209-146d-44a2-aa64-29f358498c40 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:04.797738 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c0f6f-6fe6-407a-99ca-296681d4e459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:04.798352 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c0f6f-6fe6-407a-99ca-296681d4e459 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:04.798631 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c0f6f-6fe6-407a-99ca-296681d4e459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:04.798906 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c0f6f-6fe6-407a-99ca-296681d4e459 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:04.799607 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0c0f6f-6fe6-407a-99ca-296681d4e459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:04.801251 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0c0f6f-6fe6-407a-99ca-296681d4e459 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:04.809184 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-f477a3e5-1d97-4980-901d-25398f7b60f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14a8bbb5573a4a57a1ee6aa1ded95e58'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:04.810394 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-f477a3e5-1d97-4980-901d-25398f7b60f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14a8bbb5573a4a57a1ee6aa1ded95e58'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:04.817344 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1286/2585] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:01:04.827362 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-f477a3e5-1d97-4980-901d-25398f7b60f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14a8bbb5573a4a57a1ee6aa1ded95e58'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:04.828018 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c0f6f-6fe6-407a-99ca-296681d4e459 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:04.829937 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-ca0c0f6f-6fe6-407a-99ca-296681d4e459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:04.834968 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1300/2586] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 08:01:03 2022] DELETE /identity/v3/users/14a8bbb5573a4a57a1ee6aa1ded95e58 => generated 0 bytes in 852 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:01:04.841136 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb6d84-d73c-4255-aeab-65c17fcba4a2 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:04.841136 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb6d84-d73c-4255-aeab-65c17fcba4a2 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:04.841136 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb6d84-d73c-4255-aeab-65c17fcba4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:04.847861 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c0f6f-6fe6-407a-99ca-296681d4e459 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:04.868341 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-ffbb6d84-d73c-4255-aeab-65c17fcba4a2 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:01:04.871342 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-ffbb6d84-d73c-4255-aeab-65c17fcba4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:04.916981 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:04.953123 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1301/2587] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:01:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:01:04.953619 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c4af2-cf29-46ce-92fb-8048cd9c023f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:04.954968 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c4af2-cf29-46ce-92fb-8048cd9c023f admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:04.955457 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c4af2-cf29-46ce-92fb-8048cd9c023f admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:04.955922 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c4af2-cf29-46ce-92fb-8048cd9c023f admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:04.957363 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c4af2-cf29-46ce-92fb-8048cd9c023f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:04.960130 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c4af2-cf29-46ce-92fb-8048cd9c023f admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:04.966110 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb6d84-d73c-4255-aeab-65c17fcba4a2 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:04.968643 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-ffbb6d84-d73c-4255-aeab-65c17fcba4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:04.988176 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1287/2588] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:01:04.989298 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c4af2-cf29-46ce-92fb-8048cd9c023f admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:05.000878 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c4af2-cf29-46ce-92fb-8048cd9c023f admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:05.006248 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b617d-750c-4db4-ab06-fb0655364082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:05.007559 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b617d-750c-4db4-ab06-fb0655364082 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:05.007993 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b617d-750c-4db4-ab06-fb0655364082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:05.008620 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b617d-750c-4db4-ab06-fb0655364082 admin admin] PATH_INFO: `/v3/projects/cd9def02c5b745bca10023947a905881/users/1c93fde3ad1340aeae5fc3a9618c7979/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:05.028275 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5b617d-750c-4db4-ab06-fb0655364082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd9def02c5b745bca10023947a905881, user_id=1c93fde3ad1340aeae5fc3a9618c7979, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:05.031047 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5b617d-750c-4db4-ab06-fb0655364082 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:05.037867 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb6d84-d73c-4255-aeab-65c17fcba4a2 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:05.042383 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690527d5-4ac2-4be1-954c-dc3fc506bb12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:05.044704 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690527d5-4ac2-4be1-954c-dc3fc506bb12 service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:05.044704 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690527d5-4ac2-4be1-954c-dc3fc506bb12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:05.044704 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690527d5-4ac2-4be1-954c-dc3fc506bb12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:05.053405 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690527d5-4ac2-4be1-954c-dc3fc506bb12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:05.054951 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690527d5-4ac2-4be1-954c-dc3fc506bb12 service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:05.065813 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1302/2589] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:01:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 08:01:05.102712 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1288/2590] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 08:01:04 2022] PUT /identity/v3/projects/cd9def02c5b745bca10023947a905881/users/1c93fde3ad1340aeae5fc3a9618c7979/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:01:05.115324 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23568d29-8f5d-4f10-b4c6-a9a3fecdc09b None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:05.115699 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23568d29-8f5d-4f10-b4c6-a9a3fecdc09b None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:05.116054 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23568d29-8f5d-4f10-b4c6-a9a3fecdc09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:05.152385 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-23568d29-8f5d-4f10-b4c6-a9a3fecdc09b None None] MFA Rules not processed for user `1c93fde3ad1340aeae5fc3a9618c7979`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:01:05.153831 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-23568d29-8f5d-4f10-b4c6-a9a3fecdc09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:05.231278 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:05.244248 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1303/2591] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:01:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:01:05.249190 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b617d-750c-4db4-ab06-fb0655364082 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:05.350255 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b617d-750c-4db4-ab06-fb0655364082 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:05.356487 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3eab9-6779-4af5-a77b-cce210b03615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:05.357282 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3eab9-6779-4af5-a77b-cce210b03615 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:05.357573 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3eab9-6779-4af5-a77b-cce210b03615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:05.357850 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3eab9-6779-4af5-a77b-cce210b03615 admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:05.358589 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff3eab9-6779-4af5-a77b-cce210b03615 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:05.360648 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff3eab9-6779-4af5-a77b-cce210b03615 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:05.470919 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1289/2592] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 08:01:05 2022] POST /identity/v3/projects => generated 387 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:01:05.475985 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23568d29-8f5d-4f10-b4c6-a9a3fecdc09b None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:05.490297 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23568d29-8f5d-4f10-b4c6-a9a3fecdc09b None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:05.565858 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e40d4cc-e960-4285-bc2f-01cea4268fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:05.566468 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40d4cc-e960-4285-bc2f-01cea4268fe2 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:05.566774 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40d4cc-e960-4285-bc2f-01cea4268fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:05.567073 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40d4cc-e960-4285-bc2f-01cea4268fe2 admin admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:05.567700 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e40d4cc-e960-4285-bc2f-01cea4268fe2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:05.569618 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e40d4cc-e960-4285-bc2f-01cea4268fe2 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:05.581557 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3eab9-6779-4af5-a77b-cce210b03615 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:05.584082 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-2ff3eab9-6779-4af5-a77b-cce210b03615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:05.598650 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3eab9-6779-4af5-a77b-cce210b03615 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:05.603592 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da61db2-f3d9-4211-8fe9-1c00681a3f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:05.604237 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da61db2-f3d9-4211-8fe9-1c00681a3f0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:05.604523 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da61db2-f3d9-4211-8fe9-1c00681a3f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:05.604815 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da61db2-f3d9-4211-8fe9-1c00681a3f0d admin admin] PATH_INFO: `/v3/projects/95f82cc1b02544e9a7d4ee4f70291cf9` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:05.606013 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da61db2-f3d9-4211-8fe9-1c00681a3f0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=95f82cc1b02544e9a7d4ee4f70291cf9)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:05.608175 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da61db2-f3d9-4211-8fe9-1c00681a3f0d admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:05.696064 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1304/2593] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 08:01:05 2022] POST /identity/v3/users => generated 300 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:01:05.701462 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e40d4cc-e960-4285-bc2f-01cea4268fe2 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:05.712984 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e40d4cc-e960-4285-bc2f-01cea4268fe2 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:05.718763 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14653ac2-b734-47b5-be4c-9ef438ead142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:05.719561 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14653ac2-b734-47b5-be4c-9ef438ead142 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:05.719907 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14653ac2-b734-47b5-be4c-9ef438ead142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:05.720187 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14653ac2-b734-47b5-be4c-9ef438ead142 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:05.720993 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14653ac2-b734-47b5-be4c-9ef438ead142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:05.722596 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14653ac2-b734-47b5-be4c-9ef438ead142 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:05.733679 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1305/2594] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 08:01:05.739954 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14653ac2-b734-47b5-be4c-9ef438ead142 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:05.750447 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14653ac2-b734-47b5-be4c-9ef438ead142 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:05.755114 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3bd9fa-1a3a-4d6f-8489-34b737714c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:05.755754 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3bd9fa-1a3a-4d6f-8489-34b737714c37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:05.756108 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3bd9fa-1a3a-4d6f-8489-34b737714c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:05.756382 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3bd9fa-1a3a-4d6f-8489-34b737714c37 admin admin] PATH_INFO: `/v3/projects/cb57d5c40a574d0f96af0b182a29cd9c/users/23caeddaddb34af59f123550a9db5954/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:05.772761 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3bd9fa-1a3a-4d6f-8489-34b737714c37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb57d5c40a574d0f96af0b182a29cd9c, user_id=23caeddaddb34af59f123550a9db5954, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:05.775470 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3bd9fa-1a3a-4d6f-8489-34b737714c37 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:05.867280 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1306/2595] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 08:01:05 2022] PUT /identity/v3/projects/cb57d5c40a574d0f96af0b182a29cd9c/users/23caeddaddb34af59f123550a9db5954/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:01:05.873096 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3bd9fa-1a3a-4d6f-8489-34b737714c37 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:05.876966 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-7da61db2-f3d9-4211-8fe9-1c00681a3f0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95f82cc1b02544e9a7d4ee4f70291cf9', 'request_id': 'req-7da61db2-f3d9-4211-8fe9-1c00681a3f0d'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:05.883288 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-7da61db2-f3d9-4211-8fe9-1c00681a3f0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95f82cc1b02544e9a7d4ee4f70291cf9', 'request_id': 'req-7da61db2-f3d9-4211-8fe9-1c00681a3f0d'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:05.950161 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3bd9fa-1a3a-4d6f-8489-34b737714c37 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:05.969722 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-7da61db2-f3d9-4211-8fe9-1c00681a3f0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95f82cc1b02544e9a7d4ee4f70291cf9', 'request_id': 'req-7da61db2-f3d9-4211-8fe9-1c00681a3f0d'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:05.984404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-7da61db2-f3d9-4211-8fe9-1c00681a3f0d admin admin] The token cache is being invalidate because project 95f82cc1b02544e9a7d4ee4f70291cf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:01:05.984655 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-7da61db2-f3d9-4211-8fe9-1c00681a3f0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:05.985335 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-7da61db2-f3d9-4211-8fe9-1c00681a3f0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:05.986856 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1290/2596] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 08:01:05 2022] DELETE /identity/v3/projects/95f82cc1b02544e9a7d4ee4f70291cf9 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:01:05.991756 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da61db2-f3d9-4211-8fe9-1c00681a3f0d admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:05.993157 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-7da61db2-f3d9-4211-8fe9-1c00681a3f0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:06.018074 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:06.022426 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:06.025970 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a2fc7-d471-4f59-b377-b81e573aab4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:06.026630 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a2fc7-d471-4f59-b377-b81e573aab4c admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:06.026912 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a2fc7-d471-4f59-b377-b81e573aab4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:06.027263 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a2fc7-d471-4f59-b377-b81e573aab4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:06.027924 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a2fc7-d471-4f59-b377-b81e573aab4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:06.029664 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a2fc7-d471-4f59-b377-b81e573aab4c admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:06.045116 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1307/2597] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:01:06.049967 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a2fc7-d471-4f59-b377-b81e573aab4c admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:06.049967 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-827a2fc7-d471-4f59-b377-b81e573aab4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:06.061699 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a2fc7-d471-4f59-b377-b81e573aab4c admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:06.066621 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60993781-dfa5-4449-860b-675619db2e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:06.067332 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60993781-dfa5-4449-860b-675619db2e1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:06.067672 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60993781-dfa5-4449-860b-675619db2e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:06.067894 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60993781-dfa5-4449-860b-675619db2e1f admin admin] PATH_INFO: `/v3/projects/cb57d5c40a574d0f96af0b182a29cd9c/users/23caeddaddb34af59f123550a9db5954/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:06.069874 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60993781-dfa5-4449-860b-675619db2e1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb57d5c40a574d0f96af0b182a29cd9c, user_id=23caeddaddb34af59f123550a9db5954, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:06.070786 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da61db2-f3d9-4211-8fe9-1c00681a3f0d admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:06.073357 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60993781-dfa5-4449-860b-675619db2e1f admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:06.081879 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25067d3c-f730-49f8-bd11-e9b5c7a0c37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:06.083058 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25067d3c-f730-49f8-bd11-e9b5c7a0c37a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:06.083525 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25067d3c-f730-49f8-bd11-e9b5c7a0c37a admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:06.083958 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25067d3c-f730-49f8-bd11-e9b5c7a0c37a admin admin] PATH_INFO: `/v3/users/016ba4b12cb84f68ad06053cf4295bbb` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:06.084611 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1308/2598] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 08:01:06 2022] PUT /identity/v3/projects/cb57d5c40a574d0f96af0b182a29cd9c/users/23caeddaddb34af59f123550a9db5954/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:01:06.089619 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25067d3c-f730-49f8-bd11-e9b5c7a0c37a admin admin] RBAC: Authorizing `identity:delete_user(user_id=016ba4b12cb84f68ad06053cf4295bbb)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:06.091851 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25067d3c-f730-49f8-bd11-e9b5c7a0c37a admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:06.102423 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd71b90-4091-4d5a-a3da-230b2e85ce3e None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:06.103504 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd71b90-4091-4d5a-a3da-230b2e85ce3e None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:06.103961 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd71b90-4091-4d5a-a3da-230b2e85ce3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:06.139482 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-9bd71b90-4091-4d5a-a3da-230b2e85ce3e None None] MFA Rules not processed for user `23caeddaddb34af59f123550a9db5954`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:01:06.141369 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-9bd71b90-4091-4d5a-a3da-230b2e85ce3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:06.236925 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1309/2599] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:01:06 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:01:06.250264 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd71b90-4091-4d5a-a3da-230b2e85ce3e None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:06.251769 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-9bd71b90-4091-4d5a-a3da-230b2e85ce3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:06.301713 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-25067d3c-f730-49f8-bd11-e9b5c7a0c37a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '016ba4b12cb84f68ad06053cf4295bbb'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:06.302481 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-25067d3c-f730-49f8-bd11-e9b5c7a0c37a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '016ba4b12cb84f68ad06053cf4295bbb'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:06.331645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd71b90-4091-4d5a-a3da-230b2e85ce3e None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:06.335863 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51105d6-457d-48ab-b058-4b474349b7ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:06.336488 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51105d6-457d-48ab-b058-4b474349b7ba service cinder] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:06.336770 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51105d6-457d-48ab-b058-4b474349b7ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:06.337050 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51105d6-457d-48ab-b058-4b474349b7ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:06.347726 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51105d6-457d-48ab-b058-4b474349b7ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:06.349184 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51105d6-457d-48ab-b058-4b474349b7ba service cinder] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:06.360659 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1310/2600] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:01:06 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 08:01:06.387505 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-25067d3c-f730-49f8-bd11-e9b5c7a0c37a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '016ba4b12cb84f68ad06053cf4295bbb'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:06.391225 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-25067d3c-f730-49f8-bd11-e9b5c7a0c37a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '016ba4b12cb84f68ad06053cf4295bbb'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:06.403242 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-25067d3c-f730-49f8-bd11-e9b5c7a0c37a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '016ba4b12cb84f68ad06053cf4295bbb'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:06.425539 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1291/2601] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 08:01:05 2022] DELETE /identity/v3/users/016ba4b12cb84f68ad06053cf4295bbb => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:01:06.440732 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51105d6-457d-48ab-b058-4b474349b7ba service cinder] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:06.543413 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51105d6-457d-48ab-b058-4b474349b7ba service cinder] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:06.555084 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:06.628309 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b836d-f597-4e85-99a7-68f5d245d71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:06.629148 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b836d-f597-4e85-99a7-68f5d245d71c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:06.629360 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b836d-f597-4e85-99a7-68f5d245d71c admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:06.629514 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b836d-f597-4e85-99a7-68f5d245d71c admin admin] PATH_INFO: `/v3/users/1c93fde3ad1340aeae5fc3a9618c7979` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:06.630691 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b836d-f597-4e85-99a7-68f5d245d71c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c93fde3ad1340aeae5fc3a9618c7979)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:06.632707 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b836d-f597-4e85-99a7-68f5d245d71c admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:06.862861 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-7c0b836d-f597-4e85-99a7-68f5d245d71c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c93fde3ad1340aeae5fc3a9618c7979'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:06.875137 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-7c0b836d-f597-4e85-99a7-68f5d245d71c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c93fde3ad1340aeae5fc3a9618c7979'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:06.976091 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-7c0b836d-f597-4e85-99a7-68f5d245d71c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c93fde3ad1340aeae5fc3a9618c7979'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:06.977299 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-7c0b836d-f597-4e85-99a7-68f5d245d71c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c93fde3ad1340aeae5fc3a9618c7979'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:06.986365 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25067d3c-f730-49f8-bd11-e9b5c7a0c37a admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:06.989754 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-25067d3c-f730-49f8-bd11-e9b5c7a0c37a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:07.012787 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-7c0b836d-f597-4e85-99a7-68f5d245d71c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c93fde3ad1340aeae5fc3a9618c7979'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:07.017592 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25067d3c-f730-49f8-bd11-e9b5c7a0c37a admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:07.024015 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1311/2602] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 08:01:06 2022] DELETE /identity/v3/users/1c93fde3ad1340aeae5fc3a9618c7979 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:01:07.026248 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148ee82-4e94-4612-b443-730db9d40945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:07.027305 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148ee82-4e94-4612-b443-730db9d40945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:07.027762 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148ee82-4e94-4612-b443-730db9d40945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:07.028213 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148ee82-4e94-4612-b443-730db9d40945 admin admin] PATH_INFO: `/v3/projects/314c4123e1b842fa94ee72e208ba172a` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:07.030662 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148ee82-4e94-4612-b443-730db9d40945 admin admin] RBAC: Authorizing `identity:delete_project(project_id=314c4123e1b842fa94ee72e208ba172a)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:07.032640 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66629117-b62e-4757-b74c-d267741f80ff None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:07.033410 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66629117-b62e-4757-b74c-d267741f80ff None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:07.034040 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66629117-b62e-4757-b74c-d267741f80ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:07.034227 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148ee82-4e94-4612-b443-730db9d40945 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:07.065779 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-66629117-b62e-4757-b74c-d267741f80ff None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:01:07.068167 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-66629117-b62e-4757-b74c-d267741f80ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:07.138122 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1312/2603] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:01:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:01:07.151560 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66629117-b62e-4757-b74c-d267741f80ff None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:07.153483 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-66629117-b62e-4757-b74c-d267741f80ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:07.195802 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:07.206771 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-f148ee82-4e94-4612-b443-730db9d40945 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '314c4123e1b842fa94ee72e208ba172a', 'request_id': 'req-f148ee82-4e94-4612-b443-730db9d40945'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:07.220911 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-f148ee82-4e94-4612-b443-730db9d40945 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '314c4123e1b842fa94ee72e208ba172a', 'request_id': 'req-f148ee82-4e94-4612-b443-730db9d40945'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:07.229731 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66629117-b62e-4757-b74c-d267741f80ff None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:07.304504 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0bfa59-0a0b-4f69-9e64-10057142d53b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:07.305215 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0bfa59-0a0b-4f69-9e64-10057142d53b service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:07.305489 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0bfa59-0a0b-4f69-9e64-10057142d53b service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:07.305760 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0bfa59-0a0b-4f69-9e64-10057142d53b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:07.346823 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-f148ee82-4e94-4612-b443-730db9d40945 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '314c4123e1b842fa94ee72e208ba172a', 'request_id': 'req-f148ee82-4e94-4612-b443-730db9d40945'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:07.363625 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-f148ee82-4e94-4612-b443-730db9d40945 admin admin] The token cache is being invalidate because project 314c4123e1b842fa94ee72e208ba172a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:01:07.364080 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-f148ee82-4e94-4612-b443-730db9d40945 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:07.364785 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-f148ee82-4e94-4612-b443-730db9d40945 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:07.370534 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1292/2604] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 08:01:06 2022] DELETE /identity/v3/projects/314c4123e1b842fa94ee72e208ba172a => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:01:07.378619 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f06a7-3076-4711-9d52-22889f85487a None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:07.379223 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f06a7-3076-4711-9d52-22889f85487a None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:07.385950 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f06a7-3076-4711-9d52-22889f85487a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:07.402322 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0bfa59-0a0b-4f69-9e64-10057142d53b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:07.403815 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0bfa59-0a0b-4f69-9e64-10057142d53b service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:07.404880 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-8e1f06a7-3076-4711-9d52-22889f85487a None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:01:07.406181 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-8e1f06a7-3076-4711-9d52-22889f85487a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:07.415091 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1293/2605] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:01:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:01:07.418297 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1313/2606] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:01:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 08:01:07.428042 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb671aa-0725-40d8-b8f1-ba1d490d5a67 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:07.428558 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb671aa-0725-40d8-b8f1-ba1d490d5a67 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:07.429114 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb671aa-0725-40d8-b8f1-ba1d490d5a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:07.460639 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-dfb671aa-0725-40d8-b8f1-ba1d490d5a67 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:01:07.461893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-dfb671aa-0725-40d8-b8f1-ba1d490d5a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:07.472317 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1294/2607] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:01:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:01:07.478781 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0bfa59-0a0b-4f69-9e64-10057142d53b service neutron] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:07.480979 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-6b0bfa59-0a0b-4f69-9e64-10057142d53b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:07.495443 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0bfa59-0a0b-4f69-9e64-10057142d53b service neutron] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:07.500534 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69aca62-2535-49d8-9ceb-e0ba1bdcd76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:07.501196 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69aca62-2535-49d8-9ceb-e0ba1bdcd76d admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:07.501491 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69aca62-2535-49d8-9ceb-e0ba1bdcd76d admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:07.501778 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69aca62-2535-49d8-9ceb-e0ba1bdcd76d admin admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:07.502439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69aca62-2535-49d8-9ceb-e0ba1bdcd76d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:01:07.502769 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69aca62-2535-49d8-9ceb-e0ba1bdcd76d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:07.504410 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69aca62-2535-49d8-9ceb-e0ba1bdcd76d admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:07.519975 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1314/2608] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 08:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:01:07.530430 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb671aa-0725-40d8-b8f1-ba1d490d5a67 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:07.535606 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb671aa-0725-40d8-b8f1-ba1d490d5a67 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:07.541219 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673c291-fb64-49da-9bbc-94e1d8f25652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:07.541947 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673c291-fb64-49da-9bbc-94e1d8f25652 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:07.542231 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673c291-fb64-49da-9bbc-94e1d8f25652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:07.542501 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673c291-fb64-49da-9bbc-94e1d8f25652 admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:07.543546 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e673c291-fb64-49da-9bbc-94e1d8f25652 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:07.546724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e673c291-fb64-49da-9bbc-94e1d8f25652 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:07.562754 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:07.683800 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1295/2609] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 08:01:07 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:01:07.688648 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69aca62-2535-49d8-9ceb-e0ba1bdcd76d admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:07.706865 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69aca62-2535-49d8-9ceb-e0ba1bdcd76d admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:07.797376 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e62871-adaf-4e15-8123-1aa1b02ca566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:07.798523 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e62871-adaf-4e15-8123-1aa1b02ca566 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:07.799044 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e62871-adaf-4e15-8123-1aa1b02ca566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:07.799535 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e62871-adaf-4e15-8123-1aa1b02ca566 admin admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:07.800743 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e62871-adaf-4e15-8123-1aa1b02ca566 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:07.803986 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e62871-adaf-4e15-8123-1aa1b02ca566 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:07.914886 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1315/2610] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 08:01:07 2022] POST /identity/v3/users => generated 293 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:01:07.920342 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673c291-fb64-49da-9bbc-94e1d8f25652 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:07.931714 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673c291-fb64-49da-9bbc-94e1d8f25652 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:07.937918 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa4a01-aee0-4b30-9a8d-3399b43b2332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:07.938468 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa4a01-aee0-4b30-9a8d-3399b43b2332 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:07.938750 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa4a01-aee0-4b30-9a8d-3399b43b2332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:07.939048 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa4a01-aee0-4b30-9a8d-3399b43b2332 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:07.939754 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa4a01-aee0-4b30-9a8d-3399b43b2332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:07.941372 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa4a01-aee0-4b30-9a8d-3399b43b2332 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:07.952933 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1296/2611] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:01:07.957188 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e62871-adaf-4e15-8123-1aa1b02ca566 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:07.969178 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e62871-adaf-4e15-8123-1aa1b02ca566 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:07.974032 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2bb72-71f0-4caa-a0e3-b97f415ee0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:07.974680 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2bb72-71f0-4caa-a0e3-b97f415ee0ad admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:07.974956 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2bb72-71f0-4caa-a0e3-b97f415ee0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:07.975261 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2bb72-71f0-4caa-a0e3-b97f415ee0ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:07.975921 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2bb72-71f0-4caa-a0e3-b97f415ee0ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:07.977882 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2bb72-71f0-4caa-a0e3-b97f415ee0ad admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:07.990265 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1316/2612] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:01:08.007543 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2bb72-71f0-4caa-a0e3-b97f415ee0ad admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:08.007707 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa4a01-aee0-4b30-9a8d-3399b43b2332 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:08.010499 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-a9aa4a01-aee0-4b30-9a8d-3399b43b2332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:08.016633 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:08.024195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2bb72-71f0-4caa-a0e3-b97f415ee0ad admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:08.037625 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa4a01-aee0-4b30-9a8d-3399b43b2332 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:08.037814 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae30a65-95f3-4628-be9a-1c58615d464b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:08.037814 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae30a65-95f3-4628-be9a-1c58615d464b admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:08.037814 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae30a65-95f3-4628-be9a-1c58615d464b admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:08.037814 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae30a65-95f3-4628-be9a-1c58615d464b admin admin] PATH_INFO: `/v3/projects/7e35c6c81ee3433b9117ee852b34d6ac/users/e44307674ab44a3dbb567a4e8ad8e6a0/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:08.041602 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9662655-80bb-48c6-b73c-cf2dd68e3652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:08.042263 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9662655-80bb-48c6-b73c-cf2dd68e3652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:08.042559 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9662655-80bb-48c6-b73c-cf2dd68e3652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:08.042810 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9662655-80bb-48c6-b73c-cf2dd68e3652 admin admin] PATH_INFO: `/v3/projects/cd9def02c5b745bca10023947a905881` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:08.044031 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9662655-80bb-48c6-b73c-cf2dd68e3652 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd9def02c5b745bca10023947a905881)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:08.057126 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9662655-80bb-48c6-b73c-cf2dd68e3652 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:08.069518 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae30a65-95f3-4628-be9a-1c58615d464b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e35c6c81ee3433b9117ee852b34d6ac, user_id=e44307674ab44a3dbb567a4e8ad8e6a0, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:08.072425 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae30a65-95f3-4628-be9a-1c58615d464b admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:08.168539 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1317/2613] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 08:01:08 2022] PUT /identity/v3/projects/7e35c6c81ee3433b9117ee852b34d6ac/users/e44307674ab44a3dbb567a4e8ad8e6a0/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:01:08.179718 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d4292-0a87-41b7-8d4e-fa3cb96f86ad None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:08.180140 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d4292-0a87-41b7-8d4e-fa3cb96f86ad None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:08.180538 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d4292-0a87-41b7-8d4e-fa3cb96f86ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:08.211553 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-348d4292-0a87-41b7-8d4e-fa3cb96f86ad None None] MFA Rules not processed for user `e44307674ab44a3dbb567a4e8ad8e6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:01:08.213327 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-348d4292-0a87-41b7-8d4e-fa3cb96f86ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:08.219305 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-d9662655-80bb-48c6-b73c-cf2dd68e3652 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd9def02c5b745bca10023947a905881', 'request_id': 'req-d9662655-80bb-48c6-b73c-cf2dd68e3652'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:08.227188 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-d9662655-80bb-48c6-b73c-cf2dd68e3652 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd9def02c5b745bca10023947a905881', 'request_id': 'req-d9662655-80bb-48c6-b73c-cf2dd68e3652'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:08.309929 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1318/2614] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:01:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:01:08.314884 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d4292-0a87-41b7-8d4e-fa3cb96f86ad None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:08.334345 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-d9662655-80bb-48c6-b73c-cf2dd68e3652 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd9def02c5b745bca10023947a905881', 'request_id': 'req-d9662655-80bb-48c6-b73c-cf2dd68e3652'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:08.350758 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-d9662655-80bb-48c6-b73c-cf2dd68e3652 admin admin] The token cache is being invalidate because project cd9def02c5b745bca10023947a905881 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:01:08.351088 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-d9662655-80bb-48c6-b73c-cf2dd68e3652 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:08.351804 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-d9662655-80bb-48c6-b73c-cf2dd68e3652 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:08.353554 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1297/2615] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 08:01:08 2022] DELETE /identity/v3/projects/cd9def02c5b745bca10023947a905881 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:01:08.359013 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9662655-80bb-48c6-b73c-cf2dd68e3652 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:08.360730 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-d9662655-80bb-48c6-b73c-cf2dd68e3652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:08.411106 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d4292-0a87-41b7-8d4e-fa3cb96f86ad None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:08.417698 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b924699-da01-4c68-a43f-9225b96e927b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:08.418326 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b924699-da01-4c68-a43f-9225b96e927b admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:08.418597 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b924699-da01-4c68-a43f-9225b96e927b admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:08.418872 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b924699-da01-4c68-a43f-9225b96e927b admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:08.419545 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b924699-da01-4c68-a43f-9225b96e927b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:08.421599 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b924699-da01-4c68-a43f-9225b96e927b admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:08.451848 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9662655-80bb-48c6-b73c-cf2dd68e3652 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:08.456674 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3e134-bd1b-47ed-90eb-acf590a9db3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:08.457327 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3e134-bd1b-47ed-90eb-acf590a9db3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:08.457611 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3e134-bd1b-47ed-90eb-acf590a9db3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:08.457898 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3e134-bd1b-47ed-90eb-acf590a9db3e admin admin] PATH_INFO: `/v3/users/23caeddaddb34af59f123550a9db5954` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:08.459232 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f3e134-bd1b-47ed-90eb-acf590a9db3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=23caeddaddb34af59f123550a9db5954)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:08.461813 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f3e134-bd1b-47ed-90eb-acf590a9db3e admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:08.568069 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1319/2616] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 08:01:08 2022] POST /identity/v3/projects => generated 387 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:01:08.572484 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b924699-da01-4c68-a43f-9225b96e927b admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:08.574336 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-6b924699-da01-4c68-a43f-9225b96e927b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:08.690309 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-39f3e134-bd1b-47ed-90eb-acf590a9db3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23caeddaddb34af59f123550a9db5954'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:08.691130 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-39f3e134-bd1b-47ed-90eb-acf590a9db3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23caeddaddb34af59f123550a9db5954'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:08.763886 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-39f3e134-bd1b-47ed-90eb-acf590a9db3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23caeddaddb34af59f123550a9db5954'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:08.768242 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-39f3e134-bd1b-47ed-90eb-acf590a9db3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23caeddaddb34af59f123550a9db5954'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:08.773271 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:08.780046 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b924699-da01-4c68-a43f-9225b96e927b admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:08.782166 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-39f3e134-bd1b-47ed-90eb-acf590a9db3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23caeddaddb34af59f123550a9db5954'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:08.784653 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=82,keystone:INSERT=3,keystone:DELETE=15 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:08.786527 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea86b0-a014-4a4f-a209-0800ac005dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:08.786751 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea86b0-a014-4a4f-a209-0800ac005dca admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:08.787081 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea86b0-a014-4a4f-a209-0800ac005dca admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:08.787359 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea86b0-a014-4a4f-a209-0800ac005dca admin admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:08.788008 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea86b0-a014-4a4f-a209-0800ac005dca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:08.790221 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea86b0-a014-4a4f-a209-0800ac005dca admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:08.805581 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1298/2617] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 08:01:08 2022] DELETE /identity/v3/users/23caeddaddb34af59f123550a9db5954 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:01:08.862713 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1320/2618] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 08:01:08 2022] POST /identity/v3/users => generated 300 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:01:08.866444 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3e134-bd1b-47ed-90eb-acf590a9db3e admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:08.870221 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-39f3e134-bd1b-47ed-90eb-acf590a9db3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:08.977117 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3e134-bd1b-47ed-90eb-acf590a9db3e admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:08.983113 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1e985-731f-4ddf-9aa1-1fc50a27abc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:08.983739 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1e985-731f-4ddf-9aa1-1fc50a27abc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:08.987376 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1e985-731f-4ddf-9aa1-1fc50a27abc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:08.987376 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1e985-731f-4ddf-9aa1-1fc50a27abc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:08.987376 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1e985-731f-4ddf-9aa1-1fc50a27abc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:08.987376 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1e985-731f-4ddf-9aa1-1fc50a27abc9 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:08.998246 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1299/2619] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 08:01:09.003096 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea86b0-a014-4a4f-a209-0800ac005dca admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:09.022024 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea86b0-a014-4a4f-a209-0800ac005dca admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:09.032191 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6a58a-3947-4826-b8e9-ed46a0b59059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:09.032918 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6a58a-3947-4826-b8e9-ed46a0b59059 admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:09.033197 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6a58a-3947-4826-b8e9-ed46a0b59059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:09.033472 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6a58a-3947-4826-b8e9-ed46a0b59059 admin admin] PATH_INFO: `/v3/projects/5171d749e05f4f459bfa221237369ec4/users/3c319beee56242e195ef125bf6bb9891/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:09.055304 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6a58a-3947-4826-b8e9-ed46a0b59059 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5171d749e05f4f459bfa221237369ec4, user_id=3c319beee56242e195ef125bf6bb9891, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:09.061381 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6a58a-3947-4826-b8e9-ed46a0b59059 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:09.127840 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1321/2620] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 08:01:09 2022] PUT /identity/v3/projects/5171d749e05f4f459bfa221237369ec4/users/3c319beee56242e195ef125bf6bb9891/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:01:09.131969 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1e985-731f-4ddf-9aa1-1fc50a27abc9 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:09.148648 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1e985-731f-4ddf-9aa1-1fc50a27abc9 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:09.239415 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10985d-65aa-492e-952f-35ebed328f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:09.240038 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10985d-65aa-492e-952f-35ebed328f55 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:09.240317 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10985d-65aa-492e-952f-35ebed328f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:09.240595 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10985d-65aa-492e-952f-35ebed328f55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:09.241246 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a10985d-65aa-492e-952f-35ebed328f55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:09.242845 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a10985d-65aa-492e-952f-35ebed328f55 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:09.256879 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1300/2621] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 08:01:09.262498 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6a58a-3947-4826-b8e9-ed46a0b59059 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:09.274144 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6a58a-3947-4826-b8e9-ed46a0b59059 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:09.279609 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66901138-fdb2-45cf-9fd1-1f7b6c5f8dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:09.280428 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66901138-fdb2-45cf-9fd1-1f7b6c5f8dcf admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:09.280726 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66901138-fdb2-45cf-9fd1-1f7b6c5f8dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:09.281007 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66901138-fdb2-45cf-9fd1-1f7b6c5f8dcf admin admin] PATH_INFO: `/v3/projects/5171d749e05f4f459bfa221237369ec4/users/3c319beee56242e195ef125bf6bb9891/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:09.284060 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66901138-fdb2-45cf-9fd1-1f7b6c5f8dcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5171d749e05f4f459bfa221237369ec4, user_id=3c319beee56242e195ef125bf6bb9891, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:09.285995 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66901138-fdb2-45cf-9fd1-1f7b6c5f8dcf admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:09.300949 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1322/2622] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 08:01:09 2022] PUT /identity/v3/projects/5171d749e05f4f459bfa221237369ec4/users/3c319beee56242e195ef125bf6bb9891/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:01:09.312504 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56803a-619d-4220-9362-c1a88e07d803 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:09.313177 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56803a-619d-4220-9362-c1a88e07d803 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:09.313177 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56803a-619d-4220-9362-c1a88e07d803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:09.346091 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-9f56803a-619d-4220-9362-c1a88e07d803 None None] MFA Rules not processed for user `3c319beee56242e195ef125bf6bb9891`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:01:09.347766 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-9f56803a-619d-4220-9362-c1a88e07d803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:09.372891 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66901138-fdb2-45cf-9fd1-1f7b6c5f8dcf admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:09.377476 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-66901138-fdb2-45cf-9fd1-1f7b6c5f8dcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:09.448395 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:09.456500 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1301/2623] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:01:09 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:01:09.466791 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f56803a-619d-4220-9362-c1a88e07d803 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:09.468343 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-9f56803a-619d-4220-9362-c1a88e07d803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:09.538379 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66901138-fdb2-45cf-9fd1-1f7b6c5f8dcf admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:09.547176 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087fb5a-cd60-43f0-84b3-127f254c380f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:09.551647 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087fb5a-cd60-43f0-84b3-127f254c380f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:09.551647 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087fb5a-cd60-43f0-84b3-127f254c380f admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:09.551647 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087fb5a-cd60-43f0-84b3-127f254c380f admin admin] PATH_INFO: `/v3/projects/cb57d5c40a574d0f96af0b182a29cd9c` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:09.551647 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087fb5a-cd60-43f0-84b3-127f254c380f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb57d5c40a574d0f96af0b182a29cd9c)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:09.552552 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087fb5a-cd60-43f0-84b3-127f254c380f admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:09.562431 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f56803a-619d-4220-9362-c1a88e07d803 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:09.567742 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d250628e-d2a7-43aa-b6cc-2e480d48674d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:09.568365 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250628e-d2a7-43aa-b6cc-2e480d48674d service cinder] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:09.568793 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250628e-d2a7-43aa-b6cc-2e480d48674d service cinder] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:09.569078 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250628e-d2a7-43aa-b6cc-2e480d48674d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:09.570913 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-d250628e-d2a7-43aa-b6cc-2e480d48674d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:09.650340 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d250628e-d2a7-43aa-b6cc-2e480d48674d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:09.651867 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d250628e-d2a7-43aa-b6cc-2e480d48674d service cinder] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:09.662387 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1302/2624] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:01:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 08:01:09.662693 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d250628e-d2a7-43aa-b6cc-2e480d48674d service cinder] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:09.664184 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-d250628e-d2a7-43aa-b6cc-2e480d48674d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:09.682003 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d250628e-d2a7-43aa-b6cc-2e480d48674d service cinder] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:09.687345 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57cd4ee-7b7c-4e91-8cc9-a2239c47bb8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:09.688357 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57cd4ee-7b7c-4e91-8cc9-a2239c47bb8f service cinder] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:09.689331 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57cd4ee-7b7c-4e91-8cc9-a2239c47bb8f service cinder] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:09.690038 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57cd4ee-7b7c-4e91-8cc9-a2239c47bb8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:09.708359 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57cd4ee-7b7c-4e91-8cc9-a2239c47bb8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:09.711305 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57cd4ee-7b7c-4e91-8cc9-a2239c47bb8f service cinder] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:09.716656 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-a087fb5a-cd60-43f0-84b3-127f254c380f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb57d5c40a574d0f96af0b182a29cd9c', 'request_id': 'req-a087fb5a-cd60-43f0-84b3-127f254c380f'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:09.729788 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1303/2625] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:01:09 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:01:09.733747 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-a087fb5a-cd60-43f0-84b3-127f254c380f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb57d5c40a574d0f96af0b182a29cd9c', 'request_id': 'req-a087fb5a-cd60-43f0-84b3-127f254c380f'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:09.749728 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-a087fb5a-cd60-43f0-84b3-127f254c380f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb57d5c40a574d0f96af0b182a29cd9c', 'request_id': 'req-a087fb5a-cd60-43f0-84b3-127f254c380f'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:09.862685 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-a087fb5a-cd60-43f0-84b3-127f254c380f admin admin] The token cache is being invalidate because project cb57d5c40a574d0f96af0b182a29cd9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:01:09.865339 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-a087fb5a-cd60-43f0-84b3-127f254c380f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:09.865339 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-a087fb5a-cd60-43f0-84b3-127f254c380f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:09.866614 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1323/2626] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 08:01:09 2022] DELETE /identity/v3/projects/cb57d5c40a574d0f96af0b182a29cd9c => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:01:09.871251 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66ae11-1f15-4c27-b5e6-cc446507165a None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:09.871633 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66ae11-1f15-4c27-b5e6-cc446507165a None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:09.871925 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66ae11-1f15-4c27-b5e6-cc446507165a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:09.911056 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-1b66ae11-1f15-4c27-b5e6-cc446507165a None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:01:09.913240 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-1b66ae11-1f15-4c27-b5e6-cc446507165a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:10.019478 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1304/2627] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:01:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:01:10.028710 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f148b0e-0ddc-4a3f-afe7-b9696393b555 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:10.029232 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f148b0e-0ddc-4a3f-afe7-b9696393b555 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:10.029503 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f148b0e-0ddc-4a3f-afe7-b9696393b555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:10.054843 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-0f148b0e-0ddc-4a3f-afe7-b9696393b555 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:01:10.056068 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-0f148b0e-0ddc-4a3f-afe7-b9696393b555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:10.066566 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1324/2628] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:01:10.071230 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66ae11-1f15-4c27-b5e6-cc446507165a None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:10.081315 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66ae11-1f15-4c27-b5e6-cc446507165a None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:10.086622 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca49a87-5d55-43a4-a6bc-4f71c221a3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:10.087325 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca49a87-5d55-43a4-a6bc-4f71c221a3f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:10.087680 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca49a87-5d55-43a4-a6bc-4f71c221a3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:10.087953 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca49a87-5d55-43a4-a6bc-4f71c221a3f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:10.088616 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca49a87-5d55-43a4-a6bc-4f71c221a3f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:01:10.088919 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca49a87-5d55-43a4-a6bc-4f71c221a3f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:10.090537 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca49a87-5d55-43a4-a6bc-4f71c221a3f6 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:10.106667 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1305/2629] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 08:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:01:10.108226 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f148b0e-0ddc-4a3f-afe7-b9696393b555 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:10.117794 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f148b0e-0ddc-4a3f-afe7-b9696393b555 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:10.124909 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f92bb-720e-44f2-8da2-e88d0e364dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:10.125562 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f92bb-720e-44f2-8da2-e88d0e364dba admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:10.125837 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f92bb-720e-44f2-8da2-e88d0e364dba admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:10.126107 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f92bb-720e-44f2-8da2-e88d0e364dba admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:10.126939 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f92bb-720e-44f2-8da2-e88d0e364dba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:10.129396 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f92bb-720e-44f2-8da2-e88d0e364dba admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:10.275426 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1325/2630] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 08:01:10 2022] POST /identity/v3/projects => generated 373 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:01:10.277517 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca49a87-5d55-43a4-a6bc-4f71c221a3f6 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:10.287982 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca49a87-5d55-43a4-a6bc-4f71c221a3f6 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:10.323415 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:10.360448 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f3bc2-8888-476d-901f-e7b37ec55631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:10.361060 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f3bc2-8888-476d-901f-e7b37ec55631 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:10.361334 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f3bc2-8888-476d-901f-e7b37ec55631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:10.361605 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f3bc2-8888-476d-901f-e7b37ec55631 admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:10.362227 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f3bc2-8888-476d-901f-e7b37ec55631 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:10.364154 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f3bc2-8888-476d-901f-e7b37ec55631 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:10.479746 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1306/2631] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 08:01:10 2022] POST /identity/v3/users => generated 287 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:01:10.484056 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f92bb-720e-44f2-8da2-e88d0e364dba admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:10.500922 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f92bb-720e-44f2-8da2-e88d0e364dba admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:10.500922 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616548f9-938c-4e66-aaab-29a7f720b1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:10.500922 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616548f9-938c-4e66-aaab-29a7f720b1f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:10.501931 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616548f9-938c-4e66-aaab-29a7f720b1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:10.501931 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616548f9-938c-4e66-aaab-29a7f720b1f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:10.502100 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616548f9-938c-4e66-aaab-29a7f720b1f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:10.503933 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616548f9-938c-4e66-aaab-29a7f720b1f7 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:10.514281 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:10.518265 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1326/2632] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:01:10.524334 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f3bc2-8888-476d-901f-e7b37ec55631 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:10.535886 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f3bc2-8888-476d-901f-e7b37ec55631 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:10.540922 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3c3ff-6cd5-4538-827a-5dbd55892fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:10.541691 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3c3ff-6cd5-4538-827a-5dbd55892fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:10.541994 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3c3ff-6cd5-4538-827a-5dbd55892fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:10.542262 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3c3ff-6cd5-4538-827a-5dbd55892fd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:10.542902 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e3c3ff-6cd5-4538-827a-5dbd55892fd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:10.544626 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e3c3ff-6cd5-4538-827a-5dbd55892fd8 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:10.555177 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1307/2633] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:01:10.559632 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616548f9-938c-4e66-aaab-29a7f720b1f7 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:10.571259 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616548f9-938c-4e66-aaab-29a7f720b1f7 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:10.581092 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a7516-7bb4-4552-9135-c76e50a351f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:10.581092 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a7516-7bb4-4552-9135-c76e50a351f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:10.581092 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a7516-7bb4-4552-9135-c76e50a351f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:10.581092 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a7516-7bb4-4552-9135-c76e50a351f3 admin admin] PATH_INFO: `/v3/projects/c19633b548bd47ad92f11fb4c1ff173a/users/644c2e42856a4d7ba3c845409585ab88/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:10.594741 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a7516-7bb4-4552-9135-c76e50a351f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c19633b548bd47ad92f11fb4c1ff173a, user_id=644c2e42856a4d7ba3c845409585ab88, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:10.597682 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a7516-7bb4-4552-9135-c76e50a351f3 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:10.759984 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1327/2634] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 08:01:10 2022] PUT /identity/v3/projects/c19633b548bd47ad92f11fb4c1ff173a/users/644c2e42856a4d7ba3c845409585ab88/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:01:10.767491 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97c52d-2926-411c-a59a-1f297021c6f8 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:10.767491 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97c52d-2926-411c-a59a-1f297021c6f8 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:10.767491 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97c52d-2926-411c-a59a-1f297021c6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:10.786363 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-5e97c52d-2926-411c-a59a-1f297021c6f8 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:01:10.787616 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-5e97c52d-2926-411c-a59a-1f297021c6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:10.854971 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1308/2635] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:01:10.864911 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a7516-7bb4-4552-9135-c76e50a351f3 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:10.866739 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-c29a7516-7bb4-4552-9135-c76e50a351f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:10.924790 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a7516-7bb4-4552-9135-c76e50a351f3 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:10.928617 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7c95a-593d-46ba-b8cc-227e279c26c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:10.929203 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7c95a-593d-46ba-b8cc-227e279c26c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:10.929482 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7c95a-593d-46ba-b8cc-227e279c26c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:10.929751 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7c95a-593d-46ba-b8cc-227e279c26c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:10.942213 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e7c95a-593d-46ba-b8cc-227e279c26c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:10.943689 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e7c95a-593d-46ba-b8cc-227e279c26c7 service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:10.957075 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1328/2636] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:01:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 08:01:11.363514 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97c52d-2926-411c-a59a-1f297021c6f8 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:11.365450 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-5e97c52d-2926-411c-a59a-1f297021c6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:11.383510 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97c52d-2926-411c-a59a-1f297021c6f8 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:11.390520 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef41891-56c6-44eb-ad60-bc001e375442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:11.391598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef41891-56c6-44eb-ad60-bc001e375442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:11.392183 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef41891-56c6-44eb-ad60-bc001e375442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:11.392897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef41891-56c6-44eb-ad60-bc001e375442 admin admin] PATH_INFO: `/v3/users/e44307674ab44a3dbb567a4e8ad8e6a0` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:11.394661 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef41891-56c6-44eb-ad60-bc001e375442 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e44307674ab44a3dbb567a4e8ad8e6a0)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:11.396969 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef41891-56c6-44eb-ad60-bc001e375442 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:11.672859 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-5ef41891-56c6-44eb-ad60-bc001e375442 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e44307674ab44a3dbb567a4e8ad8e6a0'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:11.673890 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-5ef41891-56c6-44eb-ad60-bc001e375442 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e44307674ab44a3dbb567a4e8ad8e6a0'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:11.750342 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-5ef41891-56c6-44eb-ad60-bc001e375442 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e44307674ab44a3dbb567a4e8ad8e6a0'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:11.751108 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-5ef41891-56c6-44eb-ad60-bc001e375442 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e44307674ab44a3dbb567a4e8ad8e6a0'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:11.764912 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-5ef41891-56c6-44eb-ad60-bc001e375442 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e44307674ab44a3dbb567a4e8ad8e6a0'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:11.794716 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1309/2637] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 08:01:11 2022] DELETE /identity/v3/users/e44307674ab44a3dbb567a4e8ad8e6a0 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:01:11.799743 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223d703-7ac7-4a86-86f8-07f734a98dbc None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:11.800316 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223d703-7ac7-4a86-86f8-07f734a98dbc None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:11.800605 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223d703-7ac7-4a86-86f8-07f734a98dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:11.822877 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-4223d703-7ac7-4a86-86f8-07f734a98dbc None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:01:11.824160 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-4223d703-7ac7-4a86-86f8-07f734a98dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:11.920736 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1329/2638] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:01:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:01:11.931844 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef41891-56c6-44eb-ad60-bc001e375442 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:11.933462 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-5ef41891-56c6-44eb-ad60-bc001e375442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:11.968434 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:12.011902 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef41891-56c6-44eb-ad60-bc001e375442 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:12.015787 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34536c63-cf3a-4000-8f64-b2416084030e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:12.016442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34536c63-cf3a-4000-8f64-b2416084030e service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:12.016946 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34536c63-cf3a-4000-8f64-b2416084030e service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:12.017725 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34536c63-cf3a-4000-8f64-b2416084030e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:12.029088 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34536c63-cf3a-4000-8f64-b2416084030e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:12.030546 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34536c63-cf3a-4000-8f64-b2416084030e service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:12.042099 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1310/2639] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:01:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:01:12.506711 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211d7f4-414d-48de-ba9f-5286ac7345d1 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:12.506711 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211d7f4-414d-48de-ba9f-5286ac7345d1 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:12.506711 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211d7f4-414d-48de-ba9f-5286ac7345d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:12.571385 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-0211d7f4-414d-48de-ba9f-5286ac7345d1 None None] MFA Rules not processed for user `644c2e42856a4d7ba3c845409585ab88`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:01:12.576366 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-0211d7f4-414d-48de-ba9f-5286ac7345d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:12.666709 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1330/2640] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:01:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:01:12.671311 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34536c63-cf3a-4000-8f64-b2416084030e service neutron] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:12.672807 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-34536c63-cf3a-4000-8f64-b2416084030e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:12.689445 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34536c63-cf3a-4000-8f64-b2416084030e service neutron] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:12.701513 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27859001-7898-41c7-abcd-f77a6d91ab86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:12.702191 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27859001-7898-41c7-abcd-f77a6d91ab86 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:12.702476 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27859001-7898-41c7-abcd-f77a6d91ab86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:12.702795 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27859001-7898-41c7-abcd-f77a6d91ab86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:12.703468 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27859001-7898-41c7-abcd-f77a6d91ab86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:12.705383 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27859001-7898-41c7-abcd-f77a6d91ab86 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:12.711103 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211d7f4-414d-48de-ba9f-5286ac7345d1 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:12.713603 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-0211d7f4-414d-48de-ba9f-5286ac7345d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:12.735211 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211d7f4-414d-48de-ba9f-5286ac7345d1 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:12.740552 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb6802-6b79-4add-afcc-67d19e1fac17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:12.741265 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb6802-6b79-4add-afcc-67d19e1fac17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:12.742252 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb6802-6b79-4add-afcc-67d19e1fac17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:12.742525 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb6802-6b79-4add-afcc-67d19e1fac17 admin admin] PATH_INFO: `/v3/projects/7e35c6c81ee3433b9117ee852b34d6ac` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:12.744814 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb6802-6b79-4add-afcc-67d19e1fac17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e35c6c81ee3433b9117ee852b34d6ac)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:12.747236 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb6802-6b79-4add-afcc-67d19e1fac17 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:12.748896 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:12.809553 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1311/2641] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 08:01:12 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:01:12.813454 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27859001-7898-41c7-abcd-f77a6d91ab86 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:12.876981 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27859001-7898-41c7-abcd-f77a6d91ab86 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:12.881802 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db0f7b-a794-4fd6-bdee-c5f4adbdbbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:12.882417 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db0f7b-a794-4fd6-bdee-c5f4adbdbbf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:12.882698 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db0f7b-a794-4fd6-bdee-c5f4adbdbbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:12.882976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db0f7b-a794-4fd6-bdee-c5f4adbdbbf3 admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:12.883634 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6db0f7b-a794-4fd6-bdee-c5f4adbdbbf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:12.886387 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6db0f7b-a794-4fd6-bdee-c5f4adbdbbf3 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:12.902956 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-7bcb6802-6b79-4add-afcc-67d19e1fac17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e35c6c81ee3433b9117ee852b34d6ac', 'request_id': 'req-7bcb6802-6b79-4add-afcc-67d19e1fac17'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:12.916503 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-7bcb6802-6b79-4add-afcc-67d19e1fac17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e35c6c81ee3433b9117ee852b34d6ac', 'request_id': 'req-7bcb6802-6b79-4add-afcc-67d19e1fac17'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:12.923537 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-7bcb6802-6b79-4add-afcc-67d19e1fac17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e35c6c81ee3433b9117ee852b34d6ac', 'request_id': 'req-7bcb6802-6b79-4add-afcc-67d19e1fac17'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:13.002432 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1312/2642] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 08:01:12 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:01:13.006328 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db0f7b-a794-4fd6-bdee-c5f4adbdbbf3 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:13.017624 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db0f7b-a794-4fd6-bdee-c5f4adbdbbf3 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:13.038309 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-7bcb6802-6b79-4add-afcc-67d19e1fac17 admin admin] The token cache is being invalidate because project 7e35c6c81ee3433b9117ee852b34d6ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:01:13.038539 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-7bcb6802-6b79-4add-afcc-67d19e1fac17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:13.039289 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-7bcb6802-6b79-4add-afcc-67d19e1fac17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:13.041194 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1331/2643] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 08:01:12 2022] DELETE /identity/v3/projects/7e35c6c81ee3433b9117ee852b34d6ac => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:01:13.045180 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb6802-6b79-4add-afcc-67d19e1fac17 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:13.046661 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-7bcb6802-6b79-4add-afcc-67d19e1fac17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:13.081142 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2661f2-bac1-42a0-a124-14731d83b09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:13.081923 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2661f2-bac1-42a0-a124-14731d83b09c admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:13.082212 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2661f2-bac1-42a0-a124-14731d83b09c admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:13.082488 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2661f2-bac1-42a0-a124-14731d83b09c admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:13.083182 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2661f2-bac1-42a0-a124-14731d83b09c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:13.085189 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2661f2-bac1-42a0-a124-14731d83b09c admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:13.107154 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1313/2644] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 08:01:13.108552 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2661f2-bac1-42a0-a124-14731d83b09c admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:13.110302 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-ee2661f2-bac1-42a0-a124-14731d83b09c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:13.123517 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2661f2-bac1-42a0-a124-14731d83b09c admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:13.128611 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01bb3f-f9ab-476a-bf89-f4118c7de42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:13.129853 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01bb3f-f9ab-476a-bf89-f4118c7de42d admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:13.130137 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01bb3f-f9ab-476a-bf89-f4118c7de42d admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:13.130643 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01bb3f-f9ab-476a-bf89-f4118c7de42d admin admin] PATH_INFO: `/v3/projects/e3b0c94adc1b40d38662c3b1d2ea9d90/users/f3a0b4860d9845ecab3f8e526c07a8c4/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:13.138811 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb6802-6b79-4add-afcc-67d19e1fac17 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:13.145434 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563c6ef-a00b-4bf7-8af2-2b5e90a67fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:13.146425 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563c6ef-a00b-4bf7-8af2-2b5e90a67fe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:13.146744 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563c6ef-a00b-4bf7-8af2-2b5e90a67fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:13.147125 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563c6ef-a00b-4bf7-8af2-2b5e90a67fe4 admin admin] PATH_INFO: `/v3/users/3c319beee56242e195ef125bf6bb9891` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:13.147857 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec01bb3f-f9ab-476a-bf89-f4118c7de42d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3b0c94adc1b40d38662c3b1d2ea9d90, user_id=f3a0b4860d9845ecab3f8e526c07a8c4, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:13.148667 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e563c6ef-a00b-4bf7-8af2-2b5e90a67fe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c319beee56242e195ef125bf6bb9891)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:13.150937 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec01bb3f-f9ab-476a-bf89-f4118c7de42d admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:13.151805 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e563c6ef-a00b-4bf7-8af2-2b5e90a67fe4 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:13.272940 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1314/2645] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 08:01:13 2022] PUT /identity/v3/projects/e3b0c94adc1b40d38662c3b1d2ea9d90/users/f3a0b4860d9845ecab3f8e526c07a8c4/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:01:13.278074 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01bb3f-f9ab-476a-bf89-f4118c7de42d admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:13.283022 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:13.363856 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01bb3f-f9ab-476a-bf89-f4118c7de42d admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:13.370731 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9e625-890c-4bff-8467-565dd5d3b313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:13.371389 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9e625-890c-4bff-8467-565dd5d3b313 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:13.377434 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9e625-890c-4bff-8467-565dd5d3b313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:13.377434 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9e625-890c-4bff-8467-565dd5d3b313 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:13.377434 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac9e625-890c-4bff-8467-565dd5d3b313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:13.377434 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac9e625-890c-4bff-8467-565dd5d3b313 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:13.387030 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1315/2646] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 08:01:13.393690 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9e625-890c-4bff-8467-565dd5d3b313 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:13.410837 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9e625-890c-4bff-8467-565dd5d3b313 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:13.416246 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769a97d-f6f6-48eb-8d5e-83f2aaaa9af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:13.417073 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769a97d-f6f6-48eb-8d5e-83f2aaaa9af3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:13.417443 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769a97d-f6f6-48eb-8d5e-83f2aaaa9af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:13.417928 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769a97d-f6f6-48eb-8d5e-83f2aaaa9af3 admin admin] PATH_INFO: `/v3/projects/e3b0c94adc1b40d38662c3b1d2ea9d90/users/f3a0b4860d9845ecab3f8e526c07a8c4/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:13.420834 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769a97d-f6f6-48eb-8d5e-83f2aaaa9af3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3b0c94adc1b40d38662c3b1d2ea9d90, user_id=f3a0b4860d9845ecab3f8e526c07a8c4, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:13.425745 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769a97d-f6f6-48eb-8d5e-83f2aaaa9af3 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:13.442648 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1316/2647] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 08:01:13 2022] PUT /identity/v3/projects/e3b0c94adc1b40d38662c3b1d2ea9d90/users/f3a0b4860d9845ecab3f8e526c07a8c4/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:01:13.444601 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-e563c6ef-a00b-4bf7-8af2-2b5e90a67fe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c319beee56242e195ef125bf6bb9891'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:13.464337 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-e563c6ef-a00b-4bf7-8af2-2b5e90a67fe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c319beee56242e195ef125bf6bb9891'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:13.564288 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-e563c6ef-a00b-4bf7-8af2-2b5e90a67fe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c319beee56242e195ef125bf6bb9891'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:13.565357 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-e563c6ef-a00b-4bf7-8af2-2b5e90a67fe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c319beee56242e195ef125bf6bb9891'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:13.586344 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-e563c6ef-a00b-4bf7-8af2-2b5e90a67fe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c319beee56242e195ef125bf6bb9891'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:13.595325 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1332/2648] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 08:01:13 2022] DELETE /identity/v3/users/3c319beee56242e195ef125bf6bb9891 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:01:14.347061 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769a97d-f6f6-48eb-8d5e-83f2aaaa9af3 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:14.350210 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-5769a97d-f6f6-48eb-8d5e-83f2aaaa9af3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:14.442849 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769a97d-f6f6-48eb-8d5e-83f2aaaa9af3 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:14.557725 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50600ee-fe75-44c3-bc76-afd66dfa2c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:14.558623 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50600ee-fe75-44c3-bc76-afd66dfa2c7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:14.559020 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50600ee-fe75-44c3-bc76-afd66dfa2c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:14.559421 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50600ee-fe75-44c3-bc76-afd66dfa2c7b admin admin] PATH_INFO: `/v3/projects/5171d749e05f4f459bfa221237369ec4` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:14.560990 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50600ee-fe75-44c3-bc76-afd66dfa2c7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5171d749e05f4f459bfa221237369ec4)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:14.563564 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50600ee-fe75-44c3-bc76-afd66dfa2c7b admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:14.773917 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:14.788716 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-f50600ee-fe75-44c3-bc76-afd66dfa2c7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5171d749e05f4f459bfa221237369ec4', 'request_id': 'req-f50600ee-fe75-44c3-bc76-afd66dfa2c7b'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:14.796287 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-f50600ee-fe75-44c3-bc76-afd66dfa2c7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5171d749e05f4f459bfa221237369ec4', 'request_id': 'req-f50600ee-fe75-44c3-bc76-afd66dfa2c7b'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:14.861168 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563c6ef-a00b-4bf7-8af2-2b5e90a67fe4 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:14.864036 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-e563c6ef-a00b-4bf7-8af2-2b5e90a67fe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:14.881781 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:14.891872 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-f50600ee-fe75-44c3-bc76-afd66dfa2c7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5171d749e05f4f459bfa221237369ec4', 'request_id': 'req-f50600ee-fe75-44c3-bc76-afd66dfa2c7b'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:14.941275 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-f50600ee-fe75-44c3-bc76-afd66dfa2c7b admin admin] The token cache is being invalidate because project 5171d749e05f4f459bfa221237369ec4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:01:14.942170 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-f50600ee-fe75-44c3-bc76-afd66dfa2c7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:14.945900 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-f50600ee-fe75-44c3-bc76-afd66dfa2c7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:14.953882 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1317/2649] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 08:01:14 2022] DELETE /identity/v3/projects/5171d749e05f4f459bfa221237369ec4 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:01:14.960753 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b80bc-8990-4b8c-a9aa-96717510d707 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:14.961897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b80bc-8990-4b8c-a9aa-96717510d707 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:14.963219 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b80bc-8990-4b8c-a9aa-96717510d707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:14.964536 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563c6ef-a00b-4bf7-8af2-2b5e90a67fe4 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:14.998921 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-ba5b80bc-8990-4b8c-a9aa-96717510d707 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:01:15.003482 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-ba5b80bc-8990-4b8c-a9aa-96717510d707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:15.095591 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e66f9d-a496-46d5-952a-d3f1ba987222 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:15.096401 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e66f9d-a496-46d5-952a-d3f1ba987222 service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:15.096771 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e66f9d-a496-46d5-952a-d3f1ba987222 service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:15.097140 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e66f9d-a496-46d5-952a-d3f1ba987222 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:15.108537 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-19e66f9d-a496-46d5-952a-d3f1ba987222 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:15.175323 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1318/2650] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:01:15.187899 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4da0e-f781-4e09-9a40-0ef511686721 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:15.192802 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4da0e-f781-4e09-9a40-0ef511686721 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:15.193139 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4da0e-f781-4e09-9a40-0ef511686721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:15.217738 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-01f4da0e-f781-4e09-9a40-0ef511686721 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:01:15.219132 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-01f4da0e-f781-4e09-9a40-0ef511686721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:15.226600 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e66f9d-a496-46d5-952a-d3f1ba987222 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:15.228446 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e66f9d-a496-46d5-952a-d3f1ba987222 service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:15.229277 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1319/2651] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:01:15.233851 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4da0e-f781-4e09-9a40-0ef511686721 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:15.241050 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1333/2652] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:01:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 08:01:15.247487 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4da0e-f781-4e09-9a40-0ef511686721 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:15.253970 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ad366-0d5e-47ab-8815-b1efa196870e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:15.254880 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ad366-0d5e-47ab-8815-b1efa196870e admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:15.255371 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ad366-0d5e-47ab-8815-b1efa196870e admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:15.256003 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ad366-0d5e-47ab-8815-b1efa196870e admin admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:15.256873 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ad366-0d5e-47ab-8815-b1efa196870e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:01:15.257334 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ad366-0d5e-47ab-8815-b1efa196870e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:15.260677 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ad366-0d5e-47ab-8815-b1efa196870e admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:15.276936 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1320/2653] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 08:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:01:15.283063 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e66f9d-a496-46d5-952a-d3f1ba987222 service neutron] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:15.301099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e66f9d-a496-46d5-952a-d3f1ba987222 service neutron] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:15.308175 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1a942-14f8-429b-9e12-78f9a35d5e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:15.308976 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1a942-14f8-429b-9e12-78f9a35d5e53 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:15.309268 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1a942-14f8-429b-9e12-78f9a35d5e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:15.309545 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1a942-14f8-429b-9e12-78f9a35d5e53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:15.310189 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c1a942-14f8-429b-9e12-78f9a35d5e53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:15.312383 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c1a942-14f8-429b-9e12-78f9a35d5e53 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:15.561393 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1334/2654] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 08:01:15 2022] POST /identity/v3/projects => generated 359 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:01:15.565861 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ad366-0d5e-47ab-8815-b1efa196870e admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:15.584285 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ad366-0d5e-47ab-8815-b1efa196870e admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:15.682454 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ebd62-6681-41e8-9745-b29f0d1482d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:15.683105 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ebd62-6681-41e8-9745-b29f0d1482d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:15.683498 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ebd62-6681-41e8-9745-b29f0d1482d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:15.683919 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ebd62-6681-41e8-9745-b29f0d1482d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:15.684864 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ebd62-6681-41e8-9745-b29f0d1482d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:15.687589 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ebd62-6681-41e8-9745-b29f0d1482d1 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:15.815215 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1321/2655] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 08:01:15 2022] POST /identity/v3/users => generated 280 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:01:15.820021 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1a942-14f8-429b-9e12-78f9a35d5e53 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:15.841625 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1a942-14f8-429b-9e12-78f9a35d5e53 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:15.865575 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c80440-f0f5-4e41-8ee1-3c559952aa58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:15.866410 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c80440-f0f5-4e41-8ee1-3c559952aa58 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:15.867112 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c80440-f0f5-4e41-8ee1-3c559952aa58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:15.867492 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c80440-f0f5-4e41-8ee1-3c559952aa58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:15.872578 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c80440-f0f5-4e41-8ee1-3c559952aa58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:15.876131 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c80440-f0f5-4e41-8ee1-3c559952aa58 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:15.908422 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1335/2656] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:01:15.909710 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ebd62-6681-41e8-9745-b29f0d1482d1 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:15.921737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ff5fa-1552-4a75-b943-c65201dad063 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:15.922346 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ff5fa-1552-4a75-b943-c65201dad063 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:15.924184 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ff5fa-1552-4a75-b943-c65201dad063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:15.933623 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ebd62-6681-41e8-9745-b29f0d1482d1 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:15.947563 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a263b37-2680-4b34-bc44-9826e126ec8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:15.950002 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a263b37-2680-4b34-bc44-9826e126ec8c admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:15.950334 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a263b37-2680-4b34-bc44-9826e126ec8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:15.950622 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a263b37-2680-4b34-bc44-9826e126ec8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:15.952775 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a263b37-2680-4b34-bc44-9826e126ec8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:15.955398 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a263b37-2680-4b34-bc44-9826e126ec8c admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:15.989268 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1322/2657] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:01:15.991657 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a263b37-2680-4b34-bc44-9826e126ec8c admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:15.998168 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-b21ff5fa-1552-4a75-b943-c65201dad063 None None] MFA Rules not processed for user `f3a0b4860d9845ecab3f8e526c07a8c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:01:15.998168 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-b21ff5fa-1552-4a75-b943-c65201dad063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:16.013491 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a263b37-2680-4b34-bc44-9826e126ec8c admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:16.024921 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0a2cb-6627-4568-8ee9-c1bcc49bf3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:16.026435 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0a2cb-6627-4568-8ee9-c1bcc49bf3cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:16.027805 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0a2cb-6627-4568-8ee9-c1bcc49bf3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:16.028416 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0a2cb-6627-4568-8ee9-c1bcc49bf3cb admin admin] PATH_INFO: `/v3/projects/f2599d3aa0d14c61b459bf2ad8830aec/users/12a1e1a14d6c4f2f9ad572355e3b9908/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:16.051152 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d0a2cb-6627-4568-8ee9-c1bcc49bf3cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2599d3aa0d14c61b459bf2ad8830aec, user_id=12a1e1a14d6c4f2f9ad572355e3b9908, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:16.054384 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d0a2cb-6627-4568-8ee9-c1bcc49bf3cb admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:16.115066 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1336/2658] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:01:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:01:16.128096 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ff5fa-1552-4a75-b943-c65201dad063 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:16.128719 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:16.132240 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-b21ff5fa-1552-4a75-b943-c65201dad063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:16.141663 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1323/2659] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 08:01:15 2022] PUT /identity/v3/projects/f2599d3aa0d14c61b459bf2ad8830aec/users/12a1e1a14d6c4f2f9ad572355e3b9908/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:01:16.152964 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68167a9a-bd01-4400-a4d4-8cd57237db3f None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:16.153677 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68167a9a-bd01-4400-a4d4-8cd57237db3f None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:16.154240 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68167a9a-bd01-4400-a4d4-8cd57237db3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:16.198589 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-68167a9a-bd01-4400-a4d4-8cd57237db3f None None] MFA Rules not processed for user `12a1e1a14d6c4f2f9ad572355e3b9908`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:01:16.200904 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-68167a9a-bd01-4400-a4d4-8cd57237db3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:16.268865 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ff5fa-1552-4a75-b943-c65201dad063 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:16.356578 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1324/2660] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:01:16 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:01:16.375041 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f699b-e821-4afd-83a7-153a1937321d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:16.379288 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f699b-e821-4afd-83a7-153a1937321d service cinder] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:16.379603 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f699b-e821-4afd-83a7-153a1937321d service cinder] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:16.379891 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f699b-e821-4afd-83a7-153a1937321d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:16.382871 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-e34f699b-e821-4afd-83a7-153a1937321d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:16.388057 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68167a9a-bd01-4400-a4d4-8cd57237db3f None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:16.389893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-68167a9a-bd01-4400-a4d4-8cd57237db3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:16.412174 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68167a9a-bd01-4400-a4d4-8cd57237db3f None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:16.420798 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfedacfd-fa86-405f-ab0a-c766a8402c8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:16.421633 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfedacfd-fa86-405f-ab0a-c766a8402c8f service cinder] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:16.422012 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfedacfd-fa86-405f-ab0a-c766a8402c8f service cinder] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:16.422267 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfedacfd-fa86-405f-ab0a-c766a8402c8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:16.436360 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:16.436600 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfedacfd-fa86-405f-ab0a-c766a8402c8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:16.438961 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfedacfd-fa86-405f-ab0a-c766a8402c8f service cinder] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:16.451389 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1325/2661] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:01:16 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 08:01:16.476105 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfedacfd-fa86-405f-ab0a-c766a8402c8f service cinder] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:16.484532 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f699b-e821-4afd-83a7-153a1937321d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:16.485977 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f699b-e821-4afd-83a7-153a1937321d service cinder] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:16.498937 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1337/2662] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:01:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:01:16.555268 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfedacfd-fa86-405f-ab0a-c766a8402c8f service cinder] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:16.560469 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49380e14-d05d-4c42-80a5-3713abe77d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:16.561108 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49380e14-d05d-4c42-80a5-3713abe77d37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:16.561389 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49380e14-d05d-4c42-80a5-3713abe77d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:16.561665 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49380e14-d05d-4c42-80a5-3713abe77d37 admin admin] PATH_INFO: `/v3/users/12a1e1a14d6c4f2f9ad572355e3b9908` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:16.563341 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49380e14-d05d-4c42-80a5-3713abe77d37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12a1e1a14d6c4f2f9ad572355e3b9908)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:16.566787 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49380e14-d05d-4c42-80a5-3713abe77d37 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:16.895020 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-49380e14-d05d-4c42-80a5-3713abe77d37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12a1e1a14d6c4f2f9ad572355e3b9908'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:16.896085 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-49380e14-d05d-4c42-80a5-3713abe77d37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12a1e1a14d6c4f2f9ad572355e3b9908'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:16.992356 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-49380e14-d05d-4c42-80a5-3713abe77d37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12a1e1a14d6c4f2f9ad572355e3b9908'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:16.993932 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-49380e14-d05d-4c42-80a5-3713abe77d37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12a1e1a14d6c4f2f9ad572355e3b9908'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:17.003680 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-49380e14-d05d-4c42-80a5-3713abe77d37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12a1e1a14d6c4f2f9ad572355e3b9908'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:17.045158 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1326/2663] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 08:01:16 2022] DELETE /identity/v3/users/12a1e1a14d6c4f2f9ad572355e3b9908 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:01:17.051292 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d882a-ceb5-44ad-b76e-d849d9c6b0cb None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:17.052524 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d882a-ceb5-44ad-b76e-d849d9c6b0cb None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:17.052952 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d882a-ceb5-44ad-b76e-d849d9c6b0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:17.080869 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-525d882a-ceb5-44ad-b76e-d849d9c6b0cb None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:01:17.082360 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-525d882a-ceb5-44ad-b76e-d849d9c6b0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:17.221343 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1338/2664] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:01:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:01:17.266934 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49380e14-d05d-4c42-80a5-3713abe77d37 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:17.268596 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-49380e14-d05d-4c42-80a5-3713abe77d37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:17.430854 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49380e14-d05d-4c42-80a5-3713abe77d37 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:17.442825 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4c586-56bf-406a-a43a-2e1f8004b55e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:17.443504 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4c586-56bf-406a-a43a-2e1f8004b55e service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:17.443784 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4c586-56bf-406a-a43a-2e1f8004b55e service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:17.444180 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4c586-56bf-406a-a43a-2e1f8004b55e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:17.467875 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c4c586-56bf-406a-a43a-2e1f8004b55e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:17.476545 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c4c586-56bf-406a-a43a-2e1f8004b55e service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:17.487557 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1327/2665] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:01:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:01:17.579244 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:18.013389 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:18.236628 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d882a-ceb5-44ad-b76e-d849d9c6b0cb None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:18.236628 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-525d882a-ceb5-44ad-b76e-d849d9c6b0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:18.259308 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d882a-ceb5-44ad-b76e-d849d9c6b0cb None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:18.288297 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26086428-a972-4aac-ae8e-621545ddc912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:18.288297 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26086428-a972-4aac-ae8e-621545ddc912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:18.288297 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26086428-a972-4aac-ae8e-621545ddc912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:18.288297 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26086428-a972-4aac-ae8e-621545ddc912 admin admin] PATH_INFO: `/v3/projects/f2599d3aa0d14c61b459bf2ad8830aec` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:18.289062 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26086428-a972-4aac-ae8e-621545ddc912 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2599d3aa0d14c61b459bf2ad8830aec)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:18.291712 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26086428-a972-4aac-ae8e-621545ddc912 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:18.474137 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-26086428-a972-4aac-ae8e-621545ddc912 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2599d3aa0d14c61b459bf2ad8830aec', 'request_id': 'req-26086428-a972-4aac-ae8e-621545ddc912'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:18.486650 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-26086428-a972-4aac-ae8e-621545ddc912 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2599d3aa0d14c61b459bf2ad8830aec', 'request_id': 'req-26086428-a972-4aac-ae8e-621545ddc912'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:18.496793 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-26086428-a972-4aac-ae8e-621545ddc912 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2599d3aa0d14c61b459bf2ad8830aec', 'request_id': 'req-26086428-a972-4aac-ae8e-621545ddc912'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:18.618158 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-26086428-a972-4aac-ae8e-621545ddc912 admin admin] The token cache is being invalidate because project f2599d3aa0d14c61b459bf2ad8830aec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:01:18.618565 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-26086428-a972-4aac-ae8e-621545ddc912 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:18.619304 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-26086428-a972-4aac-ae8e-621545ddc912 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:18.620781 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1339/2666] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 08:01:18 2022] DELETE /identity/v3/projects/f2599d3aa0d14c61b459bf2ad8830aec => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:01:18.625800 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2df03a-00a6-4d3b-a111-43251233d757 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:18.626082 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2df03a-00a6-4d3b-a111-43251233d757 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:18.626355 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2df03a-00a6-4d3b-a111-43251233d757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:18.646872 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-ad2df03a-00a6-4d3b-a111-43251233d757 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:01:18.648154 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-ad2df03a-00a6-4d3b-a111-43251233d757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:18.723551 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1328/2667] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:01:18.733080 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22277236-b018-4762-b58d-53c4a74acb1b None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:18.733472 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22277236-b018-4762-b58d-53c4a74acb1b None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:18.733825 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22277236-b018-4762-b58d-53c4a74acb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:18.755853 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-22277236-b018-4762-b58d-53c4a74acb1b None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:01:18.757142 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-22277236-b018-4762-b58d-53c4a74acb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:18.775051 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1340/2668] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:01:18.778056 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2df03a-00a6-4d3b-a111-43251233d757 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:18.789001 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2df03a-00a6-4d3b-a111-43251233d757 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:18.794668 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5157f89-bdbe-43d6-83cc-578d0d236a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:18.798164 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5157f89-bdbe-43d6-83cc-578d0d236a1b admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:18.798164 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5157f89-bdbe-43d6-83cc-578d0d236a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:18.798164 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5157f89-bdbe-43d6-83cc-578d0d236a1b admin admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:18.798164 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5157f89-bdbe-43d6-83cc-578d0d236a1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:01:18.798164 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5157f89-bdbe-43d6-83cc-578d0d236a1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:18.798624 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5157f89-bdbe-43d6-83cc-578d0d236a1b admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:18.812738 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1329/2669] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 08:01:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:01:18.817297 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22277236-b018-4762-b58d-53c4a74acb1b None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:18.828635 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22277236-b018-4762-b58d-53c4a74acb1b None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:18.835450 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd21d7-ee9f-4839-bf54-7d348f647a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:18.840107 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd21d7-ee9f-4839-bf54-7d348f647a08 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:18.840107 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd21d7-ee9f-4839-bf54-7d348f647a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:18.840107 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd21d7-ee9f-4839-bf54-7d348f647a08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:18.840107 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd21d7-ee9f-4839-bf54-7d348f647a08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:18.841236 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd21d7-ee9f-4839-bf54-7d348f647a08 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:18.970553 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1341/2670] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 08:01:18 2022] POST /identity/v3/projects => generated 375 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:01:18.975022 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5157f89-bdbe-43d6-83cc-578d0d236a1b admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:18.986639 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5157f89-bdbe-43d6-83cc-578d0d236a1b admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:19.126033 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71269e5d-6f52-420d-b29c-53cc7bf72f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:19.127185 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71269e5d-6f52-420d-b29c-53cc7bf72f26 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:19.127185 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71269e5d-6f52-420d-b29c-53cc7bf72f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:19.127549 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71269e5d-6f52-420d-b29c-53cc7bf72f26 admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:19.128250 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71269e5d-6f52-420d-b29c-53cc7bf72f26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:19.130242 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71269e5d-6f52-420d-b29c-53cc7bf72f26 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:19.219511 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1330/2671] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 08:01:18 2022] POST /identity/v3/users => generated 288 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:01:19.220154 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd21d7-ee9f-4839-bf54-7d348f647a08 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:19.236779 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd21d7-ee9f-4839-bf54-7d348f647a08 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:19.244052 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d705a5-ae9c-4c38-89ab-7acd0fc76b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:19.244052 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d705a5-ae9c-4c38-89ab-7acd0fc76b2d admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:19.244052 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d705a5-ae9c-4c38-89ab-7acd0fc76b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:19.244052 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d705a5-ae9c-4c38-89ab-7acd0fc76b2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:19.245054 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d705a5-ae9c-4c38-89ab-7acd0fc76b2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:19.246585 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d705a5-ae9c-4c38-89ab-7acd0fc76b2d admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:19.252361 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332c44a-9ad6-4643-a979-7ae58f4c3b14 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:19.252657 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332c44a-9ad6-4643-a979-7ae58f4c3b14 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:19.253100 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332c44a-9ad6-4643-a979-7ae58f4c3b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:19.258154 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1342/2672] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:01:19.262818 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d705a5-ae9c-4c38-89ab-7acd0fc76b2d admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:19.274720 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d705a5-ae9c-4c38-89ab-7acd0fc76b2d admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:19.275664 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-d332c44a-9ad6-4643-a979-7ae58f4c3b14 None None] MFA Rules not processed for user `104001160e274732be5e9f75dfee5501`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:01:19.276956 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-d332c44a-9ad6-4643-a979-7ae58f4c3b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:19.280826 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54197c15-ac95-4a59-b66e-93444b075351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:19.281587 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54197c15-ac95-4a59-b66e-93444b075351 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:19.282041 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54197c15-ac95-4a59-b66e-93444b075351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:19.282441 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54197c15-ac95-4a59-b66e-93444b075351 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:19.283376 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54197c15-ac95-4a59-b66e-93444b075351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:19.285084 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54197c15-ac95-4a59-b66e-93444b075351 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:19.291485 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:19.302402 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1343/2673] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 08:01:19.308285 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54197c15-ac95-4a59-b66e-93444b075351 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:19.326933 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54197c15-ac95-4a59-b66e-93444b075351 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:19.337548 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6b18d-de0c-47df-8089-8bfdf3b73adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:19.338325 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6b18d-de0c-47df-8089-8bfdf3b73adb admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:19.338882 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6b18d-de0c-47df-8089-8bfdf3b73adb admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:19.339554 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6b18d-de0c-47df-8089-8bfdf3b73adb admin admin] PATH_INFO: `/v3/projects/da4c6647e2444ee38c1fca7aebb12d80/users/acfced2d0350421e93b460c59b552f19/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:19.361377 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1331/2674] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:01:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:01:19.363971 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d6b18d-de0c-47df-8089-8bfdf3b73adb admin admin] RBAC: Authorizing `identity:create_grant(project_id=da4c6647e2444ee38c1fca7aebb12d80, user_id=acfced2d0350421e93b460c59b552f19, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:19.368775 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d6b18d-de0c-47df-8089-8bfdf3b73adb admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:19.485139 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332c44a-9ad6-4643-a979-7ae58f4c3b14 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:19.486616 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-d332c44a-9ad6-4643-a979-7ae58f4c3b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:19.544735 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332c44a-9ad6-4643-a979-7ae58f4c3b14 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:19.549614 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fbe1a-3900-41af-9432-b9916e86a006 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:19.550229 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fbe1a-3900-41af-9432-b9916e86a006 service cinder] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:19.550508 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fbe1a-3900-41af-9432-b9916e86a006 service cinder] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:19.550905 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fbe1a-3900-41af-9432-b9916e86a006 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:19.552707 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-e57fbe1a-3900-41af-9432-b9916e86a006 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:19.576785 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1344/2675] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 08:01:19 2022] PUT /identity/v3/projects/da4c6647e2444ee38c1fca7aebb12d80/users/acfced2d0350421e93b460c59b552f19/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:01:19.591857 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30308f22-9754-4231-8916-cfc104330cfe None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:19.592135 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30308f22-9754-4231-8916-cfc104330cfe None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:19.592619 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30308f22-9754-4231-8916-cfc104330cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:19.629362 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-30308f22-9754-4231-8916-cfc104330cfe None None] MFA Rules not processed for user `acfced2d0350421e93b460c59b552f19`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:01:19.630786 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-30308f22-9754-4231-8916-cfc104330cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:19.634045 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57fbe1a-3900-41af-9432-b9916e86a006 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:19.635720 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57fbe1a-3900-41af-9432-b9916e86a006 service cinder] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:19.646254 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1332/2676] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:01:19 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 08:01:19.697345 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:19.727101 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1345/2677] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:01:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:01:19.728867 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fbe1a-3900-41af-9432-b9916e86a006 service cinder] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:19.739350 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fbe1a-3900-41af-9432-b9916e86a006 service cinder] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:19.825383 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56f130-2b20-4dff-acb4-ef8045726eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:19.826377 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56f130-2b20-4dff-acb4-ef8045726eaa admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:19.826664 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56f130-2b20-4dff-acb4-ef8045726eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:19.826937 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56f130-2b20-4dff-acb4-ef8045726eaa admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:19.827792 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f56f130-2b20-4dff-acb4-ef8045726eaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:19.829790 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f56f130-2b20-4dff-acb4-ef8045726eaa admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:19.965394 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1333/2678] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 08:01:19 2022] POST /identity/v3/projects => generated 375 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:01:19.966367 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30308f22-9754-4231-8916-cfc104330cfe None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:19.985271 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30308f22-9754-4231-8916-cfc104330cfe None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:20.067405 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591e50d-c4a7-45f0-8ce8-b784df4cf1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:20.068042 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591e50d-c4a7-45f0-8ce8-b784df4cf1c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:20.068330 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591e50d-c4a7-45f0-8ce8-b784df4cf1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:20.068599 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591e50d-c4a7-45f0-8ce8-b784df4cf1c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:20.069573 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591e50d-c4a7-45f0-8ce8-b784df4cf1c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:20.071230 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591e50d-c4a7-45f0-8ce8-b784df4cf1c3 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:20.208748 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1346/2679] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 08:01:19 2022] POST /identity/v3/users => generated 288 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:01:20.214154 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56f130-2b20-4dff-acb4-ef8045726eaa admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:20.227496 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56f130-2b20-4dff-acb4-ef8045726eaa admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:20.236509 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be90f7b-6aed-43c6-98a5-129d45e2a206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:20.237256 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be90f7b-6aed-43c6-98a5-129d45e2a206 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:20.237591 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be90f7b-6aed-43c6-98a5-129d45e2a206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:20.237926 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be90f7b-6aed-43c6-98a5-129d45e2a206 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:20.239311 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be90f7b-6aed-43c6-98a5-129d45e2a206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:20.241702 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be90f7b-6aed-43c6-98a5-129d45e2a206 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:20.260678 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1334/2680] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 08:01:20.264717 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591e50d-c4a7-45f0-8ce8-b784df4cf1c3 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:20.278870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591e50d-c4a7-45f0-8ce8-b784df4cf1c3 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:20.285860 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4cd5b7-bf47-470b-9d32-3a9f9762ebf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:20.287074 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4cd5b7-bf47-470b-9d32-3a9f9762ebf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:20.288497 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4cd5b7-bf47-470b-9d32-3a9f9762ebf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:20.288497 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4cd5b7-bf47-470b-9d32-3a9f9762ebf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:20.288926 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4cd5b7-bf47-470b-9d32-3a9f9762ebf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:20.292566 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4cd5b7-bf47-470b-9d32-3a9f9762ebf8 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:20.322837 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1347/2681] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:01:20.327028 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be90f7b-6aed-43c6-98a5-129d45e2a206 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:20.353990 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be90f7b-6aed-43c6-98a5-129d45e2a206 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:20.368525 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a53abd-cee6-462f-b942-723badfa90cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:20.369215 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a53abd-cee6-462f-b942-723badfa90cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:20.369480 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a53abd-cee6-462f-b942-723badfa90cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:20.369753 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a53abd-cee6-462f-b942-723badfa90cb admin admin] PATH_INFO: `/v3/projects/b2379f9cf29f438e8a11defb4d9f4eef/users/afd0d430500d46d0a598f97d25008fe6/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:20.386938 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:20.397368 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a53abd-cee6-462f-b942-723badfa90cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2379f9cf29f438e8a11defb4d9f4eef, user_id=afd0d430500d46d0a598f97d25008fe6, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:20.400555 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a53abd-cee6-462f-b942-723badfa90cb admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:20.495186 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1335/2682] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 08:01:20 2022] PUT /identity/v3/projects/b2379f9cf29f438e8a11defb4d9f4eef/users/afd0d430500d46d0a598f97d25008fe6/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:01:20.506721 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63da16-f65d-4810-a69d-892c4d36c1ea None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:20.507135 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63da16-f65d-4810-a69d-892c4d36c1ea None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:20.507466 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63da16-f65d-4810-a69d-892c4d36c1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:20.560380 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-af63da16-f65d-4810-a69d-892c4d36c1ea None None] MFA Rules not processed for user `afd0d430500d46d0a598f97d25008fe6`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:01:20.562791 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-af63da16-f65d-4810-a69d-892c4d36c1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:20.667950 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1348/2683] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:01:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:01:20.672879 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a53abd-cee6-462f-b942-723badfa90cb admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:20.773306 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a53abd-cee6-462f-b942-723badfa90cb admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:20.778500 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20982d-e6c8-4a4f-8754-d36e7291dfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:20.780408 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20982d-e6c8-4a4f-8754-d36e7291dfa1 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:20.780684 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20982d-e6c8-4a4f-8754-d36e7291dfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:20.780952 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20982d-e6c8-4a4f-8754-d36e7291dfa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:20.782120 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc20982d-e6c8-4a4f-8754-d36e7291dfa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:20.788290 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc20982d-e6c8-4a4f-8754-d36e7291dfa1 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:20.934844 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1336/2684] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 08:01:20 2022] POST /identity/v3/projects => generated 377 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:01:20.939193 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63da16-f65d-4810-a69d-892c4d36c1ea None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:20.971580 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63da16-f65d-4810-a69d-892c4d36c1ea None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:21.078550 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194bbe6f-d41d-4343-b460-873293148e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:21.079504 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bbe6f-d41d-4343-b460-873293148e0b admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:21.079819 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bbe6f-d41d-4343-b460-873293148e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:21.080243 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bbe6f-d41d-4343-b460-873293148e0b admin admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:21.080986 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194bbe6f-d41d-4343-b460-873293148e0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:21.084047 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194bbe6f-d41d-4343-b460-873293148e0b admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:21.095697 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:21.225458 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1349/2685] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 08:01:20 2022] POST /identity/v3/users => generated 295 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:01:21.232545 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20982d-e6c8-4a4f-8754-d36e7291dfa1 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:21.247527 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20982d-e6c8-4a4f-8754-d36e7291dfa1 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:21.253631 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b870728-68e4-4749-b542-e36aa750ce06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:21.254792 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b870728-68e4-4749-b542-e36aa750ce06 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:21.255462 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b870728-68e4-4749-b542-e36aa750ce06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:21.256278 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b870728-68e4-4749-b542-e36aa750ce06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:21.257269 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b870728-68e4-4749-b542-e36aa750ce06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:21.260384 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b870728-68e4-4749-b542-e36aa750ce06 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:21.276068 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1337/2686] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:01:21.279989 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194bbe6f-d41d-4343-b460-873293148e0b admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:21.305397 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194bbe6f-d41d-4343-b460-873293148e0b admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:21.312211 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507fc93e-ab7a-49c6-8184-50ad69104265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:21.312929 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507fc93e-ab7a-49c6-8184-50ad69104265 admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:21.313157 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507fc93e-ab7a-49c6-8184-50ad69104265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:21.313812 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507fc93e-ab7a-49c6-8184-50ad69104265 admin admin] PATH_INFO: `/v3/projects/8e769c9d2e7746e89141fa878694327f/users/e7154b413906414f801ae9dfbd726617/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:21.340891 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507fc93e-ab7a-49c6-8184-50ad69104265 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e769c9d2e7746e89141fa878694327f, user_id=e7154b413906414f801ae9dfbd726617, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:21.345483 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507fc93e-ab7a-49c6-8184-50ad69104265 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:21.451756 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1350/2687] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 08:01:21 2022] PUT /identity/v3/projects/8e769c9d2e7746e89141fa878694327f/users/e7154b413906414f801ae9dfbd726617/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:01:21.457745 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b870728-68e4-4749-b542-e36aa750ce06 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:21.476397 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b870728-68e4-4749-b542-e36aa750ce06 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:21.598856 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e9d89-a439-4ea2-b108-a908bdc99ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:21.599749 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e9d89-a439-4ea2-b108-a908bdc99ada admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:21.600205 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e9d89-a439-4ea2-b108-a908bdc99ada admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:21.600663 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e9d89-a439-4ea2-b108-a908bdc99ada admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:21.601479 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102e9d89-a439-4ea2-b108-a908bdc99ada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:21.603554 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102e9d89-a439-4ea2-b108-a908bdc99ada admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:21.635152 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1338/2688] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:01:21.637942 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507fc93e-ab7a-49c6-8184-50ad69104265 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:21.652648 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507fc93e-ab7a-49c6-8184-50ad69104265 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:21.658723 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b897993-1486-4123-a83e-c8986176834f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:21.666812 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b897993-1486-4123-a83e-c8986176834f admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:21.666812 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b897993-1486-4123-a83e-c8986176834f admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:21.666812 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b897993-1486-4123-a83e-c8986176834f admin admin] PATH_INFO: `/v3/projects/8e769c9d2e7746e89141fa878694327f/users/e7154b413906414f801ae9dfbd726617/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:21.666812 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b897993-1486-4123-a83e-c8986176834f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e769c9d2e7746e89141fa878694327f, user_id=e7154b413906414f801ae9dfbd726617, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:21.666812 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b897993-1486-4123-a83e-c8986176834f admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:21.679898 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1351/2689] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 08:01:21 2022] PUT /identity/v3/projects/8e769c9d2e7746e89141fa878694327f/users/e7154b413906414f801ae9dfbd726617/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:01:21.757611 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4e4eb-6da0-41ed-b51d-27341b73cfec None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:21.757877 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4e4eb-6da0-41ed-b51d-27341b73cfec None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:21.758055 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4e4eb-6da0-41ed-b51d-27341b73cfec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:21.807987 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-4db4e4eb-6da0-41ed-b51d-27341b73cfec None None] MFA Rules not processed for user `e7154b413906414f801ae9dfbd726617`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:01:21.810448 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-4db4e4eb-6da0-41ed-b51d-27341b73cfec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:21.838020 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:21.895248 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1339/2690] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:01:21 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:01:21.908444 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b897993-1486-4123-a83e-c8986176834f admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:21.911684 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-9b897993-1486-4123-a83e-c8986176834f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:22.007102 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b897993-1486-4123-a83e-c8986176834f admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:22.012593 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77dc1e-30fa-482b-aa83-7254b25fe829 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:22.013170 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77dc1e-30fa-482b-aa83-7254b25fe829 service cinder] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:22.013953 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77dc1e-30fa-482b-aa83-7254b25fe829 service cinder] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:22.014234 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77dc1e-30fa-482b-aa83-7254b25fe829 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:22.107761 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77dc1e-30fa-482b-aa83-7254b25fe829 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:22.109358 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77dc1e-30fa-482b-aa83-7254b25fe829 service cinder] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:22.119179 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1352/2691] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:01:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:01:24.223840 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4e4eb-6da0-41ed-b51d-27341b73cfec None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:24.225411 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-4db4e4eb-6da0-41ed-b51d-27341b73cfec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:24.296696 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4e4eb-6da0-41ed-b51d-27341b73cfec None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:24.304713 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be373c6-886c-4184-a871-9c1418114532 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:24.304713 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be373c6-886c-4184-a871-9c1418114532 service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:24.304713 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be373c6-886c-4184-a871-9c1418114532 service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:24.304713 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be373c6-886c-4184-a871-9c1418114532 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:24.305194 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-5be373c6-886c-4184-a871-9c1418114532 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:24.397468 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be373c6-886c-4184-a871-9c1418114532 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:24.400956 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be373c6-886c-4184-a871-9c1418114532 service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:24.416246 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1340/2692] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:01:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:01:24.439014 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77dc1e-30fa-482b-aa83-7254b25fe829 service cinder] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:24.459551 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77dc1e-30fa-482b-aa83-7254b25fe829 service cinder] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:24.467228 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80982977-7e78-482c-afcb-9676e4f71665 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:24.468322 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80982977-7e78-482c-afcb-9676e4f71665 service cinder] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:24.468994 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80982977-7e78-482c-afcb-9676e4f71665 service cinder] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:24.469288 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80982977-7e78-482c-afcb-9676e4f71665 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:24.543163 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:24.547235 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80982977-7e78-482c-afcb-9676e4f71665 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:24.548784 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80982977-7e78-482c-afcb-9676e4f71665 service cinder] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:24.559487 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1353/2693] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:01:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:01:26.606715 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be373c6-886c-4184-a871-9c1418114532 service neutron] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:26.627471 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be373c6-886c-4184-a871-9c1418114532 service neutron] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:26.632424 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b618f-8980-4435-9e65-77d211013ad1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:26.633057 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b618f-8980-4435-9e65-77d211013ad1 service cinder] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:26.634268 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b618f-8980-4435-9e65-77d211013ad1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:26.634637 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b618f-8980-4435-9e65-77d211013ad1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:26.645754 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b618f-8980-4435-9e65-77d211013ad1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:26.651274 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b618f-8980-4435-9e65-77d211013ad1 service cinder] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:26.658687 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1341/2694] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:01:26 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:01:28.194680 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf330d2-91e5-406a-a633-cad9d7809b4f None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:28.195517 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf330d2-91e5-406a-a633-cad9d7809b4f None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:28.195517 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf330d2-91e5-406a-a633-cad9d7809b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:28.240333 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-fcf330d2-91e5-406a-a633-cad9d7809b4f None None] MFA Rules not processed for user `30dc2621143f4604b53bb44b82e8efbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:01:28.241915 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-fcf330d2-91e5-406a-a633-cad9d7809b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:28.342942 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1354/2695] 10.222.0.42 () {58 vars in 967 bytes} [Fri Aug 26 08:01:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:01:28.536589 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b618f-8980-4435-9e65-77d211013ad1 service cinder] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:28.540747 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-de7b618f-8980-4435-9e65-77d211013ad1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:28.659350 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:28.687889 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b618f-8980-4435-9e65-77d211013ad1 service cinder] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:28.693501 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e98c3c-1af4-4efb-b1bd-7638ab4694e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3142255c263e44a189db82c621f87e7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:28.694336 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e98c3c-1af4-4efb-b1bd-7638ab4694e3 service swift] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:28.694622 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e98c3c-1af4-4efb-b1bd-7638ab4694e3 service swift] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:28.694898 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e98c3c-1af4-4efb-b1bd-7638ab4694e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:28.704741 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e98c3c-1af4-4efb-b1bd-7638ab4694e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:28.706764 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e98c3c-1af4-4efb-b1bd-7638ab4694e3 service swift] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:28.717559 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1342/2696] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 26 08:01:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 08:01:32.600435 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf330d2-91e5-406a-a633-cad9d7809b4f None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:32.613276 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf330d2-91e5-406a-a633-cad9d7809b4f None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:32.619302 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b17002-5c4d-4945-8df4-65909c1454c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:32.620056 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b17002-5c4d-4945-8df4-65909c1454c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:32.620347 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b17002-5c4d-4945-8df4-65909c1454c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:32.620630 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b17002-5c4d-4945-8df4-65909c1454c6 admin admin] PATH_INFO: `/v3/users/acfced2d0350421e93b460c59b552f19` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:32.621944 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b17002-5c4d-4945-8df4-65909c1454c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acfced2d0350421e93b460c59b552f19)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:32.624037 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b17002-5c4d-4945-8df4-65909c1454c6 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:32.863824 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-60b17002-5c4d-4945-8df4-65909c1454c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acfced2d0350421e93b460c59b552f19'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:32.877131 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-60b17002-5c4d-4945-8df4-65909c1454c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acfced2d0350421e93b460c59b552f19'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:32.986420 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-60b17002-5c4d-4945-8df4-65909c1454c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acfced2d0350421e93b460c59b552f19'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:32.989075 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-60b17002-5c4d-4945-8df4-65909c1454c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acfced2d0350421e93b460c59b552f19'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:33.014369 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-60b17002-5c4d-4945-8df4-65909c1454c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acfced2d0350421e93b460c59b552f19'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:33.021550 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1355/2697] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 08:01:32 2022] DELETE /identity/v3/users/acfced2d0350421e93b460c59b552f19 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:01:33.026905 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cba32-140a-479e-87c3-842c9bb8f9ef None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:33.032052 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cba32-140a-479e-87c3-842c9bb8f9ef None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:33.032052 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cba32-140a-479e-87c3-842c9bb8f9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:33.059754 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-b08cba32-140a-479e-87c3-842c9bb8f9ef None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:01:33.060196 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-b08cba32-140a-479e-87c3-842c9bb8f9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:33.167119 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1343/2698] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:01:33.175251 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b17002-5c4d-4945-8df4-65909c1454c6 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:33.176777 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-60b17002-5c4d-4945-8df4-65909c1454c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:33.273071 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b17002-5c4d-4945-8df4-65909c1454c6 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:33.280183 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a49b46-69ca-448b-af44-2fec80de1d3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:33.281951 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a49b46-69ca-448b-af44-2fec80de1d3b service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:33.282340 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a49b46-69ca-448b-af44-2fec80de1d3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:33.282722 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a49b46-69ca-448b-af44-2fec80de1d3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:33.301227 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a49b46-69ca-448b-af44-2fec80de1d3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:33.306195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a49b46-69ca-448b-af44-2fec80de1d3b service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:33.313862 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:33.324485 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1356/2699] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:01:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 08:01:34.100006 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08cba32-140a-479e-87c3-842c9bb8f9ef None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:34.104931 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-b08cba32-140a-479e-87c3-842c9bb8f9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:34.160125 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08cba32-140a-479e-87c3-842c9bb8f9ef None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:34.170459 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb73594-83c7-43c7-b25b-ee51ba15306c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:34.171968 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb73594-83c7-43c7-b25b-ee51ba15306c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:34.172435 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb73594-83c7-43c7-b25b-ee51ba15306c admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:34.173710 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb73594-83c7-43c7-b25b-ee51ba15306c admin admin] PATH_INFO: `/v3/projects/da4c6647e2444ee38c1fca7aebb12d80` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:34.176660 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb73594-83c7-43c7-b25b-ee51ba15306c admin admin] RBAC: Authorizing `identity:delete_project(project_id=da4c6647e2444ee38c1fca7aebb12d80)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:34.181044 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb73594-83c7-43c7-b25b-ee51ba15306c admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:34.356874 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-feb73594-83c7-43c7-b25b-ee51ba15306c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da4c6647e2444ee38c1fca7aebb12d80', 'request_id': 'req-feb73594-83c7-43c7-b25b-ee51ba15306c'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:34.371620 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-feb73594-83c7-43c7-b25b-ee51ba15306c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da4c6647e2444ee38c1fca7aebb12d80', 'request_id': 'req-feb73594-83c7-43c7-b25b-ee51ba15306c'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:34.558369 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-feb73594-83c7-43c7-b25b-ee51ba15306c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da4c6647e2444ee38c1fca7aebb12d80', 'request_id': 'req-feb73594-83c7-43c7-b25b-ee51ba15306c'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:34.575629 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-feb73594-83c7-43c7-b25b-ee51ba15306c admin admin] The token cache is being invalidate because project da4c6647e2444ee38c1fca7aebb12d80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:01:34.575927 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-feb73594-83c7-43c7-b25b-ee51ba15306c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:34.576587 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-feb73594-83c7-43c7-b25b-ee51ba15306c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:34.578202 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1344/2700] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 08:01:34 2022] DELETE /identity/v3/projects/da4c6647e2444ee38c1fca7aebb12d80 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:01:34.584164 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a49b46-69ca-448b-af44-2fec80de1d3b service neutron] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:34.596987 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a49b46-69ca-448b-af44-2fec80de1d3b service neutron] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:34.666339 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c09384-aca9-455a-b4ec-8b9b62f0f176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:34.667268 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c09384-aca9-455a-b4ec-8b9b62f0f176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:34.667671 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c09384-aca9-455a-b4ec-8b9b62f0f176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:34.668040 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c09384-aca9-455a-b4ec-8b9b62f0f176 admin admin] PATH_INFO: `/v3/users/afd0d430500d46d0a598f97d25008fe6` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:34.669653 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c09384-aca9-455a-b4ec-8b9b62f0f176 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afd0d430500d46d0a598f97d25008fe6)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:34.672279 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c09384-aca9-455a-b4ec-8b9b62f0f176 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:34.961445 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-36c09384-aca9-455a-b4ec-8b9b62f0f176 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afd0d430500d46d0a598f97d25008fe6'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:34.970093 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-36c09384-aca9-455a-b4ec-8b9b62f0f176 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afd0d430500d46d0a598f97d25008fe6'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:35.082463 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-36c09384-aca9-455a-b4ec-8b9b62f0f176 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afd0d430500d46d0a598f97d25008fe6'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:35.083261 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-36c09384-aca9-455a-b4ec-8b9b62f0f176 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afd0d430500d46d0a598f97d25008fe6'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:35.100553 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-36c09384-aca9-455a-b4ec-8b9b62f0f176 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afd0d430500d46d0a598f97d25008fe6'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:35.110106 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1357/2701] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 08:01:34 2022] DELETE /identity/v3/users/afd0d430500d46d0a598f97d25008fe6 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:01:36.439407 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb73594-83c7-43c7-b25b-ee51ba15306c admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:36.441518 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-feb73594-83c7-43c7-b25b-ee51ba15306c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:36.534900 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb73594-83c7-43c7-b25b-ee51ba15306c admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:36.655903 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c030f7f-36bf-4569-8863-7cc2b018b99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:36.662099 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c030f7f-36bf-4569-8863-7cc2b018b99b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:36.662099 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c030f7f-36bf-4569-8863-7cc2b018b99b admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:36.662099 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c030f7f-36bf-4569-8863-7cc2b018b99b admin admin] PATH_INFO: `/v3/projects/b2379f9cf29f438e8a11defb4d9f4eef` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:36.662099 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c030f7f-36bf-4569-8863-7cc2b018b99b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2379f9cf29f438e8a11defb4d9f4eef)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:36.663126 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c030f7f-36bf-4569-8863-7cc2b018b99b admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:36.670822 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:36.856273 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-2c030f7f-36bf-4569-8863-7cc2b018b99b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2379f9cf29f438e8a11defb4d9f4eef', 'request_id': 'req-2c030f7f-36bf-4569-8863-7cc2b018b99b'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:36.869731 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-2c030f7f-36bf-4569-8863-7cc2b018b99b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2379f9cf29f438e8a11defb4d9f4eef', 'request_id': 'req-2c030f7f-36bf-4569-8863-7cc2b018b99b'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:36.996954 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-2c030f7f-36bf-4569-8863-7cc2b018b99b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2379f9cf29f438e8a11defb4d9f4eef', 'request_id': 'req-2c030f7f-36bf-4569-8863-7cc2b018b99b'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:37.019986 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-2c030f7f-36bf-4569-8863-7cc2b018b99b admin admin] The token cache is being invalidate because project b2379f9cf29f438e8a11defb4d9f4eef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:01:37.020239 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-2c030f7f-36bf-4569-8863-7cc2b018b99b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:37.021051 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-2c030f7f-36bf-4569-8863-7cc2b018b99b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:37.026582 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1345/2702] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 08:01:36 2022] DELETE /identity/v3/projects/b2379f9cf29f438e8a11defb4d9f4eef => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:01:37.031388 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c09384-aca9-455a-b4ec-8b9b62f0f176 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:37.036105 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-36c09384-aca9-455a-b4ec-8b9b62f0f176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:37.065290 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c09384-aca9-455a-b4ec-8b9b62f0f176 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:37.163041 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4159d9dc-e491-4822-ba19-72f693a1c102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:37.163856 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159d9dc-e491-4822-ba19-72f693a1c102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:37.164807 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159d9dc-e491-4822-ba19-72f693a1c102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:37.165424 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159d9dc-e491-4822-ba19-72f693a1c102 admin admin] PATH_INFO: `/v3/users/e7154b413906414f801ae9dfbd726617` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:37.166441 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4159d9dc-e491-4822-ba19-72f693a1c102 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7154b413906414f801ae9dfbd726617)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:37.168551 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4159d9dc-e491-4822-ba19-72f693a1c102 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:37.190489 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:37.493182 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-4159d9dc-e491-4822-ba19-72f693a1c102 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7154b413906414f801ae9dfbd726617'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:37.502613 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-4159d9dc-e491-4822-ba19-72f693a1c102 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7154b413906414f801ae9dfbd726617'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:37.653331 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-4159d9dc-e491-4822-ba19-72f693a1c102 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7154b413906414f801ae9dfbd726617'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:37.653331 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-4159d9dc-e491-4822-ba19-72f693a1c102 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7154b413906414f801ae9dfbd726617'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:37.681133 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-4159d9dc-e491-4822-ba19-72f693a1c102 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7154b413906414f801ae9dfbd726617'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:37.690451 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1358/2703] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 08:01:37 2022] DELETE /identity/v3/users/e7154b413906414f801ae9dfbd726617 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:01:38.759542 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c030f7f-36bf-4569-8863-7cc2b018b99b admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:38.766779 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-2c030f7f-36bf-4569-8863-7cc2b018b99b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:38.783372 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c030f7f-36bf-4569-8863-7cc2b018b99b admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:38.898737 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f07a21-7abc-4073-9908-ae2c74b1a4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:38.899709 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f07a21-7abc-4073-9908-ae2c74b1a4f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:38.900201 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f07a21-7abc-4073-9908-ae2c74b1a4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:38.901070 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f07a21-7abc-4073-9908-ae2c74b1a4f6 admin admin] PATH_INFO: `/v3/projects/8e769c9d2e7746e89141fa878694327f` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:38.903761 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f07a21-7abc-4073-9908-ae2c74b1a4f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e769c9d2e7746e89141fa878694327f)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:38.908448 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f07a21-7abc-4073-9908-ae2c74b1a4f6 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:39.130915 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-25f07a21-7abc-4073-9908-ae2c74b1a4f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e769c9d2e7746e89141fa878694327f', 'request_id': 'req-25f07a21-7abc-4073-9908-ae2c74b1a4f6'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:39.147902 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-25f07a21-7abc-4073-9908-ae2c74b1a4f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e769c9d2e7746e89141fa878694327f', 'request_id': 'req-25f07a21-7abc-4073-9908-ae2c74b1a4f6'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:39.281881 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-25f07a21-7abc-4073-9908-ae2c74b1a4f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e769c9d2e7746e89141fa878694327f', 'request_id': 'req-25f07a21-7abc-4073-9908-ae2c74b1a4f6'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:39.334430 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-25f07a21-7abc-4073-9908-ae2c74b1a4f6 admin admin] The token cache is being invalidate because project 8e769c9d2e7746e89141fa878694327f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:01:39.346970 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-25f07a21-7abc-4073-9908-ae2c74b1a4f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:39.346970 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-25f07a21-7abc-4073-9908-ae2c74b1a4f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:39.346970 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1346/2704] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 08:01:38 2022] DELETE /identity/v3/projects/8e769c9d2e7746e89141fa878694327f => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:01:39.894706 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4159d9dc-e491-4822-ba19-72f693a1c102 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:39.896261 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-4159d9dc-e491-4822-ba19-72f693a1c102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:39.914848 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4159d9dc-e491-4822-ba19-72f693a1c102 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:40.022118 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b94348e-8ae9-427f-a560-c87687217aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:40.022717 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94348e-8ae9-427f-a560-c87687217aab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:40.023095 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94348e-8ae9-427f-a560-c87687217aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:40.024324 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94348e-8ae9-427f-a560-c87687217aab admin admin] PATH_INFO: `/v3/users/c82f2803ed1447edab12e9ee905273ea` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:40.025685 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b94348e-8ae9-427f-a560-c87687217aab admin admin] RBAC: Authorizing `identity:delete_user(user_id=c82f2803ed1447edab12e9ee905273ea)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:40.027823 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b94348e-8ae9-427f-a560-c87687217aab admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:40.365161 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-4b94348e-8ae9-427f-a560-c87687217aab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c82f2803ed1447edab12e9ee905273ea'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:40.386820 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-4b94348e-8ae9-427f-a560-c87687217aab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c82f2803ed1447edab12e9ee905273ea'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:40.541291 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-4b94348e-8ae9-427f-a560-c87687217aab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c82f2803ed1447edab12e9ee905273ea'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:40.544578 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-4b94348e-8ae9-427f-a560-c87687217aab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c82f2803ed1447edab12e9ee905273ea'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:40.566068 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-4b94348e-8ae9-427f-a560-c87687217aab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c82f2803ed1447edab12e9ee905273ea'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:40.582420 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1359/2705] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 08:01:39 2022] DELETE /identity/v3/users/c82f2803ed1447edab12e9ee905273ea => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:01:40.806654 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f07a21-7abc-4073-9908-ae2c74b1a4f6 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:40.813160 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-25f07a21-7abc-4073-9908-ae2c74b1a4f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:40.833526 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f07a21-7abc-4073-9908-ae2c74b1a4f6 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:40.878429 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:40.921585 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7571f6-4edc-4976-b22c-b447d7e414af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:40.922192 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7571f6-4edc-4976-b22c-b447d7e414af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:40.922472 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7571f6-4edc-4976-b22c-b447d7e414af admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:40.922746 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7571f6-4edc-4976-b22c-b447d7e414af admin admin] PATH_INFO: `/v3/users/644c2e42856a4d7ba3c845409585ab88` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:40.923930 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7571f6-4edc-4976-b22c-b447d7e414af admin admin] RBAC: Authorizing `identity:delete_user(user_id=644c2e42856a4d7ba3c845409585ab88)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:40.925935 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7571f6-4edc-4976-b22c-b447d7e414af admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:41.047196 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b94348e-8ae9-427f-a560-c87687217aab admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:41.050164 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-4b94348e-8ae9-427f-a560-c87687217aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:41.093264 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b94348e-8ae9-427f-a560-c87687217aab admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:41.100221 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e66e1-dd01-454e-b369-d57a68a6ac0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:41.101119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e66e1-dd01-454e-b369-d57a68a6ac0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:41.101789 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e66e1-dd01-454e-b369-d57a68a6ac0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:41.102297 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e66e1-dd01-454e-b369-d57a68a6ac0a admin admin] PATH_INFO: `/v3/projects/17031b1ed4104b4fac9fe03aff41b0cd` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:41.104307 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e66e1-dd01-454e-b369-d57a68a6ac0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=17031b1ed4104b4fac9fe03aff41b0cd)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:41.106402 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e66e1-dd01-454e-b369-d57a68a6ac0a admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:41.121165 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:41.187724 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-df7571f6-4edc-4976-b22c-b447d7e414af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '644c2e42856a4d7ba3c845409585ab88'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:41.188381 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-df7571f6-4edc-4976-b22c-b447d7e414af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '644c2e42856a4d7ba3c845409585ab88'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:41.236530 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-2b3e66e1-dd01-454e-b369-d57a68a6ac0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17031b1ed4104b4fac9fe03aff41b0cd', 'request_id': 'req-2b3e66e1-dd01-454e-b369-d57a68a6ac0a'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:41.244427 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-2b3e66e1-dd01-454e-b369-d57a68a6ac0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17031b1ed4104b4fac9fe03aff41b0cd', 'request_id': 'req-2b3e66e1-dd01-454e-b369-d57a68a6ac0a'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:41.255547 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-2b3e66e1-dd01-454e-b369-d57a68a6ac0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17031b1ed4104b4fac9fe03aff41b0cd', 'request_id': 'req-2b3e66e1-dd01-454e-b369-d57a68a6ac0a'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:41.312022 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-df7571f6-4edc-4976-b22c-b447d7e414af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '644c2e42856a4d7ba3c845409585ab88'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:41.316437 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-df7571f6-4edc-4976-b22c-b447d7e414af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '644c2e42856a4d7ba3c845409585ab88'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:41.329914 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-df7571f6-4edc-4976-b22c-b447d7e414af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '644c2e42856a4d7ba3c845409585ab88'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:41.368492 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1347/2706] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 08:01:40 2022] DELETE /identity/v3/users/644c2e42856a4d7ba3c845409585ab88 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:01:41.420199 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-2b3e66e1-dd01-454e-b369-d57a68a6ac0a admin admin] The token cache is being invalidate because project 17031b1ed4104b4fac9fe03aff41b0cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:01:41.421041 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-2b3e66e1-dd01-454e-b369-d57a68a6ac0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:41.428074 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-2b3e66e1-dd01-454e-b369-d57a68a6ac0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:41.431981 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1360/2707] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 08:01:41 2022] DELETE /identity/v3/projects/17031b1ed4104b4fac9fe03aff41b0cd => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:01:41.440489 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7571f6-4edc-4976-b22c-b447d7e414af admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:41.442381 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-df7571f6-4edc-4976-b22c-b447d7e414af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:41.542933 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7571f6-4edc-4976-b22c-b447d7e414af admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:41.549279 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d0ed7-0939-4f92-a5e5-b73993237d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:41.550329 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d0ed7-0939-4f92-a5e5-b73993237d56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:41.550702 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d0ed7-0939-4f92-a5e5-b73993237d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:41.551010 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d0ed7-0939-4f92-a5e5-b73993237d56 admin admin] PATH_INFO: `/v3/users/217344fc9e414867b3a013674b529407` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:41.552314 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d0ed7-0939-4f92-a5e5-b73993237d56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=217344fc9e414867b3a013674b529407)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:41.554306 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d0ed7-0939-4f92-a5e5-b73993237d56 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:41.801886 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e66e1-dd01-454e-b369-d57a68a6ac0a admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:41.806871 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-2b3e66e1-dd01-454e-b369-d57a68a6ac0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:41.858926 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-1e1d0ed7-0939-4f92-a5e5-b73993237d56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '217344fc9e414867b3a013674b529407'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:41.863872 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-1e1d0ed7-0939-4f92-a5e5-b73993237d56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '217344fc9e414867b3a013674b529407'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:41.956576 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e66e1-dd01-454e-b369-d57a68a6ac0a admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:41.963332 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e5e18-9d00-4944-ad22-93751a39c886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:41.964582 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e5e18-9d00-4944-ad22-93751a39c886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:41.965176 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e5e18-9d00-4944-ad22-93751a39c886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:41.965771 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e5e18-9d00-4944-ad22-93751a39c886 admin admin] PATH_INFO: `/v3/projects/c19633b548bd47ad92f11fb4c1ff173a` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:41.967679 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e5e18-9d00-4944-ad22-93751a39c886 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c19633b548bd47ad92f11fb4c1ff173a)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:41.969765 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e5e18-9d00-4944-ad22-93751a39c886 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:41.986238 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-1e1d0ed7-0939-4f92-a5e5-b73993237d56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '217344fc9e414867b3a013674b529407'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:41.987173 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-1e1d0ed7-0939-4f92-a5e5-b73993237d56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '217344fc9e414867b3a013674b529407'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:42.005863 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-1e1d0ed7-0939-4f92-a5e5-b73993237d56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '217344fc9e414867b3a013674b529407'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:42.048818 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1348/2708] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 08:01:41 2022] DELETE /identity/v3/users/217344fc9e414867b3a013674b529407 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:01:42.268560 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-553e5e18-9d00-4944-ad22-93751a39c886 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c19633b548bd47ad92f11fb4c1ff173a', 'request_id': 'req-553e5e18-9d00-4944-ad22-93751a39c886'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:42.281769 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-553e5e18-9d00-4944-ad22-93751a39c886 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c19633b548bd47ad92f11fb4c1ff173a', 'request_id': 'req-553e5e18-9d00-4944-ad22-93751a39c886'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:42.295907 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-553e5e18-9d00-4944-ad22-93751a39c886 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c19633b548bd47ad92f11fb4c1ff173a', 'request_id': 'req-553e5e18-9d00-4944-ad22-93751a39c886'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:42.468140 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-553e5e18-9d00-4944-ad22-93751a39c886 admin admin] The token cache is being invalidate because project c19633b548bd47ad92f11fb4c1ff173a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:01:42.468732 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-553e5e18-9d00-4944-ad22-93751a39c886 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:42.469780 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-553e5e18-9d00-4944-ad22-93751a39c886 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:42.484241 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d0ed7-0939-4f92-a5e5-b73993237d56 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:42.486173 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-1e1d0ed7-0939-4f92-a5e5-b73993237d56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:42.495298 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1361/2709] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 08:01:41 2022] DELETE /identity/v3/projects/c19633b548bd47ad92f11fb4c1ff173a => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:01:42.672009 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d0ed7-0939-4f92-a5e5-b73993237d56 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:42.862125 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e85871-4cf7-4122-b032-7f2b254684ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:42.863204 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e85871-4cf7-4122-b032-7f2b254684ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:42.863633 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e85871-4cf7-4122-b032-7f2b254684ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:42.864098 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e85871-4cf7-4122-b032-7f2b254684ab admin admin] PATH_INFO: `/v3/users/f3a0b4860d9845ecab3f8e526c07a8c4` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:42.869447 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e85871-4cf7-4122-b032-7f2b254684ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3a0b4860d9845ecab3f8e526c07a8c4)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:42.873653 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e85871-4cf7-4122-b032-7f2b254684ab admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:42.878509 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:43.110093 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e5e18-9d00-4944-ad22-93751a39c886 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:43.112053 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-553e5e18-9d00-4944-ad22-93751a39c886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:43.130714 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e5e18-9d00-4944-ad22-93751a39c886 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:43.145765 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1efdefe-073a-4b00-a87a-b3bfd15201f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:43.146416 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efdefe-073a-4b00-a87a-b3bfd15201f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:43.146699 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efdefe-073a-4b00-a87a-b3bfd15201f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:43.146976 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efdefe-073a-4b00-a87a-b3bfd15201f3 admin admin] PATH_INFO: `/v3/projects/ba3c8244370545039094a60a261011c2` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:43.151834 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1efdefe-073a-4b00-a87a-b3bfd15201f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba3c8244370545039094a60a261011c2)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:43.162411 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1efdefe-073a-4b00-a87a-b3bfd15201f3 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:43.224804 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:43.376182 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-b5e85871-4cf7-4122-b032-7f2b254684ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3a0b4860d9845ecab3f8e526c07a8c4'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:43.379800 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-b5e85871-4cf7-4122-b032-7f2b254684ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3a0b4860d9845ecab3f8e526c07a8c4'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:43.412783 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-a1efdefe-073a-4b00-a87a-b3bfd15201f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba3c8244370545039094a60a261011c2', 'request_id': 'req-a1efdefe-073a-4b00-a87a-b3bfd15201f3'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:43.422961 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-a1efdefe-073a-4b00-a87a-b3bfd15201f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba3c8244370545039094a60a261011c2', 'request_id': 'req-a1efdefe-073a-4b00-a87a-b3bfd15201f3'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:43.437936 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-a1efdefe-073a-4b00-a87a-b3bfd15201f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba3c8244370545039094a60a261011c2', 'request_id': 'req-a1efdefe-073a-4b00-a87a-b3bfd15201f3'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:43.672184 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-b5e85871-4cf7-4122-b032-7f2b254684ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3a0b4860d9845ecab3f8e526c07a8c4'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:43.688006 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-b5e85871-4cf7-4122-b032-7f2b254684ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3a0b4860d9845ecab3f8e526c07a8c4'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:43.696881 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-b5e85871-4cf7-4122-b032-7f2b254684ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3a0b4860d9845ecab3f8e526c07a8c4'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:43.735860 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1349/2710] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 08:01:42 2022] DELETE /identity/v3/users/f3a0b4860d9845ecab3f8e526c07a8c4 => generated 0 bytes in 1252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:01:43.866182 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-a1efdefe-073a-4b00-a87a-b3bfd15201f3 admin admin] The token cache is being invalidate because project ba3c8244370545039094a60a261011c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:01:43.866828 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-a1efdefe-073a-4b00-a87a-b3bfd15201f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:43.869774 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-a1efdefe-073a-4b00-a87a-b3bfd15201f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:43.873545 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1362/2711] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 08:01:43 2022] DELETE /identity/v3/projects/ba3c8244370545039094a60a261011c2 => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:01:44.266687 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e85871-4cf7-4122-b032-7f2b254684ab admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:44.266687 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-b5e85871-4cf7-4122-b032-7f2b254684ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:44.366584 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e85871-4cf7-4122-b032-7f2b254684ab admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:44.374903 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e410d-b97a-4aba-b582-4f1b02556127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:44.375843 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e410d-b97a-4aba-b582-4f1b02556127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:44.376257 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e410d-b97a-4aba-b582-4f1b02556127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:44.376744 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e410d-b97a-4aba-b582-4f1b02556127 admin admin] PATH_INFO: `/v3/projects/e3b0c94adc1b40d38662c3b1d2ea9d90` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:44.378019 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e410d-b97a-4aba-b582-4f1b02556127 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3b0c94adc1b40d38662c3b1d2ea9d90)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:44.380473 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e410d-b97a-4aba-b582-4f1b02556127 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:44.607574 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-389e410d-b97a-4aba-b582-4f1b02556127 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3b0c94adc1b40d38662c3b1d2ea9d90', 'request_id': 'req-389e410d-b97a-4aba-b582-4f1b02556127'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:44.615356 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-389e410d-b97a-4aba-b582-4f1b02556127 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3b0c94adc1b40d38662c3b1d2ea9d90', 'request_id': 'req-389e410d-b97a-4aba-b582-4f1b02556127'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:44.751530 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-389e410d-b97a-4aba-b582-4f1b02556127 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3b0c94adc1b40d38662c3b1d2ea9d90', 'request_id': 'req-389e410d-b97a-4aba-b582-4f1b02556127'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:44.768781 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-389e410d-b97a-4aba-b582-4f1b02556127 admin admin] The token cache is being invalidate because project e3b0c94adc1b40d38662c3b1d2ea9d90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:01:44.769219 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-389e410d-b97a-4aba-b582-4f1b02556127 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:44.770014 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-389e410d-b97a-4aba-b582-4f1b02556127 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:44.772615 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1350/2712] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 08:01:44 2022] DELETE /identity/v3/projects/e3b0c94adc1b40d38662c3b1d2ea9d90 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:01:44.779401 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500475e-7046-4871-afe8-dff39e07dd14 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:44.780008 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500475e-7046-4871-afe8-dff39e07dd14 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:44.780008 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500475e-7046-4871-afe8-dff39e07dd14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:44.802143 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-e500475e-7046-4871-afe8-dff39e07dd14 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:01:44.803419 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-e500475e-7046-4871-afe8-dff39e07dd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:44.873361 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1363/2713] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:01:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:01:44.883638 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d90405-ddf0-43f1-8e0a-95513d8842f6 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:44.883972 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d90405-ddf0-43f1-8e0a-95513d8842f6 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:44.884309 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d90405-ddf0-43f1-8e0a-95513d8842f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:44.910195 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-85d90405-ddf0-43f1-8e0a-95513d8842f6 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:01:44.911546 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-85d90405-ddf0-43f1-8e0a-95513d8842f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:44.921800 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1351/2714] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:01:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:01:44.928305 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e500475e-7046-4871-afe8-dff39e07dd14 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:44.947308 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e500475e-7046-4871-afe8-dff39e07dd14 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:44.955922 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c1874-b96f-46ca-be2e-930b57dbbe6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:44.957341 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c1874-b96f-46ca-be2e-930b57dbbe6b admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:44.958094 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c1874-b96f-46ca-be2e-930b57dbbe6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:44.959439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c1874-b96f-46ca-be2e-930b57dbbe6b admin admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:44.962765 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c1874-b96f-46ca-be2e-930b57dbbe6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:01:44.963537 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c1874-b96f-46ca-be2e-930b57dbbe6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:44.966961 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c1874-b96f-46ca-be2e-930b57dbbe6b admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:44.995511 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1364/2715] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 08:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:01:45.002032 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d90405-ddf0-43f1-8e0a-95513d8842f6 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:45.014670 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d90405-ddf0-43f1-8e0a-95513d8842f6 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:45.022972 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2ecb3-acec-4ec4-93ea-ef7e54d4c9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:45.022972 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2ecb3-acec-4ec4-93ea-ef7e54d4c9e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:45.022972 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2ecb3-acec-4ec4-93ea-ef7e54d4c9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:45.024401 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2ecb3-acec-4ec4-93ea-ef7e54d4c9e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:45.024401 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2ecb3-acec-4ec4-93ea-ef7e54d4c9e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:45.027255 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2ecb3-acec-4ec4-93ea-ef7e54d4c9e6 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:45.324793 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1352/2716] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 08:01:45 2022] POST /identity/v3/projects => generated 373 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:01:45.329984 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c1874-b96f-46ca-be2e-930b57dbbe6b admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:45.350933 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c1874-b96f-46ca-be2e-930b57dbbe6b admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:45.432003 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcfd55a-9ab0-4491-a74e-33bda063f1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:45.433243 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfd55a-9ab0-4491-a74e-33bda063f1ee admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:45.433731 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfd55a-9ab0-4491-a74e-33bda063f1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:45.434005 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfd55a-9ab0-4491-a74e-33bda063f1ee admin admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:45.434648 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcfd55a-9ab0-4491-a74e-33bda063f1ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:45.436663 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcfd55a-9ab0-4491-a74e-33bda063f1ee admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:45.604522 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1365/2717] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 08:01:45 2022] POST /identity/v3/users => generated 287 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:01:45.609167 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2ecb3-acec-4ec4-93ea-ef7e54d4c9e6 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:45.627047 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2ecb3-acec-4ec4-93ea-ef7e54d4c9e6 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:45.633993 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d137a9e8-b795-4cb1-89ca-5d21fb8d3710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:45.634661 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137a9e8-b795-4cb1-89ca-5d21fb8d3710 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:45.634936 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137a9e8-b795-4cb1-89ca-5d21fb8d3710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:45.635309 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137a9e8-b795-4cb1-89ca-5d21fb8d3710 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:45.636170 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d137a9e8-b795-4cb1-89ca-5d21fb8d3710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:45.637663 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d137a9e8-b795-4cb1-89ca-5d21fb8d3710 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:45.659328 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1353/2718] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:01:45.665128 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcfd55a-9ab0-4491-a74e-33bda063f1ee admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:45.677889 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcfd55a-9ab0-4491-a74e-33bda063f1ee admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:45.686881 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689f4e3-c336-4bc6-ac88-0affc6db5703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:45.687647 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689f4e3-c336-4bc6-ac88-0affc6db5703 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:45.687939 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689f4e3-c336-4bc6-ac88-0affc6db5703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:45.688389 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689f4e3-c336-4bc6-ac88-0affc6db5703 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:45.690112 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f689f4e3-c336-4bc6-ac88-0affc6db5703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:45.709094 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f689f4e3-c336-4bc6-ac88-0affc6db5703 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:45.721630 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:45.731337 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1366/2719] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 08:01:45.737033 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d137a9e8-b795-4cb1-89ca-5d21fb8d3710 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:45.755588 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d137a9e8-b795-4cb1-89ca-5d21fb8d3710 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:45.761499 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f37704-3e85-4a14-9077-845286ca2084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:45.762386 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f37704-3e85-4a14-9077-845286ca2084 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:45.788121 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f37704-3e85-4a14-9077-845286ca2084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:45.788121 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f37704-3e85-4a14-9077-845286ca2084 admin admin] PATH_INFO: `/v3/projects/5b72e00de1784b519dba95570d91b93f/users/ce2074d37c88460a81de823540d0b70f/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:45.802574 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f37704-3e85-4a14-9077-845286ca2084 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b72e00de1784b519dba95570d91b93f, user_id=ce2074d37c88460a81de823540d0b70f, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:45.806674 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f37704-3e85-4a14-9077-845286ca2084 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:46.034903 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1354/2720] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 08:01:45 2022] PUT /identity/v3/projects/5b72e00de1784b519dba95570d91b93f/users/ce2074d37c88460a81de823540d0b70f/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:01:46.044498 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe6710-6e62-4b4a-a85a-e6e372e51373 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:46.045027 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe6710-6e62-4b4a-a85a-e6e372e51373 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:46.045198 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe6710-6e62-4b4a-a85a-e6e372e51373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:46.087166 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-bfbe6710-6e62-4b4a-a85a-e6e372e51373 None None] MFA Rules not processed for user `ce2074d37c88460a81de823540d0b70f`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:01:46.089837 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-bfbe6710-6e62-4b4a-a85a-e6e372e51373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:46.097505 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:46.171032 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1367/2721] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:01:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:01:46.176869 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f37704-3e85-4a14-9077-845286ca2084 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:46.222271 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe6710-6e62-4b4a-a85a-e6e372e51373 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:46.224085 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-bfbe6710-6e62-4b4a-a85a-e6e372e51373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:46.272338 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f37704-3e85-4a14-9077-845286ca2084 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:46.280507 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f8954-07c6-4fc9-a116-848913abe4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:46.281400 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f8954-07c6-4fc9-a116-848913abe4da admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:46.281837 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f8954-07c6-4fc9-a116-848913abe4da admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:46.282284 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f8954-07c6-4fc9-a116-848913abe4da admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:46.283378 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6f8954-07c6-4fc9-a116-848913abe4da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:46.286424 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6f8954-07c6-4fc9-a116-848913abe4da admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:46.320535 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe6710-6e62-4b4a-a85a-e6e372e51373 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:46.328826 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c673087-fe6e-4953-af94-ca21a837a673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:46.329384 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c673087-fe6e-4953-af94-ca21a837a673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:46.329662 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c673087-fe6e-4953-af94-ca21a837a673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:46.329930 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c673087-fe6e-4953-af94-ca21a837a673 admin admin] PATH_INFO: `/v3/users/53157861be9f45e6a6f4c5f1eeb3b6fc` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:46.331161 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c673087-fe6e-4953-af94-ca21a837a673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53157861be9f45e6a6f4c5f1eeb3b6fc)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:46.333086 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c673087-fe6e-4953-af94-ca21a837a673 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:46.504304 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1355/2722] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 08:01:46 2022] POST /identity/v3/projects => generated 375 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:01:46.508033 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f8954-07c6-4fc9-a116-848913abe4da admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:46.591163 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f8954-07c6-4fc9-a116-848913abe4da admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:46.596058 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f5be7-dc85-481f-bfe5-eca00f6f933b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:46.596639 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f5be7-dc85-481f-bfe5-eca00f6f933b admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:46.596920 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f5be7-dc85-481f-bfe5-eca00f6f933b admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:46.597196 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f5be7-dc85-481f-bfe5-eca00f6f933b admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:46.597831 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f5be7-dc85-481f-bfe5-eca00f6f933b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:46.599808 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f5be7-dc85-481f-bfe5-eca00f6f933b admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:46.807154 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1356/2723] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 08:01:46 2022] POST /identity/v3/users => generated 294 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:01:46.808509 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f5be7-dc85-481f-bfe5-eca00f6f933b admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:46.813592 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-7c673087-fe6e-4953-af94-ca21a837a673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53157861be9f45e6a6f4c5f1eeb3b6fc'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:46.819229 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f5be7-dc85-481f-bfe5-eca00f6f933b admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:46.823360 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-7c673087-fe6e-4953-af94-ca21a837a673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53157861be9f45e6a6f4c5f1eeb3b6fc'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:46.825500 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ca0c1-590f-4a70-8928-abbae4a42876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:46.826307 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ca0c1-590f-4a70-8928-abbae4a42876 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:46.826717 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ca0c1-590f-4a70-8928-abbae4a42876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:46.827214 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ca0c1-590f-4a70-8928-abbae4a42876 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:46.828138 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ca0c1-590f-4a70-8928-abbae4a42876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:46.829996 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ca0c1-590f-4a70-8928-abbae4a42876 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:46.844057 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1357/2724] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:01:46.854878 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ca0c1-590f-4a70-8928-abbae4a42876 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:46.865313 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ca0c1-590f-4a70-8928-abbae4a42876 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:46.870895 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c9d46-4a44-4d86-b4b5-d59b72966d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:46.871643 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c9d46-4a44-4d86-b4b5-d59b72966d49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:46.871908 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c9d46-4a44-4d86-b4b5-d59b72966d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:46.872181 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c9d46-4a44-4d86-b4b5-d59b72966d49 admin admin] PATH_INFO: `/v3/projects/4f7017896009488ea5648acbbc9af0c7/users/06aa9fdf6a894bb4b7f6c8a7159b5959/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:46.889475 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c9d46-4a44-4d86-b4b5-d59b72966d49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f7017896009488ea5648acbbc9af0c7, user_id=06aa9fdf6a894bb4b7f6c8a7159b5959, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:46.892170 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c9d46-4a44-4d86-b4b5-d59b72966d49 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:47.048137 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-7c673087-fe6e-4953-af94-ca21a837a673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53157861be9f45e6a6f4c5f1eeb3b6fc'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:47.048806 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-7c673087-fe6e-4953-af94-ca21a837a673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53157861be9f45e6a6f4c5f1eeb3b6fc'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:47.067025 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-7c673087-fe6e-4953-af94-ca21a837a673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53157861be9f45e6a6f4c5f1eeb3b6fc'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:47.074123 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1368/2725] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 08:01:46 2022] DELETE /identity/v3/users/53157861be9f45e6a6f4c5f1eeb3b6fc => generated 0 bytes in 852 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:01:47.152951 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1358/2726] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 08:01:46 2022] PUT /identity/v3/projects/4f7017896009488ea5648acbbc9af0c7/users/06aa9fdf6a894bb4b7f6c8a7159b5959/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:01:47.153753 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c673087-fe6e-4953-af94-ca21a837a673 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:47.155559 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-7c673087-fe6e-4953-af94-ca21a837a673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:47.250748 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c673087-fe6e-4953-af94-ca21a837a673 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:47.329864 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2fd46-a343-42a8-8d1d-d7401f8fe0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:47.330479 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2fd46-a343-42a8-8d1d-d7401f8fe0e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:47.330759 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2fd46-a343-42a8-8d1d-d7401f8fe0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:47.331207 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2fd46-a343-42a8-8d1d-d7401f8fe0e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:47.331738 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2fd46-a343-42a8-8d1d-d7401f8fe0e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:47.333375 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2fd46-a343-42a8-8d1d-d7401f8fe0e7 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:47.345812 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1369/2727] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 08:01:47.352411 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c9d46-4a44-4d86-b4b5-d59b72966d49 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:47.364357 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c9d46-4a44-4d86-b4b5-d59b72966d49 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:47.369108 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0dbb7b-6666-4f74-aa9b-a87a03ff9682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:47.369764 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0dbb7b-6666-4f74-aa9b-a87a03ff9682 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:47.370045 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0dbb7b-6666-4f74-aa9b-a87a03ff9682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:47.370340 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0dbb7b-6666-4f74-aa9b-a87a03ff9682 admin admin] PATH_INFO: `/v3/projects/4f7017896009488ea5648acbbc9af0c7/users/06aa9fdf6a894bb4b7f6c8a7159b5959/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:47.372345 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0dbb7b-6666-4f74-aa9b-a87a03ff9682 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f7017896009488ea5648acbbc9af0c7, user_id=06aa9fdf6a894bb4b7f6c8a7159b5959, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:47.374978 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0dbb7b-6666-4f74-aa9b-a87a03ff9682 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:47.385658 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1359/2728] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 08:01:47 2022] PUT /identity/v3/projects/4f7017896009488ea5648acbbc9af0c7/users/06aa9fdf6a894bb4b7f6c8a7159b5959/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:01:47.400322 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfd197-6426-4d7e-8044-d9cd8d439b33 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:47.400595 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfd197-6426-4d7e-8044-d9cd8d439b33 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:47.400861 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfd197-6426-4d7e-8044-d9cd8d439b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:47.442474 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-79bfd197-6426-4d7e-8044-d9cd8d439b33 None None] MFA Rules not processed for user `06aa9fdf6a894bb4b7f6c8a7159b5959`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:01:47.443907 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-79bfd197-6426-4d7e-8044-d9cd8d439b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:47.504004 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0dbb7b-6666-4f74-aa9b-a87a03ff9682 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:47.506262 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-de0dbb7b-6666-4f74-aa9b-a87a03ff9682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:47.534415 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1370/2729] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:01:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:01:47.548756 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bfd197-6426-4d7e-8044-d9cd8d439b33 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:47.551130 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-79bfd197-6426-4d7e-8044-d9cd8d439b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:47.601891 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0dbb7b-6666-4f74-aa9b-a87a03ff9682 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:47.609977 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8bddbb-dc28-4196-91fe-3b9c7bfa9272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:47.611046 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bddbb-dc28-4196-91fe-3b9c7bfa9272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:47.611534 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bddbb-dc28-4196-91fe-3b9c7bfa9272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:47.612000 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bddbb-dc28-4196-91fe-3b9c7bfa9272 admin admin] PATH_INFO: `/v3/projects/41d9c715141c46028f9a0da822bfea76` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:47.613776 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8bddbb-dc28-4196-91fe-3b9c7bfa9272 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41d9c715141c46028f9a0da822bfea76)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:47.615799 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8bddbb-dc28-4196-91fe-3b9c7bfa9272 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:47.638154 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bfd197-6426-4d7e-8044-d9cd8d439b33 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:47.644897 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890df2f-3f13-4c2d-99f3-acf2cd9b2ed8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:47.645824 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890df2f-3f13-4c2d-99f3-acf2cd9b2ed8 service cinder] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:47.646111 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890df2f-3f13-4c2d-99f3-acf2cd9b2ed8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:47.646425 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890df2f-3f13-4c2d-99f3-acf2cd9b2ed8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:47.648897 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-5890df2f-3f13-4c2d-99f3-acf2cd9b2ed8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:47.713079 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5890df2f-3f13-4c2d-99f3-acf2cd9b2ed8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:47.714608 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5890df2f-3f13-4c2d-99f3-acf2cd9b2ed8 service cinder] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:47.724482 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1371/2730] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:01:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 08:01:47.815419 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-2a8bddbb-dc28-4196-91fe-3b9c7bfa9272 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41d9c715141c46028f9a0da822bfea76', 'request_id': 'req-2a8bddbb-dc28-4196-91fe-3b9c7bfa9272'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:47.822443 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-2a8bddbb-dc28-4196-91fe-3b9c7bfa9272 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41d9c715141c46028f9a0da822bfea76', 'request_id': 'req-2a8bddbb-dc28-4196-91fe-3b9c7bfa9272'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:48.018206 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-2a8bddbb-dc28-4196-91fe-3b9c7bfa9272 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41d9c715141c46028f9a0da822bfea76', 'request_id': 'req-2a8bddbb-dc28-4196-91fe-3b9c7bfa9272'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:48.031082 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-2a8bddbb-dc28-4196-91fe-3b9c7bfa9272 admin admin] The token cache is being invalidate because project 41d9c715141c46028f9a0da822bfea76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:01:48.031451 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-2a8bddbb-dc28-4196-91fe-3b9c7bfa9272 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:48.032120 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-2a8bddbb-dc28-4196-91fe-3b9c7bfa9272 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:48.033668 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1360/2731] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 08:01:47 2022] DELETE /identity/v3/projects/41d9c715141c46028f9a0da822bfea76 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:01:48.037872 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890df2f-3f13-4c2d-99f3-acf2cd9b2ed8 service cinder] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:48.050097 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890df2f-3f13-4c2d-99f3-acf2cd9b2ed8 service cinder] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:48.110183 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c8a71-c40e-495a-ac98-4896d41688d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:48.110808 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c8a71-c40e-495a-ac98-4896d41688d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:48.111116 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c8a71-c40e-495a-ac98-4896d41688d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:48.111386 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c8a71-c40e-495a-ac98-4896d41688d4 admin admin] PATH_INFO: `/v3/users/72e21792024344a797796a53d9131cef` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:48.112500 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c8a71-c40e-495a-ac98-4896d41688d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72e21792024344a797796a53d9131cef)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:48.115477 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c8a71-c40e-495a-ac98-4896d41688d4 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:48.517779 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-c61c8a71-c40e-495a-ac98-4896d41688d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72e21792024344a797796a53d9131cef'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:48.525484 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-c61c8a71-c40e-495a-ac98-4896d41688d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72e21792024344a797796a53d9131cef'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:48.704517 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-c61c8a71-c40e-495a-ac98-4896d41688d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72e21792024344a797796a53d9131cef'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:48.705828 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-c61c8a71-c40e-495a-ac98-4896d41688d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72e21792024344a797796a53d9131cef'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:48.725539 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-c61c8a71-c40e-495a-ac98-4896d41688d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72e21792024344a797796a53d9131cef'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:48.733022 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1372/2732] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 08:01:48 2022] DELETE /identity/v3/users/72e21792024344a797796a53d9131cef => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:01:49.056071 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8bddbb-dc28-4196-91fe-3b9c7bfa9272 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:49.057880 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-2a8bddbb-dc28-4196-91fe-3b9c7bfa9272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:49.090056 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8bddbb-dc28-4196-91fe-3b9c7bfa9272 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:49.165549 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9abdb3a-c776-4e72-80ce-1be4e3b3e50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:49.166221 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abdb3a-c776-4e72-80ce-1be4e3b3e50f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:49.166481 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abdb3a-c776-4e72-80ce-1be4e3b3e50f admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:49.166753 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abdb3a-c776-4e72-80ce-1be4e3b3e50f admin admin] PATH_INFO: `/v3/projects/380b9ff2b1b74aada9b6d486e2cbe07d` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:49.167932 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9abdb3a-c776-4e72-80ce-1be4e3b3e50f admin admin] RBAC: Authorizing `identity:delete_project(project_id=380b9ff2b1b74aada9b6d486e2cbe07d)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:49.169877 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9abdb3a-c776-4e72-80ce-1be4e3b3e50f admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:49.304859 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-f9abdb3a-c776-4e72-80ce-1be4e3b3e50f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '380b9ff2b1b74aada9b6d486e2cbe07d', 'request_id': 'req-f9abdb3a-c776-4e72-80ce-1be4e3b3e50f'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:49.312339 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-f9abdb3a-c776-4e72-80ce-1be4e3b3e50f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '380b9ff2b1b74aada9b6d486e2cbe07d', 'request_id': 'req-f9abdb3a-c776-4e72-80ce-1be4e3b3e50f'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:49.407164 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-f9abdb3a-c776-4e72-80ce-1be4e3b3e50f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '380b9ff2b1b74aada9b6d486e2cbe07d', 'request_id': 'req-f9abdb3a-c776-4e72-80ce-1be4e3b3e50f'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:49.421181 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-f9abdb3a-c776-4e72-80ce-1be4e3b3e50f admin admin] The token cache is being invalidate because project 380b9ff2b1b74aada9b6d486e2cbe07d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:01:49.421465 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-f9abdb3a-c776-4e72-80ce-1be4e3b3e50f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:49.422258 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-f9abdb3a-c776-4e72-80ce-1be4e3b3e50f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:49.423807 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1361/2733] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 08:01:49 2022] DELETE /identity/v3/projects/380b9ff2b1b74aada9b6d486e2cbe07d => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:01:49.902363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c8a71-c40e-495a-ac98-4896d41688d4 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:49.904009 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-c61c8a71-c40e-495a-ac98-4896d41688d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:49.976916 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c8a71-c40e-495a-ac98-4896d41688d4 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:50.042598 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279805a-ed31-4083-9beb-9a485512b46e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:50.043269 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279805a-ed31-4083-9beb-9a485512b46e service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:50.043552 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279805a-ed31-4083-9beb-9a485512b46e service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:50.043828 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279805a-ed31-4083-9beb-9a485512b46e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:50.045777 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-0279805a-ed31-4083-9beb-9a485512b46e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:50.135852 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279805a-ed31-4083-9beb-9a485512b46e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:50.138230 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279805a-ed31-4083-9beb-9a485512b46e service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:50.156731 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1373/2734] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:01:49 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:01:50.287200 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:51.302280 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:51.909136 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9abdb3a-c776-4e72-80ce-1be4e3b3e50f admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:51.911641 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-f9abdb3a-c776-4e72-80ce-1be4e3b3e50f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:52.006141 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9abdb3a-c776-4e72-80ce-1be4e3b3e50f admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:52.011840 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff8d3b-312f-4656-a893-81a29e592a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:52.012526 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff8d3b-312f-4656-a893-81a29e592a19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:52.012802 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff8d3b-312f-4656-a893-81a29e592a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:52.013254 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff8d3b-312f-4656-a893-81a29e592a19 admin admin] PATH_INFO: `/v3/users/ce2074d37c88460a81de823540d0b70f` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:52.014431 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff8d3b-312f-4656-a893-81a29e592a19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce2074d37c88460a81de823540d0b70f)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:52.016400 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff8d3b-312f-4656-a893-81a29e592a19 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:52.332507 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-98ff8d3b-312f-4656-a893-81a29e592a19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce2074d37c88460a81de823540d0b70f'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:52.333268 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-98ff8d3b-312f-4656-a893-81a29e592a19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce2074d37c88460a81de823540d0b70f'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:52.441532 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-98ff8d3b-312f-4656-a893-81a29e592a19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce2074d37c88460a81de823540d0b70f'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:52.442345 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-98ff8d3b-312f-4656-a893-81a29e592a19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce2074d37c88460a81de823540d0b70f'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:52.452443 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-98ff8d3b-312f-4656-a893-81a29e592a19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce2074d37c88460a81de823540d0b70f'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:52.479426 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1362/2735] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 08:01:51 2022] DELETE /identity/v3/users/ce2074d37c88460a81de823540d0b70f => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:01:52.484041 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91bd3f-bd2d-40e4-829f-d842ec7c147a None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:52.484575 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91bd3f-bd2d-40e4-829f-d842ec7c147a None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:52.484699 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91bd3f-bd2d-40e4-829f-d842ec7c147a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:52.506397 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-af91bd3f-bd2d-40e4-829f-d842ec7c147a None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:01:52.507906 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-af91bd3f-bd2d-40e4-829f-d842ec7c147a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:52.609860 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1374/2736] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:01:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:01:52.623138 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff8d3b-312f-4656-a893-81a29e592a19 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:52.625727 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-98ff8d3b-312f-4656-a893-81a29e592a19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:52.718927 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff8d3b-312f-4656-a893-81a29e592a19 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:52.730278 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f38d2-6314-4b6b-a60d-ac767ef61508 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:52.741933 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f38d2-6314-4b6b-a60d-ac767ef61508 service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:52.741933 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f38d2-6314-4b6b-a60d-ac767ef61508 service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:52.741933 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f38d2-6314-4b6b-a60d-ac767ef61508 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:52.747841 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f38d2-6314-4b6b-a60d-ac767ef61508 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:52.750689 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f38d2-6314-4b6b-a60d-ac767ef61508 service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:52.767080 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1363/2737] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:01:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:01:53.102052 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:53.225450 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=100 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:53.535020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91bd3f-bd2d-40e4-829f-d842ec7c147a None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:53.537624 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-af91bd3f-bd2d-40e4-829f-d842ec7c147a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:53.566022 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91bd3f-bd2d-40e4-829f-d842ec7c147a None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:53.574348 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e325f4-88a3-42ef-a331-70194a8d6c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:53.576708 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e325f4-88a3-42ef-a331-70194a8d6c20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:53.576708 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e325f4-88a3-42ef-a331-70194a8d6c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:53.577050 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e325f4-88a3-42ef-a331-70194a8d6c20 admin admin] PATH_INFO: `/v3/projects/5b72e00de1784b519dba95570d91b93f` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:53.579269 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e325f4-88a3-42ef-a331-70194a8d6c20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b72e00de1784b519dba95570d91b93f)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:53.582980 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e325f4-88a3-42ef-a331-70194a8d6c20 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:53.660794 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:53.792810 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-f9e325f4-88a3-42ef-a331-70194a8d6c20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b72e00de1784b519dba95570d91b93f', 'request_id': 'req-f9e325f4-88a3-42ef-a331-70194a8d6c20'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:53.799587 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-f9e325f4-88a3-42ef-a331-70194a8d6c20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b72e00de1784b519dba95570d91b93f', 'request_id': 'req-f9e325f4-88a3-42ef-a331-70194a8d6c20'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:53.807977 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-f9e325f4-88a3-42ef-a331-70194a8d6c20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b72e00de1784b519dba95570d91b93f', 'request_id': 'req-f9e325f4-88a3-42ef-a331-70194a8d6c20'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:53.954802 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-f9e325f4-88a3-42ef-a331-70194a8d6c20 admin admin] The token cache is being invalidate because project 5b72e00de1784b519dba95570d91b93f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:01:53.955386 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-f9e325f4-88a3-42ef-a331-70194a8d6c20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:53.956665 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-f9e325f4-88a3-42ef-a331-70194a8d6c20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:53.959920 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1375/2738] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 08:01:53 2022] DELETE /identity/v3/projects/5b72e00de1784b519dba95570d91b93f => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:01:53.969461 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f38d2-6314-4b6b-a60d-ac767ef61508 service neutron] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:53.984487 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f38d2-6314-4b6b-a60d-ac767ef61508 service neutron] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:54.013935 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:54.068817 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03418253-acf6-49d1-a258-194746e581dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:54.070697 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03418253-acf6-49d1-a258-194746e581dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:54.070697 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03418253-acf6-49d1-a258-194746e581dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:54.071164 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03418253-acf6-49d1-a258-194746e581dd admin admin] PATH_INFO: `/v3/users/06aa9fdf6a894bb4b7f6c8a7159b5959` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:54.075783 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03418253-acf6-49d1-a258-194746e581dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=06aa9fdf6a894bb4b7f6c8a7159b5959)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:54.075783 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03418253-acf6-49d1-a258-194746e581dd admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:54.413963 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-03418253-acf6-49d1-a258-194746e581dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06aa9fdf6a894bb4b7f6c8a7159b5959'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:54.414648 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-03418253-acf6-49d1-a258-194746e581dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06aa9fdf6a894bb4b7f6c8a7159b5959'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:54.597803 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-03418253-acf6-49d1-a258-194746e581dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06aa9fdf6a894bb4b7f6c8a7159b5959'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:54.598896 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-03418253-acf6-49d1-a258-194746e581dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06aa9fdf6a894bb4b7f6c8a7159b5959'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:54.608330 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-03418253-acf6-49d1-a258-194746e581dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06aa9fdf6a894bb4b7f6c8a7159b5959'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:54.630543 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1364/2739] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 08:01:53 2022] DELETE /identity/v3/users/06aa9fdf6a894bb4b7f6c8a7159b5959 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:01:55.141467 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:55.211337 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e325f4-88a3-42ef-a331-70194a8d6c20 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:55.213232 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-f9e325f4-88a3-42ef-a331-70194a8d6c20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:55.227690 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e325f4-88a3-42ef-a331-70194a8d6c20 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:55.289949 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62908a-cfcf-4b64-96a4-2abd7c556a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:55.290621 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62908a-cfcf-4b64-96a4-2abd7c556a7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:55.290898 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62908a-cfcf-4b64-96a4-2abd7c556a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:55.291201 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62908a-cfcf-4b64-96a4-2abd7c556a7e admin admin] PATH_INFO: `/v3/projects/4f7017896009488ea5648acbbc9af0c7` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:55.292361 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad62908a-cfcf-4b64-96a4-2abd7c556a7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f7017896009488ea5648acbbc9af0c7)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:55.294671 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad62908a-cfcf-4b64-96a4-2abd7c556a7e admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:55.328584 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:55.438583 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-ad62908a-cfcf-4b64-96a4-2abd7c556a7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f7017896009488ea5648acbbc9af0c7', 'request_id': 'req-ad62908a-cfcf-4b64-96a4-2abd7c556a7e'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:55.445836 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-ad62908a-cfcf-4b64-96a4-2abd7c556a7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f7017896009488ea5648acbbc9af0c7', 'request_id': 'req-ad62908a-cfcf-4b64-96a4-2abd7c556a7e'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:55.453002 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-ad62908a-cfcf-4b64-96a4-2abd7c556a7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f7017896009488ea5648acbbc9af0c7', 'request_id': 'req-ad62908a-cfcf-4b64-96a4-2abd7c556a7e'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:55.700525 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-ad62908a-cfcf-4b64-96a4-2abd7c556a7e admin admin] The token cache is being invalidate because project 4f7017896009488ea5648acbbc9af0c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:01:55.700869 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-ad62908a-cfcf-4b64-96a4-2abd7c556a7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:55.701428 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-ad62908a-cfcf-4b64-96a4-2abd7c556a7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:01:55.703164 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1376/2740] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 08:01:55 2022] DELETE /identity/v3/projects/4f7017896009488ea5648acbbc9af0c7 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:01:55.708125 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f122c-ef59-4bb0-b1e4-e7a958b14409 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:55.710781 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f122c-ef59-4bb0-b1e4-e7a958b14409 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:55.710781 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f122c-ef59-4bb0-b1e4-e7a958b14409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:55.734801 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-838f122c-ef59-4bb0-b1e4-e7a958b14409 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:01:55.736466 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-838f122c-ef59-4bb0-b1e4-e7a958b14409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:55.800668 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1365/2741] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:01:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:01:55.869833 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc3f87-b536-443b-9ec4-239dd8e219cd None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:55.870450 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc3f87-b536-443b-9ec4-239dd8e219cd None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:55.870801 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc3f87-b536-443b-9ec4-239dd8e219cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:55.897485 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-76cc3f87-b536-443b-9ec4-239dd8e219cd None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:01:55.898779 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-76cc3f87-b536-443b-9ec4-239dd8e219cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:55.906873 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1377/2742] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:01:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:01:55.911228 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f122c-ef59-4bb0-b1e4-e7a958b14409 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:55.931251 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f122c-ef59-4bb0-b1e4-e7a958b14409 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:55.936718 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59dc8c-6960-4690-bcdf-49472197c24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:55.937345 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59dc8c-6960-4690-bcdf-49472197c24a admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:55.937624 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59dc8c-6960-4690-bcdf-49472197c24a admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:55.937895 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59dc8c-6960-4690-bcdf-49472197c24a admin admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:55.938555 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59dc8c-6960-4690-bcdf-49472197c24a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:01:55.938860 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59dc8c-6960-4690-bcdf-49472197c24a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:55.940524 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59dc8c-6960-4690-bcdf-49472197c24a admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:55.953880 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1366/2743] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 08:01:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 08:01:55.962157 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc3f87-b536-443b-9ec4-239dd8e219cd None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:55.972015 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc3f87-b536-443b-9ec4-239dd8e219cd None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:55.977273 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d201e3-39cd-474d-bf17-600dc0986588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:55.977887 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d201e3-39cd-474d-bf17-600dc0986588 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:55.978157 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d201e3-39cd-474d-bf17-600dc0986588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:55.978431 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d201e3-39cd-474d-bf17-600dc0986588 admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:55.979090 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d201e3-39cd-474d-bf17-600dc0986588 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:55.980995 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d201e3-39cd-474d-bf17-600dc0986588 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:56.118412 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1378/2744] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 08:01:55 2022] POST /identity/v3/projects => generated 373 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:01:56.123997 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59dc8c-6960-4690-bcdf-49472197c24a admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:56.137404 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59dc8c-6960-4690-bcdf-49472197c24a admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:56.158026 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:56.209643 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13606502-53b0-46a0-b19d-050b014b2a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:56.210622 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13606502-53b0-46a0-b19d-050b014b2a7f admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:56.211180 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13606502-53b0-46a0-b19d-050b014b2a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:56.211458 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13606502-53b0-46a0-b19d-050b014b2a7f admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:56.212129 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13606502-53b0-46a0-b19d-050b014b2a7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:56.214180 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13606502-53b0-46a0-b19d-050b014b2a7f admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:56.340815 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1367/2745] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 08:01:56 2022] POST /identity/v3/users => generated 287 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:01:56.345242 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d201e3-39cd-474d-bf17-600dc0986588 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:56.356472 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d201e3-39cd-474d-bf17-600dc0986588 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:56.361168 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e50a7-a776-47c9-b1e4-6584dcfd7b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:56.361881 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e50a7-a776-47c9-b1e4-6584dcfd7b6d admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:56.362164 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e50a7-a776-47c9-b1e4-6584dcfd7b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:56.362442 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e50a7-a776-47c9-b1e4-6584dcfd7b6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:56.363127 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e50a7-a776-47c9-b1e4-6584dcfd7b6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:56.364725 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e50a7-a776-47c9-b1e4-6584dcfd7b6d admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:56.378387 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1379/2746] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:01:56.384259 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13606502-53b0-46a0-b19d-050b014b2a7f admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:56.395583 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13606502-53b0-46a0-b19d-050b014b2a7f admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:56.401153 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85133a5-7b35-4804-afa2-bca13b5faf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:56.401785 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85133a5-7b35-4804-afa2-bca13b5faf07 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:56.402088 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85133a5-7b35-4804-afa2-bca13b5faf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:56.402400 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85133a5-7b35-4804-afa2-bca13b5faf07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:56.403043 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85133a5-7b35-4804-afa2-bca13b5faf07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:56.404659 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85133a5-7b35-4804-afa2-bca13b5faf07 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:56.416552 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1368/2747] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:01:56.421300 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e50a7-a776-47c9-b1e4-6584dcfd7b6d admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:56.433250 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e50a7-a776-47c9-b1e4-6584dcfd7b6d admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:56.437805 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da69b49-c98b-488f-9783-ef9f9cd3832a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:56.441237 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da69b49-c98b-488f-9783-ef9f9cd3832a admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:56.441237 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da69b49-c98b-488f-9783-ef9f9cd3832a admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:56.441237 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da69b49-c98b-488f-9783-ef9f9cd3832a admin admin] PATH_INFO: `/v3/projects/44e67507b3444444993c6b88ff2fa32e/users/8bb969b468a34c6c98d28e21492c988a/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:56.448890 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:01:56.455917 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da69b49-c98b-488f-9783-ef9f9cd3832a admin admin] RBAC: Authorizing `identity:create_grant(project_id=44e67507b3444444993c6b88ff2fa32e, user_id=8bb969b468a34c6c98d28e21492c988a, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:56.458686 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da69b49-c98b-488f-9783-ef9f9cd3832a admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:56.581694 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1380/2748] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 08:01:56 2022] PUT /identity/v3/projects/44e67507b3444444993c6b88ff2fa32e/users/8bb969b468a34c6c98d28e21492c988a/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:01:56.589792 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f5d10-69ce-41da-b885-f03e2a6e130d None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:56.590208 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f5d10-69ce-41da-b885-f03e2a6e130d None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:56.590674 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f5d10-69ce-41da-b885-f03e2a6e130d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:56.620213 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-408f5d10-69ce-41da-b885-f03e2a6e130d None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:01:56.621452 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-408f5d10-69ce-41da-b885-f03e2a6e130d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:56.685052 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1369/2749] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:01:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:01:56.695380 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da69b49-c98b-488f-9783-ef9f9cd3832a admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:56.697358 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-6da69b49-c98b-488f-9783-ef9f9cd3832a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:56.763655 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da69b49-c98b-488f-9783-ef9f9cd3832a admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:56.769141 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1926b5d0-c564-4117-a400-1ee3078668a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:56.770156 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926b5d0-c564-4117-a400-1ee3078668a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:56.770642 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926b5d0-c564-4117-a400-1ee3078668a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:56.771706 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926b5d0-c564-4117-a400-1ee3078668a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:56.781673 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1926b5d0-c564-4117-a400-1ee3078668a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:56.783154 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1926b5d0-c564-4117-a400-1ee3078668a9 service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:56.793752 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1381/2750] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:01:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:01:59.321180 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd2945-fa2e-457a-bea3-a96235871436 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:59.325657 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd2945-fa2e-457a-bea3-a96235871436 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:59.325657 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd2945-fa2e-457a-bea3-a96235871436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:59.357567 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-5efd2945-fa2e-457a-bea3-a96235871436 None None] MFA Rules not processed for user `8bb969b468a34c6c98d28e21492c988a`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:01:59.358890 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-5efd2945-fa2e-457a-bea3-a96235871436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:59.434347 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1370/2751] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:01:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:01:59.447781 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1926b5d0-c564-4117-a400-1ee3078668a9 service neutron] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:01:59.447781 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-1926b5d0-c564-4117-a400-1ee3078668a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:01:59.525823 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1926b5d0-c564-4117-a400-1ee3078668a9 service neutron] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:01:59.529685 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0785c688-0fb2-4456-b742-50f2c117883d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:01:59.530304 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785c688-0fb2-4456-b742-50f2c117883d service cinder] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:01:59.530580 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785c688-0fb2-4456-b742-50f2c117883d service cinder] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:01:59.530851 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785c688-0fb2-4456-b742-50f2c117883d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:01:59.540795 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0785c688-0fb2-4456-b742-50f2c117883d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:01:59.542239 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0785c688-0fb2-4456-b742-50f2c117883d service cinder] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:01:59.553600 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1382/2752] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:01:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:02:01.611874 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e9a86-a6be-4f10-baef-681513e222e3 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:02:01.612402 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e9a86-a6be-4f10-baef-681513e222e3 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:02:01.612508 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e9a86-a6be-4f10-baef-681513e222e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:02:01.633796 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-a56e9a86-a6be-4f10-baef-681513e222e3 None None] MFA Rules not processed for user `8bb969b468a34c6c98d28e21492c988a`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:02:01.635116 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-a56e9a86-a6be-4f10-baef-681513e222e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:02:01.642278 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1371/2753] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:02:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:02:01.685072 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0785c688-0fb2-4456-b742-50f2c117883d service cinder] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:02:01.686364 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-0785c688-0fb2-4456-b742-50f2c117883d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:02:01.772769 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0785c688-0fb2-4456-b742-50f2c117883d service cinder] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:02:01.778343 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028a92f-1f9d-4bad-a8dd-07dfcde53f22 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df7725203304d8fbe3a768656cabf23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:02:01.779496 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028a92f-1f9d-4bad-a8dd-07dfcde53f22 service glance] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:02:01.780132 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028a92f-1f9d-4bad-a8dd-07dfcde53f22 service glance] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:02:01.780618 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028a92f-1f9d-4bad-a8dd-07dfcde53f22 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:02:01.782828 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-f028a92f-1f9d-4bad-a8dd-07dfcde53f22 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:02:01.840525 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:02:01.885872 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f028a92f-1f9d-4bad-a8dd-07dfcde53f22 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:02:01.887658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f028a92f-1f9d-4bad-a8dd-07dfcde53f22 service glance] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:02:01.926212 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1383/2754] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:02:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 08:02:02.964601 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e9a86-a6be-4f10-baef-681513e222e3 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:02:02.979260 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e9a86-a6be-4f10-baef-681513e222e3 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:02:02.988105 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb07005-6737-491d-b9d4-b1b8c7294b68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:02:02.988827 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb07005-6737-491d-b9d4-b1b8c7294b68 service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:02:02.989052 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb07005-6737-491d-b9d4-b1b8c7294b68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:02:02.989328 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb07005-6737-491d-b9d4-b1b8c7294b68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:02:02.991213 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-2bb07005-6737-491d-b9d4-b1b8c7294b68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:02:03.009328 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb07005-6737-491d-b9d4-b1b8c7294b68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:02:03.010973 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb07005-6737-491d-b9d4-b1b8c7294b68 service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:02:03.026727 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1372/2755] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:02:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:02:12.283281 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=22 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:02:13.028664 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:02:14.033573 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc7e67-9112-41a0-8f50-60035f7054ad None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:02:14.034119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc7e67-9112-41a0-8f50-60035f7054ad None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:02:14.034119 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc7e67-9112-41a0-8f50-60035f7054ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:02:14.054125 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-18dc7e67-9112-41a0-8f50-60035f7054ad None None] MFA Rules not processed for user `d0e5d7a2d5604c4fbc1ea74f4a263e79`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:02:14.055411 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-18dc7e67-9112-41a0-8f50-60035f7054ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:02:14.113476 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1384/2756] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:02:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:02:24.106091 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=25 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:02:25.122255 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed389680-0b11-42d6-b7dd-9938e7d799bf None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:02:25.122824 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed389680-0b11-42d6-b7dd-9938e7d799bf None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:02:25.122824 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed389680-0b11-42d6-b7dd-9938e7d799bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:02:25.142403 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-ed389680-0b11-42d6-b7dd-9938e7d799bf None None] MFA Rules not processed for user `8bb969b468a34c6c98d28e21492c988a`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:02:25.143657 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-ed389680-0b11-42d6-b7dd-9938e7d799bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:02:25.153733 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1373/2757] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:02:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:02:25.432729 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc7e67-9112-41a0-8f50-60035f7054ad None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:02:25.434598 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-18dc7e67-9112-41a0-8f50-60035f7054ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:02:25.449255 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc7e67-9112-41a0-8f50-60035f7054ad None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:02:25.453187 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb47340-04c5-40b1-b806-7d5dc5345c93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:02:25.453814 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb47340-04c5-40b1-b806-7d5dc5345c93 service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:02:25.454094 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb47340-04c5-40b1-b806-7d5dc5345c93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:02:25.454378 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb47340-04c5-40b1-b806-7d5dc5345c93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:02:25.456260 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-ccb47340-04c5-40b1-b806-7d5dc5345c93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:02:25.469027 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb47340-04c5-40b1-b806-7d5dc5345c93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:02:25.470489 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb47340-04c5-40b1-b806-7d5dc5345c93 service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:02:25.480421 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1385/2758] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:02:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:02:26.046542 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed389680-0b11-42d6-b7dd-9938e7d799bf None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:02:26.048751 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-ed389680-0b11-42d6-b7dd-9938e7d799bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:02:26.147110 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed389680-0b11-42d6-b7dd-9938e7d799bf None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:02:26.152189 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf291f05-68ea-4334-99f4-b36947d0fcd4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c2bc293f1b4daca83e8d6dff66a316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:02:26.152814 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf291f05-68ea-4334-99f4-b36947d0fcd4 service placement] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:02:26.153104 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf291f05-68ea-4334-99f4-b36947d0fcd4 service placement] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:02:26.153358 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf291f05-68ea-4334-99f4-b36947d0fcd4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:02:26.155160 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-bf291f05-68ea-4334-99f4-b36947d0fcd4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:02:26.167969 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf291f05-68ea-4334-99f4-b36947d0fcd4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:02:26.169590 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf291f05-68ea-4334-99f4-b36947d0fcd4 service placement] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:02:26.182043 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1374/2759] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:02:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 08:02:30.485999 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb47340-04c5-40b1-b806-7d5dc5345c93 service neutron] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:02:30.501927 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb47340-04c5-40b1-b806-7d5dc5345c93 service neutron] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:02:30.516145 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9834a-33e3-4497-ae51-2c6dedb38ea0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:02:30.517222 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9834a-33e3-4497-ae51-2c6dedb38ea0 service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:02:30.517717 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9834a-33e3-4497-ae51-2c6dedb38ea0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:02:30.518199 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9834a-33e3-4497-ae51-2c6dedb38ea0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:02:30.520299 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-90f9834a-33e3-4497-ae51-2c6dedb38ea0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:02:30.534170 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9834a-33e3-4497-ae51-2c6dedb38ea0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:02:30.536085 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9834a-33e3-4497-ae51-2c6dedb38ea0 service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:02:30.553083 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1386/2760] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:02:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:02:33.866961 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf291f05-68ea-4334-99f4-b36947d0fcd4 service placement] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:02:33.869244 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-bf291f05-68ea-4334-99f4-b36947d0fcd4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:02:33.894208 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf291f05-68ea-4334-99f4-b36947d0fcd4 service placement] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:02:33.903948 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a713f-d0f9-478a-b921-ac140061b905 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc92c0a0a2cc4722868e6877bac93ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:02:33.905074 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a713f-d0f9-478a-b921-ac140061b905 service nova] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:02:33.905445 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a713f-d0f9-478a-b921-ac140061b905 service nova] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:02:33.905989 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a713f-d0f9-478a-b921-ac140061b905 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:02:33.908805 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-621a713f-d0f9-478a-b921-ac140061b905 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:02:33.932150 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a713f-d0f9-478a-b921-ac140061b905 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:02:33.933868 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a713f-d0f9-478a-b921-ac140061b905 service nova] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:02:33.946570 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1375/2761] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:02:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 08:02:40.547950 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=12 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:02:43.941072 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=41 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:02:46.466672 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9834a-33e3-4497-ae51-2c6dedb38ea0 service neutron] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:02:46.487443 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9834a-33e3-4497-ae51-2c6dedb38ea0 service neutron] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:02:46.496737 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718a3e9-b1e9-43b2-b251-2c86b3b19ee0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc92c0a0a2cc4722868e6877bac93ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:02:46.507364 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718a3e9-b1e9-43b2-b251-2c86b3b19ee0 service nova] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:02:46.507364 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718a3e9-b1e9-43b2-b251-2c86b3b19ee0 service nova] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:02:46.507364 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718a3e9-b1e9-43b2-b251-2c86b3b19ee0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:02:46.507364 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-c718a3e9-b1e9-43b2-b251-2c86b3b19ee0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:02:46.513123 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c718a3e9-b1e9-43b2-b251-2c86b3b19ee0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:02:46.515320 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c718a3e9-b1e9-43b2-b251-2c86b3b19ee0 service nova] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:02:46.530238 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1387/2762] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:02:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:02:54.912355 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc194a-3c62-413e-aeac-e6c782487369 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:02:54.912920 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc194a-3c62-413e-aeac-e6c782487369 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:02:54.913239 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc194a-3c62-413e-aeac-e6c782487369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:02:54.986343 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-0cdc194a-3c62-413e-aeac-e6c782487369 None None] MFA Rules not processed for user `30dc2621143f4604b53bb44b82e8efbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:02:54.987467 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-0cdc194a-3c62-413e-aeac-e6c782487369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:02:55.073006 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1376/2763] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Aug 26 08:02:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:02:55.251420 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718a3e9-b1e9-43b2-b251-2c86b3b19ee0 service nova] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:02:55.253774 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-c718a3e9-b1e9-43b2-b251-2c86b3b19ee0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:02:55.383062 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718a3e9-b1e9-43b2-b251-2c86b3b19ee0 service nova] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:02:55.388468 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e7077-a5c6-4be6-a98f-b1c4582f81d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3142255c263e44a189db82c621f87e7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:02:55.389408 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e7077-a5c6-4be6-a98f-b1c4582f81d3 service swift] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:02:55.389885 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e7077-a5c6-4be6-a98f-b1c4582f81d3 service swift] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:02:55.390306 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e7077-a5c6-4be6-a98f-b1c4582f81d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:02:55.402109 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627e7077-a5c6-4be6-a98f-b1c4582f81d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:02:55.403754 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627e7077-a5c6-4be6-a98f-b1c4582f81d3 service swift] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:02:55.413314 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1388/2764] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 26 08:02:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 08:03:05.143416 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=40 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:03:05.409444 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=47 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:03:14.561808 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92053a8f-3de8-4e98-a4bd-d8c8a4736fc7 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:03:14.562317 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92053a8f-3de8-4e98-a4bd-d8c8a4736fc7 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:03:14.562439 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92053a8f-3de8-4e98-a4bd-d8c8a4736fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:03:14.587372 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-92053a8f-3de8-4e98-a4bd-d8c8a4736fc7 None None] MFA Rules not processed for user `30dc2621143f4604b53bb44b82e8efbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:03:14.588702 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-92053a8f-3de8-4e98-a4bd-d8c8a4736fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:03:14.596702 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1377/2765] 10.222.0.42 () {58 vars in 967 bytes} [Fri Aug 26 08:03:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:03:14.609980 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e7077-a5c6-4be6-a98f-b1c4582f81d3 service swift] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:03:14.623500 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e7077-a5c6-4be6-a98f-b1c4582f81d3 service swift] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:03:14.629073 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d452bbc-dd74-45ea-94b4-0f16241e9f87 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3142255c263e44a189db82c621f87e7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:03:14.629759 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d452bbc-dd74-45ea-94b4-0f16241e9f87 service swift] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:03:14.630046 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d452bbc-dd74-45ea-94b4-0f16241e9f87 service swift] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:03:14.630390 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d452bbc-dd74-45ea-94b4-0f16241e9f87 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:03:14.639413 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d452bbc-dd74-45ea-94b4-0f16241e9f87 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:03:14.641022 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d452bbc-dd74-45ea-94b4-0f16241e9f87 service swift] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:03:14.651347 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1389/2766] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Aug 26 08:03:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 08:03:17.550580 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92053a8f-3de8-4e98-a4bd-d8c8a4736fc7 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:03:17.569056 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92053a8f-3de8-4e98-a4bd-d8c8a4736fc7 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:03:17.570975 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f48c8-a366-4201-a04b-90a396855f13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc92c0a0a2cc4722868e6877bac93ada', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:03:17.571641 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f48c8-a366-4201-a04b-90a396855f13 service nova] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:03:17.571922 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f48c8-a366-4201-a04b-90a396855f13 service nova] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:03:17.572203 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f48c8-a366-4201-a04b-90a396855f13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:03:17.574142 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-e34f48c8-a366-4201-a04b-90a396855f13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:03:17.586943 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f48c8-a366-4201-a04b-90a396855f13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:03:17.588589 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f48c8-a366-4201-a04b-90a396855f13 service nova] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:03:17.599571 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1378/2767] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:03:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:03:18.280356 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d452bbc-dd74-45ea-94b4-0f16241e9f87 service swift] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:03:18.299389 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d452bbc-dd74-45ea-94b4-0f16241e9f87 service swift] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:03:18.307617 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a618a93-ca01-479d-9084-00a7b8102a5f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c2bc293f1b4daca83e8d6dff66a316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:03:18.308636 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a618a93-ca01-479d-9084-00a7b8102a5f service placement] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:03:18.309157 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a618a93-ca01-479d-9084-00a7b8102a5f service placement] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:03:18.309614 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a618a93-ca01-479d-9084-00a7b8102a5f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:03:18.312173 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-5a618a93-ca01-479d-9084-00a7b8102a5f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:03:18.332246 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a618a93-ca01-479d-9084-00a7b8102a5f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:03:18.336881 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a618a93-ca01-479d-9084-00a7b8102a5f service placement] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:03:18.346327 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1390/2768] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:03:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:03:18.534931 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f48c8-a366-4201-a04b-90a396855f13 service nova] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:03:18.549729 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f48c8-a366-4201-a04b-90a396855f13 service nova] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:03:18.557661 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c38396-9a7f-47e5-9010-ff4687924e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:03:18.558409 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c38396-9a7f-47e5-9010-ff4687924e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:03:18.558615 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c38396-9a7f-47e5-9010-ff4687924e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:03:18.558882 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c38396-9a7f-47e5-9010-ff4687924e56 admin admin] PATH_INFO: `/v3/users/8bb969b468a34c6c98d28e21492c988a` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:03:18.561037 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c38396-9a7f-47e5-9010-ff4687924e56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bb969b468a34c6c98d28e21492c988a)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:03:18.562069 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c38396-9a7f-47e5-9010-ff4687924e56 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:03:18.879947 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-b4c38396-9a7f-47e5-9010-ff4687924e56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bb969b468a34c6c98d28e21492c988a'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:03:18.881020 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-b4c38396-9a7f-47e5-9010-ff4687924e56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bb969b468a34c6c98d28e21492c988a'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:03:18.978680 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-b4c38396-9a7f-47e5-9010-ff4687924e56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bb969b468a34c6c98d28e21492c988a'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:03:18.979713 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-b4c38396-9a7f-47e5-9010-ff4687924e56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bb969b468a34c6c98d28e21492c988a'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:03:18.988003 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-b4c38396-9a7f-47e5-9010-ff4687924e56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bb969b468a34c6c98d28e21492c988a'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:03:19.007168 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1379/2769] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 08:03:18 2022] DELETE /identity/v3/users/8bb969b468a34c6c98d28e21492c988a => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:03:19.333455 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a618a93-ca01-479d-9084-00a7b8102a5f service placement] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:03:19.345952 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a618a93-ca01-479d-9084-00a7b8102a5f service placement] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:03:19.418936 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc7658-be14-487b-b8e0-600731bb3433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:03:19.419606 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc7658-be14-487b-b8e0-600731bb3433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:03:19.419887 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc7658-be14-487b-b8e0-600731bb3433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:03:19.420165 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc7658-be14-487b-b8e0-600731bb3433 admin admin] PATH_INFO: `/v3/projects/44e67507b3444444993c6b88ff2fa32e` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:03:19.421290 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc7658-be14-487b-b8e0-600731bb3433 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44e67507b3444444993c6b88ff2fa32e)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:03:19.423276 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc7658-be14-487b-b8e0-600731bb3433 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:03:19.575534 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-8bfc7658-be14-487b-b8e0-600731bb3433 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44e67507b3444444993c6b88ff2fa32e', 'request_id': 'req-8bfc7658-be14-487b-b8e0-600731bb3433'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:03:19.581217 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-8bfc7658-be14-487b-b8e0-600731bb3433 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44e67507b3444444993c6b88ff2fa32e', 'request_id': 'req-8bfc7658-be14-487b-b8e0-600731bb3433'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:03:19.588367 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-8bfc7658-be14-487b-b8e0-600731bb3433 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44e67507b3444444993c6b88ff2fa32e', 'request_id': 'req-8bfc7658-be14-487b-b8e0-600731bb3433'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:03:19.667705 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-8bfc7658-be14-487b-b8e0-600731bb3433 admin admin] The token cache is being invalidate because project 44e67507b3444444993c6b88ff2fa32e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:03:19.668121 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-8bfc7658-be14-487b-b8e0-600731bb3433 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:03:19.668883 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-8bfc7658-be14-487b-b8e0-600731bb3433 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:03:19.670767 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1391/2770] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 08:03:19 2022] DELETE /identity/v3/projects/44e67507b3444444993c6b88ff2fa32e => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:03:29.002944 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=38,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:03:29.662843 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=63,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:03:38.978089 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c38396-9a7f-47e5-9010-ff4687924e56 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:03:38.979728 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-b4c38396-9a7f-47e5-9010-ff4687924e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:03:39.063701 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c38396-9a7f-47e5-9010-ff4687924e56 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:03:39.142051 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe4e2b-43cc-45f5-b8e5-7fdda93ff520 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:03:39.142718 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe4e2b-43cc-45f5-b8e5-7fdda93ff520 service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:03:39.143100 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe4e2b-43cc-45f5-b8e5-7fdda93ff520 service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:03:39.143252 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe4e2b-43cc-45f5-b8e5-7fdda93ff520 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:03:39.144968 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-98fe4e2b-43cc-45f5-b8e5-7fdda93ff520 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:03:39.222857 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe4e2b-43cc-45f5-b8e5-7fdda93ff520 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:03:39.224432 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe4e2b-43cc-45f5-b8e5-7fdda93ff520 service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:03:39.236517 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1380/2771] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:03:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:03:47.277695 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc7658-be14-487b-b8e0-600731bb3433 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:03:47.279330 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-8bfc7658-be14-487b-b8e0-600731bb3433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:03:47.297523 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc7658-be14-487b-b8e0-600731bb3433 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:03:47.302461 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243db9b-fd3a-4d2c-9d5e-3ced12a58d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:03:47.303183 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243db9b-fd3a-4d2c-9d5e-3ced12a58d53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:03:47.303803 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243db9b-fd3a-4d2c-9d5e-3ced12a58d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:03:47.304087 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243db9b-fd3a-4d2c-9d5e-3ced12a58d53 admin admin] PATH_INFO: `/v3/users/104001160e274732be5e9f75dfee5501` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:03:47.305306 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f243db9b-fd3a-4d2c-9d5e-3ced12a58d53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=104001160e274732be5e9f75dfee5501)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:03:47.307553 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f243db9b-fd3a-4d2c-9d5e-3ced12a58d53 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:03:47.551802 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-f243db9b-fd3a-4d2c-9d5e-3ced12a58d53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '104001160e274732be5e9f75dfee5501'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:03:47.561643 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-f243db9b-fd3a-4d2c-9d5e-3ced12a58d53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '104001160e274732be5e9f75dfee5501'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:03:47.681159 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-f243db9b-fd3a-4d2c-9d5e-3ced12a58d53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '104001160e274732be5e9f75dfee5501'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:03:47.681967 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-f243db9b-fd3a-4d2c-9d5e-3ced12a58d53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '104001160e274732be5e9f75dfee5501'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:03:47.695220 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-f243db9b-fd3a-4d2c-9d5e-3ced12a58d53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '104001160e274732be5e9f75dfee5501'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:03:47.701347 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1392/2772] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 08:03:47 2022] DELETE /identity/v3/users/104001160e274732be5e9f75dfee5501 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:03:47.991483 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe4e2b-43cc-45f5-b8e5-7fdda93ff520 service neutron] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:03:48.005314 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe4e2b-43cc-45f5-b8e5-7fdda93ff520 service neutron] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:03:48.092122 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e1134-bfc9-4fe6-a5d6-6038045401b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:03:48.093014 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e1134-bfc9-4fe6-a5d6-6038045401b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:03:48.093452 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e1134-bfc9-4fe6-a5d6-6038045401b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:03:48.093734 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e1134-bfc9-4fe6-a5d6-6038045401b2 admin admin] PATH_INFO: `/v3/projects/b46ee52dcf494a37a0b0928eec3d407c` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:03:48.095017 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e1134-bfc9-4fe6-a5d6-6038045401b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b46ee52dcf494a37a0b0928eec3d407c)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:03:48.098422 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e1134-bfc9-4fe6-a5d6-6038045401b2 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:03:48.112212 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=100 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:03:48.207570 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-ed6e1134-bfc9-4fe6-a5d6-6038045401b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b46ee52dcf494a37a0b0928eec3d407c', 'request_id': 'req-ed6e1134-bfc9-4fe6-a5d6-6038045401b2'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:03:48.213762 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-ed6e1134-bfc9-4fe6-a5d6-6038045401b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b46ee52dcf494a37a0b0928eec3d407c', 'request_id': 'req-ed6e1134-bfc9-4fe6-a5d6-6038045401b2'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:03:48.332109 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-ed6e1134-bfc9-4fe6-a5d6-6038045401b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b46ee52dcf494a37a0b0928eec3d407c', 'request_id': 'req-ed6e1134-bfc9-4fe6-a5d6-6038045401b2'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:03:48.345201 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-ed6e1134-bfc9-4fe6-a5d6-6038045401b2 admin admin] The token cache is being invalidate because project b46ee52dcf494a37a0b0928eec3d407c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:03:48.345500 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-ed6e1134-bfc9-4fe6-a5d6-6038045401b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:03:48.346149 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-ed6e1134-bfc9-4fe6-a5d6-6038045401b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:03:48.347676 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1381/2773] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 08:03:47 2022] DELETE /identity/v3/projects/b46ee52dcf494a37a0b0928eec3d407c => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:03:48.351789 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243db9b-fd3a-4d2c-9d5e-3ced12a58d53 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:03:48.353311 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-f243db9b-fd3a-4d2c-9d5e-3ced12a58d53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:03:48.367776 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243db9b-fd3a-4d2c-9d5e-3ced12a58d53 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:03:48.429323 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a790069-e9c9-42a5-95a5-b5015849acc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:03:48.429971 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a790069-e9c9-42a5-95a5-b5015849acc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:03:48.430246 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a790069-e9c9-42a5-95a5-b5015849acc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:03:48.430516 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a790069-e9c9-42a5-95a5-b5015849acc4 admin admin] PATH_INFO: `/v3/users/abc98b13d8dd488a96f15ff6f372cef8` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:03:48.431746 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a790069-e9c9-42a5-95a5-b5015849acc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abc98b13d8dd488a96f15ff6f372cef8)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:03:48.433663 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a790069-e9c9-42a5-95a5-b5015849acc4 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:03:48.664183 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-5a790069-e9c9-42a5-95a5-b5015849acc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abc98b13d8dd488a96f15ff6f372cef8'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:03:48.675358 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-5a790069-e9c9-42a5-95a5-b5015849acc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abc98b13d8dd488a96f15ff6f372cef8'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:03:48.787246 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-5a790069-e9c9-42a5-95a5-b5015849acc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abc98b13d8dd488a96f15ff6f372cef8'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:03:48.788142 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-5a790069-e9c9-42a5-95a5-b5015849acc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abc98b13d8dd488a96f15ff6f372cef8'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:03:48.798089 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:03:48.803125 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-5a790069-e9c9-42a5-95a5-b5015849acc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abc98b13d8dd488a96f15ff6f372cef8'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:03:48.811165 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1393/2774] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 08:03:48 2022] DELETE /identity/v3/users/abc98b13d8dd488a96f15ff6f372cef8 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:03:49.096439 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e1134-bfc9-4fe6-a5d6-6038045401b2 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:03:49.097207 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-ed6e1134-bfc9-4fe6-a5d6-6038045401b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:03:49.121995 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e1134-bfc9-4fe6-a5d6-6038045401b2 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:03:49.182979 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1b3ef-fe46-449d-a039-55297fcdaa55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:03:49.183643 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1b3ef-fe46-449d-a039-55297fcdaa55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:03:49.183979 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1b3ef-fe46-449d-a039-55297fcdaa55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:03:49.184161 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1b3ef-fe46-449d-a039-55297fcdaa55 admin admin] PATH_INFO: `/v3/projects/59130f868e4e44fa817cfa1c9543ad6d` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:03:49.185277 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee1b3ef-fe46-449d-a039-55297fcdaa55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59130f868e4e44fa817cfa1c9543ad6d)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:03:49.187284 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee1b3ef-fe46-449d-a039-55297fcdaa55 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:03:49.298406 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-3ee1b3ef-fe46-449d-a039-55297fcdaa55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59130f868e4e44fa817cfa1c9543ad6d', 'request_id': 'req-3ee1b3ef-fe46-449d-a039-55297fcdaa55'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:03:49.304454 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-3ee1b3ef-fe46-449d-a039-55297fcdaa55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59130f868e4e44fa817cfa1c9543ad6d', 'request_id': 'req-3ee1b3ef-fe46-449d-a039-55297fcdaa55'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:03:49.405818 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-3ee1b3ef-fe46-449d-a039-55297fcdaa55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59130f868e4e44fa817cfa1c9543ad6d', 'request_id': 'req-3ee1b3ef-fe46-449d-a039-55297fcdaa55'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:03:49.418725 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-3ee1b3ef-fe46-449d-a039-55297fcdaa55 admin admin] The token cache is being invalidate because project 59130f868e4e44fa817cfa1c9543ad6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:03:49.419083 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-3ee1b3ef-fe46-449d-a039-55297fcdaa55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:03:49.419690 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-3ee1b3ef-fe46-449d-a039-55297fcdaa55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:03:49.421181 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1382/2775] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 08:03:49 2022] DELETE /identity/v3/projects/59130f868e4e44fa817cfa1c9543ad6d => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:03:54.650151 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a790069-e9c9-42a5-95a5-b5015849acc4 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:03:54.651658 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-5a790069-e9c9-42a5-95a5-b5015849acc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:03:54.708809 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a790069-e9c9-42a5-95a5-b5015849acc4 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:03:54.757615 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf32de5-b21a-486c-a283-aa0dd7a95e5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:03:54.758220 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf32de5-b21a-486c-a283-aa0dd7a95e5d service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:03:54.758500 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf32de5-b21a-486c-a283-aa0dd7a95e5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:03:54.758772 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf32de5-b21a-486c-a283-aa0dd7a95e5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:03:54.760571 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-daf32de5-b21a-486c-a283-aa0dd7a95e5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:03:54.821937 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf32de5-b21a-486c-a283-aa0dd7a95e5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:03:54.823407 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf32de5-b21a-486c-a283-aa0dd7a95e5d service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:03:54.832842 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1394/2776] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:03:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:03:58.457010 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1b3ef-fe46-449d-a039-55297fcdaa55 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:03:58.457010 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-3ee1b3ef-fe46-449d-a039-55297fcdaa55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:03:58.470641 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1b3ef-fe46-449d-a039-55297fcdaa55 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:03:58.476070 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69264e75-197b-4963-b7c2-ceca08181041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:03:58.476662 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69264e75-197b-4963-b7c2-ceca08181041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:03:58.476976 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69264e75-197b-4963-b7c2-ceca08181041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:03:58.477211 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69264e75-197b-4963-b7c2-ceca08181041 admin admin] PATH_INFO: `/v3/users/d0e5d7a2d5604c4fbc1ea74f4a263e79` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:03:58.478361 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69264e75-197b-4963-b7c2-ceca08181041 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0e5d7a2d5604c4fbc1ea74f4a263e79)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:03:58.480406 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69264e75-197b-4963-b7c2-ceca08181041 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:03:58.507817 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:03:58.723227 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-69264e75-197b-4963-b7c2-ceca08181041 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0e5d7a2d5604c4fbc1ea74f4a263e79'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:03:58.723840 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-69264e75-197b-4963-b7c2-ceca08181041 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0e5d7a2d5604c4fbc1ea74f4a263e79'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:03:58.834567 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-69264e75-197b-4963-b7c2-ceca08181041 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0e5d7a2d5604c4fbc1ea74f4a263e79'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:03:58.835465 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-69264e75-197b-4963-b7c2-ceca08181041 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0e5d7a2d5604c4fbc1ea74f4a263e79'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:03:58.844280 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-69264e75-197b-4963-b7c2-ceca08181041 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0e5d7a2d5604c4fbc1ea74f4a263e79'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:03:58.862805 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1383/2777] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 08:03:58 2022] DELETE /identity/v3/users/d0e5d7a2d5604c4fbc1ea74f4a263e79 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:03:59.098875 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf32de5-b21a-486c-a283-aa0dd7a95e5d service neutron] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:03:59.110344 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf32de5-b21a-486c-a283-aa0dd7a95e5d service neutron] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:03:59.164371 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:03:59.170920 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f9a05-c8be-433f-af96-158e0e793fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:03:59.171881 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f9a05-c8be-433f-af96-158e0e793fbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:03:59.172162 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f9a05-c8be-433f-af96-158e0e793fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:03:59.172434 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f9a05-c8be-433f-af96-158e0e793fbf admin admin] PATH_INFO: `/v3/projects/e747d455c2f94bd39079cd63d78ce103` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:03:59.173567 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f9a05-c8be-433f-af96-158e0e793fbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e747d455c2f94bd39079cd63d78ce103)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:03:59.175495 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f9a05-c8be-433f-af96-158e0e793fbf admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:03:59.285243 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-2e4f9a05-c8be-433f-af96-158e0e793fbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e747d455c2f94bd39079cd63d78ce103', 'request_id': 'req-2e4f9a05-c8be-433f-af96-158e0e793fbf'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:03:59.291198 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-2e4f9a05-c8be-433f-af96-158e0e793fbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e747d455c2f94bd39079cd63d78ce103', 'request_id': 'req-2e4f9a05-c8be-433f-af96-158e0e793fbf'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:03:59.297310 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-2e4f9a05-c8be-433f-af96-158e0e793fbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e747d455c2f94bd39079cd63d78ce103', 'request_id': 'req-2e4f9a05-c8be-433f-af96-158e0e793fbf'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:03:59.388518 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-2e4f9a05-c8be-433f-af96-158e0e793fbf admin admin] The token cache is being invalidate because project e747d455c2f94bd39079cd63d78ce103 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:03:59.388810 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-2e4f9a05-c8be-433f-af96-158e0e793fbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:03:59.389463 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-2e4f9a05-c8be-433f-af96-158e0e793fbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:03:59.390954 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1395/2778] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 08:03:59 2022] DELETE /identity/v3/projects/e747d455c2f94bd39079cd63d78ce103 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:03:59.395932 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa6ac6-7e90-4705-898a-5f7e96cb6b84 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:03:59.396218 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa6ac6-7e90-4705-898a-5f7e96cb6b84 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:03:59.397104 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa6ac6-7e90-4705-898a-5f7e96cb6b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:03:59.424895 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-78fa6ac6-7e90-4705-898a-5f7e96cb6b84 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:03:59.426136 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-78fa6ac6-7e90-4705-898a-5f7e96cb6b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:03:59.493065 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1384/2779] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:03:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:03:59.501209 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc3168-bbda-4ec8-b236-7e27dc019c17 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:03:59.501495 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc3168-bbda-4ec8-b236-7e27dc019c17 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:03:59.501770 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc3168-bbda-4ec8-b236-7e27dc019c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:03:59.522495 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-1bbc3168-bbda-4ec8-b236-7e27dc019c17 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:03:59.523824 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-1bbc3168-bbda-4ec8-b236-7e27dc019c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:03:59.531851 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1396/2780] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:03:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:03:59.536148 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa6ac6-7e90-4705-898a-5f7e96cb6b84 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:03:59.546428 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa6ac6-7e90-4705-898a-5f7e96cb6b84 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:03:59.550939 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5bbce6-60eb-4625-8ca9-865b3d7ee451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:03:59.551590 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bbce6-60eb-4625-8ca9-865b3d7ee451 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:03:59.551865 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bbce6-60eb-4625-8ca9-865b3d7ee451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:03:59.552137 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bbce6-60eb-4625-8ca9-865b3d7ee451 admin admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:03:59.552820 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5bbce6-60eb-4625-8ca9-865b3d7ee451 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:03:59.553248 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5bbce6-60eb-4625-8ca9-865b3d7ee451 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:03:59.554947 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5bbce6-60eb-4625-8ca9-865b3d7ee451 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:03:59.566781 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1385/2781] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 08:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:03:59.571234 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc3168-bbda-4ec8-b236-7e27dc019c17 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:03:59.580440 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc3168-bbda-4ec8-b236-7e27dc019c17 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:03:59.585604 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3dfdd6-41e2-440f-ac51-3c0fcf2bacaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:03:59.586195 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3dfdd6-41e2-440f-ac51-3c0fcf2bacaf admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:03:59.586732 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3dfdd6-41e2-440f-ac51-3c0fcf2bacaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:03:59.587026 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3dfdd6-41e2-440f-ac51-3c0fcf2bacaf admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:03:59.587672 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3dfdd6-41e2-440f-ac51-3c0fcf2bacaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:03:59.589560 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3dfdd6-41e2-440f-ac51-3c0fcf2bacaf admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:03:59.715932 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1397/2782] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 08:03:59 2022] POST /identity/v3/projects => generated 367 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:03:59.720441 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5bbce6-60eb-4625-8ca9-865b3d7ee451 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:03:59.731334 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5bbce6-60eb-4625-8ca9-865b3d7ee451 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:03:59.788754 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15daa9-986d-46ea-9b54-b860b93e0300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:03:59.789292 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15daa9-986d-46ea-9b54-b860b93e0300 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:03:59.789584 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15daa9-986d-46ea-9b54-b860b93e0300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:03:59.789847 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15daa9-986d-46ea-9b54-b860b93e0300 admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:03:59.790469 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15daa9-986d-46ea-9b54-b860b93e0300 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:03:59.792425 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15daa9-986d-46ea-9b54-b860b93e0300 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:03:59.857963 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1386/2783] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 08:03:59 2022] POST /identity/v3/users => generated 284 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:03:59.862244 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3dfdd6-41e2-440f-ac51-3c0fcf2bacaf admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:03:59.873045 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3dfdd6-41e2-440f-ac51-3c0fcf2bacaf admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:03:59.877700 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43736e-0ac1-4c6c-b75a-7b23534f4ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:03:59.878293 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43736e-0ac1-4c6c-b75a-7b23534f4ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:03:59.878574 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43736e-0ac1-4c6c-b75a-7b23534f4ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:03:59.878844 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43736e-0ac1-4c6c-b75a-7b23534f4ea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:03:59.879515 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43736e-0ac1-4c6c-b75a-7b23534f4ea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:03:59.885233 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43736e-0ac1-4c6c-b75a-7b23534f4ea7 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:03:59.891524 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1398/2784] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 08:03:59.895502 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15daa9-986d-46ea-9b54-b860b93e0300 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:03:59.906097 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15daa9-986d-46ea-9b54-b860b93e0300 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:03:59.910595 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb1828-4a23-4f7a-a987-5095938de1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:03:59.911218 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb1828-4a23-4f7a-a987-5095938de1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:03:59.911498 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb1828-4a23-4f7a-a987-5095938de1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:03:59.911769 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb1828-4a23-4f7a-a987-5095938de1f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:03:59.912410 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb1828-4a23-4f7a-a987-5095938de1f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:03:59.914026 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb1828-4a23-4f7a-a987-5095938de1f9 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:03:59.924342 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1387/2785] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:03:59.928460 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43736e-0ac1-4c6c-b75a-7b23534f4ea7 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:03:59.938414 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43736e-0ac1-4c6c-b75a-7b23534f4ea7 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:03:59.944673 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffce3e-2b20-4b22-9f23-bef6a0238a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:03:59.945320 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffce3e-2b20-4b22-9f23-bef6a0238a85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:03:59.945625 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffce3e-2b20-4b22-9f23-bef6a0238a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:03:59.945921 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffce3e-2b20-4b22-9f23-bef6a0238a85 admin admin] PATH_INFO: `/v3/projects/4ef453887c944c1dab5b18e15f9fd6a0/users/9664de2562aa493682b0b6f079edd924/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:03:59.961202 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ffce3e-2b20-4b22-9f23-bef6a0238a85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ef453887c944c1dab5b18e15f9fd6a0, user_id=9664de2562aa493682b0b6f079edd924, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:03:59.964107 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ffce3e-2b20-4b22-9f23-bef6a0238a85 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:00.041053 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1399/2786] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 08:03:59 2022] PUT /identity/v3/projects/4ef453887c944c1dab5b18e15f9fd6a0/users/9664de2562aa493682b0b6f079edd924/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:04:00.051571 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72543f-3459-4bd4-8fcc-8694acbc61d1 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:00.056121 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72543f-3459-4bd4-8fcc-8694acbc61d1 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:00.056121 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72543f-3459-4bd4-8fcc-8694acbc61d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:00.060393 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:04:00.079799 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-2b72543f-3459-4bd4-8fcc-8694acbc61d1 None None] MFA Rules not processed for user `9664de2562aa493682b0b6f079edd924`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:04:00.084896 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-2b72543f-3459-4bd4-8fcc-8694acbc61d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:04:00.144577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1388/2787] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:04:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:04:00.155318 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffce3e-2b20-4b22-9f23-bef6a0238a85 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:00.157029 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-f1ffce3e-2b20-4b22-9f23-bef6a0238a85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:04:00.216815 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffce3e-2b20-4b22-9f23-bef6a0238a85 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:00.222276 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f5277-df21-4b1d-a7b4-ba2a45b0b143 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:00.222276 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f5277-df21-4b1d-a7b4-ba2a45b0b143 service cinder] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:00.222276 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f5277-df21-4b1d-a7b4-ba2a45b0b143 service cinder] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:00.222276 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f5277-df21-4b1d-a7b4-ba2a45b0b143 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:00.230499 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f5277-df21-4b1d-a7b4-ba2a45b0b143 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:00.232206 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f5277-df21-4b1d-a7b4-ba2a45b0b143 service cinder] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:00.241718 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1400/2788] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:04:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:04:10.207372 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72543f-3459-4bd4-8fcc-8694acbc61d1 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:10.237009 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=78,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:04:10.270624 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72543f-3459-4bd4-8fcc-8694acbc61d1 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:10.275435 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa35d88-de39-44c7-ac14-33eaa84aa4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:10.276063 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa35d88-de39-44c7-ac14-33eaa84aa4e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:10.276340 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa35d88-de39-44c7-ac14-33eaa84aa4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:10.276608 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa35d88-de39-44c7-ac14-33eaa84aa4e3 admin admin] PATH_INFO: `/v3/users/9664de2562aa493682b0b6f079edd924` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:10.277718 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa35d88-de39-44c7-ac14-33eaa84aa4e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9664de2562aa493682b0b6f079edd924)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:10.279737 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa35d88-de39-44c7-ac14-33eaa84aa4e3 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:10.461901 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-4aa35d88-de39-44c7-ac14-33eaa84aa4e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9664de2562aa493682b0b6f079edd924'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:10.461901 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-4aa35d88-de39-44c7-ac14-33eaa84aa4e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9664de2562aa493682b0b6f079edd924'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:10.536812 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-4aa35d88-de39-44c7-ac14-33eaa84aa4e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9664de2562aa493682b0b6f079edd924'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:10.537451 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-4aa35d88-de39-44c7-ac14-33eaa84aa4e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9664de2562aa493682b0b6f079edd924'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:10.545944 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-4aa35d88-de39-44c7-ac14-33eaa84aa4e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9664de2562aa493682b0b6f079edd924'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:10.565177 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1389/2789] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 08:04:10 2022] DELETE /identity/v3/users/9664de2562aa493682b0b6f079edd924 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:04:10.569624 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff08c15-1e01-46b4-ba12-877e73e93484 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:10.569912 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff08c15-1e01-46b4-ba12-877e73e93484 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:10.570189 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff08c15-1e01-46b4-ba12-877e73e93484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:10.591659 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-5ff08c15-1e01-46b4-ba12-877e73e93484 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:04:10.592891 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-5ff08c15-1e01-46b4-ba12-877e73e93484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:04:10.654341 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1401/2790] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:04:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:04:10.665165 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa35d88-de39-44c7-ac14-33eaa84aa4e3 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:10.667954 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-4aa35d88-de39-44c7-ac14-33eaa84aa4e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:04:10.683452 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:04:10.753649 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa35d88-de39-44c7-ac14-33eaa84aa4e3 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:10.753649 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9584342b-b850-4e2c-8409-b335a41adae6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:10.753649 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584342b-b850-4e2c-8409-b335a41adae6 service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:10.753649 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584342b-b850-4e2c-8409-b335a41adae6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:10.754238 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584342b-b850-4e2c-8409-b335a41adae6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:10.754238 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9584342b-b850-4e2c-8409-b335a41adae6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:10.754238 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9584342b-b850-4e2c-8409-b335a41adae6 service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:10.756704 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1390/2791] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:04:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:04:11.177236 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff08c15-1e01-46b4-ba12-877e73e93484 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:11.179501 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-5ff08c15-1e01-46b4-ba12-877e73e93484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:04:11.193659 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff08c15-1e01-46b4-ba12-877e73e93484 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:11.199967 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3144f-6e65-4f96-81d8-2c73f5a8b2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:11.200537 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3144f-6e65-4f96-81d8-2c73f5a8b2ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:11.201387 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3144f-6e65-4f96-81d8-2c73f5a8b2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:11.201685 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3144f-6e65-4f96-81d8-2c73f5a8b2ef admin admin] PATH_INFO: `/v3/projects/4ef453887c944c1dab5b18e15f9fd6a0` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:11.203116 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc3144f-6e65-4f96-81d8-2c73f5a8b2ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ef453887c944c1dab5b18e15f9fd6a0)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:11.205024 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc3144f-6e65-4f96-81d8-2c73f5a8b2ef admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:11.332573 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-9cc3144f-6e65-4f96-81d8-2c73f5a8b2ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ef453887c944c1dab5b18e15f9fd6a0', 'request_id': 'req-9cc3144f-6e65-4f96-81d8-2c73f5a8b2ef'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:11.338773 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-9cc3144f-6e65-4f96-81d8-2c73f5a8b2ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ef453887c944c1dab5b18e15f9fd6a0', 'request_id': 'req-9cc3144f-6e65-4f96-81d8-2c73f5a8b2ef'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:11.345143 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-9cc3144f-6e65-4f96-81d8-2c73f5a8b2ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ef453887c944c1dab5b18e15f9fd6a0', 'request_id': 'req-9cc3144f-6e65-4f96-81d8-2c73f5a8b2ef'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:11.434028 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-9cc3144f-6e65-4f96-81d8-2c73f5a8b2ef admin admin] The token cache is being invalidate because project 4ef453887c944c1dab5b18e15f9fd6a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:04:11.434317 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-9cc3144f-6e65-4f96-81d8-2c73f5a8b2ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:11.434952 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-9cc3144f-6e65-4f96-81d8-2c73f5a8b2ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:11.436512 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1402/2792] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 08:04:11 2022] DELETE /identity/v3/projects/4ef453887c944c1dab5b18e15f9fd6a0 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:04:11.442229 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b922e064-5170-4ae5-9849-0c875d707913 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:11.442803 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b922e064-5170-4ae5-9849-0c875d707913 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:11.442923 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b922e064-5170-4ae5-9849-0c875d707913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:11.465022 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-b922e064-5170-4ae5-9849-0c875d707913 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:04:11.466254 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-b922e064-5170-4ae5-9849-0c875d707913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:04:11.532033 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1391/2793] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:04:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:04:11.542109 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f42bc-c4b5-4039-b359-5a30996b2158 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:11.542532 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f42bc-c4b5-4039-b359-5a30996b2158 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:11.542965 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f42bc-c4b5-4039-b359-5a30996b2158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:11.566630 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-cc4f42bc-c4b5-4039-b359-5a30996b2158 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:04:11.570328 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-cc4f42bc-c4b5-4039-b359-5a30996b2158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:04:11.577036 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1403/2794] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:04:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:04:11.581403 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b922e064-5170-4ae5-9849-0c875d707913 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:11.592148 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b922e064-5170-4ae5-9849-0c875d707913 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:11.599935 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b69c15-0e2a-4649-8cde-b7f25d55fe1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:11.601032 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b69c15-0e2a-4649-8cde-b7f25d55fe1c admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:11.601532 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b69c15-0e2a-4649-8cde-b7f25d55fe1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:11.602021 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b69c15-0e2a-4649-8cde-b7f25d55fe1c admin admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:11.603269 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b69c15-0e2a-4649-8cde-b7f25d55fe1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:04:11.603830 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b69c15-0e2a-4649-8cde-b7f25d55fe1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:11.607263 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b69c15-0e2a-4649-8cde-b7f25d55fe1c admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:11.621178 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1392/2795] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 08:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:04:11.625485 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f42bc-c4b5-4039-b359-5a30996b2158 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:11.635905 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f42bc-c4b5-4039-b359-5a30996b2158 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:11.640689 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1851dcd-e42d-4c3f-b11d-61caf1ae812b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:11.641287 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1851dcd-e42d-4c3f-b11d-61caf1ae812b admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:11.641564 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1851dcd-e42d-4c3f-b11d-61caf1ae812b admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:11.641834 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1851dcd-e42d-4c3f-b11d-61caf1ae812b admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:11.642460 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1851dcd-e42d-4c3f-b11d-61caf1ae812b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:11.644523 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1851dcd-e42d-4c3f-b11d-61caf1ae812b admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:11.767363 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1404/2796] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 08:04:11 2022] POST /identity/v3/projects => generated 381 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:04:11.771857 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b69c15-0e2a-4649-8cde-b7f25d55fe1c admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:11.782297 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b69c15-0e2a-4649-8cde-b7f25d55fe1c admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:11.841391 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65aa4f-a302-40fa-bfd3-1c6e7bb38dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:11.841993 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65aa4f-a302-40fa-bfd3-1c6e7bb38dfe admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:11.842321 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65aa4f-a302-40fa-bfd3-1c6e7bb38dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:11.842538 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65aa4f-a302-40fa-bfd3-1c6e7bb38dfe admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:11.846685 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65aa4f-a302-40fa-bfd3-1c6e7bb38dfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:11.846685 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65aa4f-a302-40fa-bfd3-1c6e7bb38dfe admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:11.941887 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1393/2797] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 08:04:11 2022] POST /identity/v3/users => generated 291 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:04:11.946071 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1851dcd-e42d-4c3f-b11d-61caf1ae812b admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:11.956731 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1851dcd-e42d-4c3f-b11d-61caf1ae812b admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:11.961958 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8fe888-28c2-4c5c-8dee-1374c24dac58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:11.962553 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fe888-28c2-4c5c-8dee-1374c24dac58 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:11.962830 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fe888-28c2-4c5c-8dee-1374c24dac58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:11.963145 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fe888-28c2-4c5c-8dee-1374c24dac58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:11.963783 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8fe888-28c2-4c5c-8dee-1374c24dac58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:11.965502 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8fe888-28c2-4c5c-8dee-1374c24dac58 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:11.976243 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1405/2798] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:04:11.980284 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65aa4f-a302-40fa-bfd3-1c6e7bb38dfe admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:11.990541 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65aa4f-a302-40fa-bfd3-1c6e7bb38dfe admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:11.995893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239839d-b2c9-46a0-8903-8384362b02c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:11.996504 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239839d-b2c9-46a0-8903-8384362b02c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:11.996783 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239839d-b2c9-46a0-8903-8384362b02c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:11.997062 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239839d-b2c9-46a0-8903-8384362b02c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:11.997710 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e239839d-b2c9-46a0-8903-8384362b02c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:11.999381 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e239839d-b2c9-46a0-8903-8384362b02c4 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:12.009949 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1394/2799] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:04:12.014181 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8fe888-28c2-4c5c-8dee-1374c24dac58 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:12.024657 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8fe888-28c2-4c5c-8dee-1374c24dac58 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:12.029445 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11f272-9ceb-4a2d-b704-6780cbc96e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:12.030096 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11f272-9ceb-4a2d-b704-6780cbc96e57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:12.030376 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11f272-9ceb-4a2d-b704-6780cbc96e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:12.030654 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11f272-9ceb-4a2d-b704-6780cbc96e57 admin admin] PATH_INFO: `/v3/projects/ce705bb698a34ab2b076e2f96a7eade5/users/6a071a715ce6401faca77decac65570c/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:12.048065 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe11f272-9ceb-4a2d-b704-6780cbc96e57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce705bb698a34ab2b076e2f96a7eade5, user_id=6a071a715ce6401faca77decac65570c, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:12.050870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe11f272-9ceb-4a2d-b704-6780cbc96e57 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:12.142666 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1406/2800] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 08:04:12 2022] PUT /identity/v3/projects/ce705bb698a34ab2b076e2f96a7eade5/users/6a071a715ce6401faca77decac65570c/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:04:12.154074 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54356139-3467-458b-9ac1-118d4a5d6b3d None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:12.156691 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54356139-3467-458b-9ac1-118d4a5d6b3d None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:12.156691 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54356139-3467-458b-9ac1-118d4a5d6b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:12.183468 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-54356139-3467-458b-9ac1-118d4a5d6b3d None None] MFA Rules not processed for user `6a071a715ce6401faca77decac65570c`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:04:12.184680 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-54356139-3467-458b-9ac1-118d4a5d6b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:04:12.194054 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:04:12.248469 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1395/2801] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:04:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:04:12.252844 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11f272-9ceb-4a2d-b704-6780cbc96e57 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:12.274166 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:04:12.315577 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11f272-9ceb-4a2d-b704-6780cbc96e57 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:12.320523 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b104cda-e387-4ed5-bb33-3a8f860c6204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:12.321870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b104cda-e387-4ed5-bb33-3a8f860c6204 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:12.321870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b104cda-e387-4ed5-bb33-3a8f860c6204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:12.321870 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b104cda-e387-4ed5-bb33-3a8f860c6204 admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:12.322309 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b104cda-e387-4ed5-bb33-3a8f860c6204 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:12.324478 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b104cda-e387-4ed5-bb33-3a8f860c6204 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:12.407051 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1407/2802] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 08:04:12 2022] POST /identity/v3/projects => generated 381 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:04:12.411323 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54356139-3467-458b-9ac1-118d4a5d6b3d None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:12.422893 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54356139-3467-458b-9ac1-118d4a5d6b3d None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:12.486484 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050805c-9b3a-40f1-9344-532c008db079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:12.487194 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050805c-9b3a-40f1-9344-532c008db079 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:12.487406 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050805c-9b3a-40f1-9344-532c008db079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:12.487684 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050805c-9b3a-40f1-9344-532c008db079 admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:12.488316 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1050805c-9b3a-40f1-9344-532c008db079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:12.490296 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1050805c-9b3a-40f1-9344-532c008db079 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:12.606751 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1396/2803] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 08:04:12 2022] POST /identity/v3/users => generated 297 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:04:12.611267 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b104cda-e387-4ed5-bb33-3a8f860c6204 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:12.622577 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b104cda-e387-4ed5-bb33-3a8f860c6204 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:12.627281 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3872d-c268-4f3b-a996-c69115dd8c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:12.627888 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3872d-c268-4f3b-a996-c69115dd8c2c admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:12.628168 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3872d-c268-4f3b-a996-c69115dd8c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:12.628441 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3872d-c268-4f3b-a996-c69115dd8c2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:12.629084 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c3872d-c268-4f3b-a996-c69115dd8c2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:12.630667 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c3872d-c268-4f3b-a996-c69115dd8c2c admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:12.641768 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1408/2804] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:04:12.646482 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050805c-9b3a-40f1-9344-532c008db079 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:12.663552 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050805c-9b3a-40f1-9344-532c008db079 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:12.668458 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e5494-ad98-4375-9822-597cf94a4af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:12.669115 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e5494-ad98-4375-9822-597cf94a4af8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:12.669407 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e5494-ad98-4375-9822-597cf94a4af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:12.669681 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e5494-ad98-4375-9822-597cf94a4af8 admin admin] PATH_INFO: `/v3/projects/6d8c3274586141ba84cf9442fb5825d6/users/846d60f83aaf4ca391fdcc83ac8aa34d/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:12.687604 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e5494-ad98-4375-9822-597cf94a4af8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d8c3274586141ba84cf9442fb5825d6, user_id=846d60f83aaf4ca391fdcc83ac8aa34d, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:12.690259 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e5494-ad98-4375-9822-597cf94a4af8 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:12.760555 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1397/2805] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 08:04:12 2022] PUT /identity/v3/projects/6d8c3274586141ba84cf9442fb5825d6/users/846d60f83aaf4ca391fdcc83ac8aa34d/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:04:12.765794 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3872d-c268-4f3b-a996-c69115dd8c2c admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:12.776403 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3872d-c268-4f3b-a996-c69115dd8c2c admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:12.834034 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd65c8-193b-45d7-9379-9e046d9e5304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:12.834635 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd65c8-193b-45d7-9379-9e046d9e5304 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:12.835450 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd65c8-193b-45d7-9379-9e046d9e5304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:12.835822 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd65c8-193b-45d7-9379-9e046d9e5304 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:12.836721 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd65c8-193b-45d7-9379-9e046d9e5304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:12.838289 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd65c8-193b-45d7-9379-9e046d9e5304 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:12.848009 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1409/2806] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 08:04:12.853066 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e5494-ad98-4375-9822-597cf94a4af8 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:12.864780 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e5494-ad98-4375-9822-597cf94a4af8 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:12.869459 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fafdd7-f707-49c1-b77b-4b8c9a6341f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:12.870153 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fafdd7-f707-49c1-b77b-4b8c9a6341f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:12.870556 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fafdd7-f707-49c1-b77b-4b8c9a6341f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:12.870840 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fafdd7-f707-49c1-b77b-4b8c9a6341f1 admin admin] PATH_INFO: `/v3/projects/6d8c3274586141ba84cf9442fb5825d6/users/846d60f83aaf4ca391fdcc83ac8aa34d/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:12.872939 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fafdd7-f707-49c1-b77b-4b8c9a6341f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d8c3274586141ba84cf9442fb5825d6, user_id=846d60f83aaf4ca391fdcc83ac8aa34d, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:12.875632 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fafdd7-f707-49c1-b77b-4b8c9a6341f1 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:12.886855 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1398/2807] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 08:04:12 2022] PUT /identity/v3/projects/6d8c3274586141ba84cf9442fb5825d6/users/846d60f83aaf4ca391fdcc83ac8aa34d/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:04:12.898855 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784f32f-3e97-4383-8bdb-2ddb8b50fe7b None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:12.899167 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784f32f-3e97-4383-8bdb-2ddb8b50fe7b None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:12.899439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784f32f-3e97-4383-8bdb-2ddb8b50fe7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:12.937001 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-a784f32f-3e97-4383-8bdb-2ddb8b50fe7b None None] MFA Rules not processed for user `846d60f83aaf4ca391fdcc83ac8aa34d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:04:12.938123 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-a784f32f-3e97-4383-8bdb-2ddb8b50fe7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:04:13.013858 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1410/2808] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:04:12 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:04:13.025911 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fafdd7-f707-49c1-b77b-4b8c9a6341f1 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:13.027773 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-70fafdd7-f707-49c1-b77b-4b8c9a6341f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:04:13.084382 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fafdd7-f707-49c1-b77b-4b8c9a6341f1 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:13.089040 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5863fb-646b-45eb-a544-d0d31ac36b08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:13.089671 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5863fb-646b-45eb-a544-d0d31ac36b08 service cinder] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:13.089953 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5863fb-646b-45eb-a544-d0d31ac36b08 service cinder] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:13.090238 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5863fb-646b-45eb-a544-d0d31ac36b08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:13.099577 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5863fb-646b-45eb-a544-d0d31ac36b08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:13.101642 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5863fb-646b-45eb-a544-d0d31ac36b08 service cinder] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:13.111258 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1399/2809] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:04:13 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:04:13.227287 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784f32f-3e97-4383-8bdb-2ddb8b50fe7b None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:13.237053 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784f32f-3e97-4383-8bdb-2ddb8b50fe7b None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:13.240659 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1e83d-10fe-46e7-b4f0-1451abd9e752 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:13.241932 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1e83d-10fe-46e7-b4f0-1451abd9e752 service cinder] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:13.242357 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1e83d-10fe-46e7-b4f0-1451abd9e752 service cinder] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:13.242633 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1e83d-10fe-46e7-b4f0-1451abd9e752 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:13.254714 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:04:13.307390 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d1e83d-10fe-46e7-b4f0-1451abd9e752 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:13.308829 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d1e83d-10fe-46e7-b4f0-1451abd9e752 service cinder] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:13.318466 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1411/2810] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:04:13 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:04:16.452911 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5863fb-646b-45eb-a544-d0d31ac36b08 service cinder] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:16.461783 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:04:16.517578 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5863fb-646b-45eb-a544-d0d31ac36b08 service cinder] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:16.522261 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59dbe2-15ca-4481-a93f-724ff54628c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:16.522900 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59dbe2-15ca-4481-a93f-724ff54628c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:16.523200 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59dbe2-15ca-4481-a93f-724ff54628c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:16.523478 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59dbe2-15ca-4481-a93f-724ff54628c0 admin admin] PATH_INFO: `/v3/users/6a071a715ce6401faca77decac65570c` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:16.524591 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59dbe2-15ca-4481-a93f-724ff54628c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a071a715ce6401faca77decac65570c)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:16.526498 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59dbe2-15ca-4481-a93f-724ff54628c0 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:16.727897 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-ed59dbe2-15ca-4481-a93f-724ff54628c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a071a715ce6401faca77decac65570c'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:16.728494 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-ed59dbe2-15ca-4481-a93f-724ff54628c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a071a715ce6401faca77decac65570c'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:16.792732 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-ed59dbe2-15ca-4481-a93f-724ff54628c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a071a715ce6401faca77decac65570c'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:16.793357 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-ed59dbe2-15ca-4481-a93f-724ff54628c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a071a715ce6401faca77decac65570c'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:16.801042 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-ed59dbe2-15ca-4481-a93f-724ff54628c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a071a715ce6401faca77decac65570c'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:16.818817 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1400/2811] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 08:04:16 2022] DELETE /identity/v3/users/6a071a715ce6401faca77decac65570c => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:04:16.823536 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280f1a5-2038-4733-b8f5-72eac5a1f4c2 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:16.824028 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280f1a5-2038-4733-b8f5-72eac5a1f4c2 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:16.824147 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280f1a5-2038-4733-b8f5-72eac5a1f4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:16.844035 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-a280f1a5-2038-4733-b8f5-72eac5a1f4c2 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:04:16.845226 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-a280f1a5-2038-4733-b8f5-72eac5a1f4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:04:16.904515 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1412/2812] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:04:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:04:16.914464 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59dbe2-15ca-4481-a93f-724ff54628c0 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:16.916600 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-ed59dbe2-15ca-4481-a93f-724ff54628c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:04:16.973439 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59dbe2-15ca-4481-a93f-724ff54628c0 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:16.977085 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd058de0-98f5-4faa-82a3-72bd11d59322 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:16.978279 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd058de0-98f5-4faa-82a3-72bd11d59322 service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:16.978566 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd058de0-98f5-4faa-82a3-72bd11d59322 service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:16.978763 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd058de0-98f5-4faa-82a3-72bd11d59322 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:16.987939 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd058de0-98f5-4faa-82a3-72bd11d59322 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:16.989368 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd058de0-98f5-4faa-82a3-72bd11d59322 service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:16.999656 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1401/2813] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:04:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:04:17.423509 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280f1a5-2038-4733-b8f5-72eac5a1f4c2 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:17.427682 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-a280f1a5-2038-4733-b8f5-72eac5a1f4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:04:17.438291 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280f1a5-2038-4733-b8f5-72eac5a1f4c2 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:17.442928 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1847e26-35fe-4cac-83fb-3a46edc737ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:17.443875 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1847e26-35fe-4cac-83fb-3a46edc737ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:17.444169 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1847e26-35fe-4cac-83fb-3a46edc737ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:17.444448 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1847e26-35fe-4cac-83fb-3a46edc737ad admin admin] PATH_INFO: `/v3/projects/ce705bb698a34ab2b076e2f96a7eade5` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:17.445728 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1847e26-35fe-4cac-83fb-3a46edc737ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce705bb698a34ab2b076e2f96a7eade5)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:17.448170 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1847e26-35fe-4cac-83fb-3a46edc737ad admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:17.569944 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-b1847e26-35fe-4cac-83fb-3a46edc737ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce705bb698a34ab2b076e2f96a7eade5', 'request_id': 'req-b1847e26-35fe-4cac-83fb-3a46edc737ad'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:17.576115 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-b1847e26-35fe-4cac-83fb-3a46edc737ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce705bb698a34ab2b076e2f96a7eade5', 'request_id': 'req-b1847e26-35fe-4cac-83fb-3a46edc737ad'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:17.582500 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-b1847e26-35fe-4cac-83fb-3a46edc737ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce705bb698a34ab2b076e2f96a7eade5', 'request_id': 'req-b1847e26-35fe-4cac-83fb-3a46edc737ad'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:17.651173 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-b1847e26-35fe-4cac-83fb-3a46edc737ad admin admin] The token cache is being invalidate because project ce705bb698a34ab2b076e2f96a7eade5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:04:17.651458 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-b1847e26-35fe-4cac-83fb-3a46edc737ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:17.652087 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-b1847e26-35fe-4cac-83fb-3a46edc737ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:17.653576 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1413/2814] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 08:04:17 2022] DELETE /identity/v3/projects/ce705bb698a34ab2b076e2f96a7eade5 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:04:17.657795 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd058de0-98f5-4faa-82a3-72bd11d59322 service neutron] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:17.668163 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd058de0-98f5-4faa-82a3-72bd11d59322 service neutron] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:17.714047 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:04:17.752442 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959271b-087f-4961-9e14-6b85f96c69c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:17.753078 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959271b-087f-4961-9e14-6b85f96c69c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:17.753354 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959271b-087f-4961-9e14-6b85f96c69c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:17.753625 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959271b-087f-4961-9e14-6b85f96c69c7 admin admin] PATH_INFO: `/v3/users/846d60f83aaf4ca391fdcc83ac8aa34d` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:17.754873 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6959271b-087f-4961-9e14-6b85f96c69c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=846d60f83aaf4ca391fdcc83ac8aa34d)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:17.756812 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6959271b-087f-4961-9e14-6b85f96c69c7 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:17.973351 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-6959271b-087f-4961-9e14-6b85f96c69c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '846d60f83aaf4ca391fdcc83ac8aa34d'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:17.974030 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-6959271b-087f-4961-9e14-6b85f96c69c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '846d60f83aaf4ca391fdcc83ac8aa34d'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:18.069838 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-6959271b-087f-4961-9e14-6b85f96c69c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '846d60f83aaf4ca391fdcc83ac8aa34d'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:18.070451 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-6959271b-087f-4961-9e14-6b85f96c69c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '846d60f83aaf4ca391fdcc83ac8aa34d'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:18.079578 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-6959271b-087f-4961-9e14-6b85f96c69c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '846d60f83aaf4ca391fdcc83ac8aa34d'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:18.097498 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1402/2815] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 08:04:17 2022] DELETE /identity/v3/users/846d60f83aaf4ca391fdcc83ac8aa34d => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:04:18.545508 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1847e26-35fe-4cac-83fb-3a46edc737ad admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:18.547599 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-b1847e26-35fe-4cac-83fb-3a46edc737ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:04:18.561374 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1847e26-35fe-4cac-83fb-3a46edc737ad admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:18.597841 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:04:18.629992 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00883009-cca8-47ef-ba7a-40fc3eadf468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:18.630640 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00883009-cca8-47ef-ba7a-40fc3eadf468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:18.630920 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00883009-cca8-47ef-ba7a-40fc3eadf468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:18.631225 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00883009-cca8-47ef-ba7a-40fc3eadf468 admin admin] PATH_INFO: `/v3/projects/6d8c3274586141ba84cf9442fb5825d6` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:18.632376 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00883009-cca8-47ef-ba7a-40fc3eadf468 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d8c3274586141ba84cf9442fb5825d6)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:18.636990 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00883009-cca8-47ef-ba7a-40fc3eadf468 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:18.744005 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-00883009-cca8-47ef-ba7a-40fc3eadf468 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d8c3274586141ba84cf9442fb5825d6', 'request_id': 'req-00883009-cca8-47ef-ba7a-40fc3eadf468'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:18.752016 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-00883009-cca8-47ef-ba7a-40fc3eadf468 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d8c3274586141ba84cf9442fb5825d6', 'request_id': 'req-00883009-cca8-47ef-ba7a-40fc3eadf468'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:18.758166 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-00883009-cca8-47ef-ba7a-40fc3eadf468 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d8c3274586141ba84cf9442fb5825d6', 'request_id': 'req-00883009-cca8-47ef-ba7a-40fc3eadf468'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:18.841743 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-00883009-cca8-47ef-ba7a-40fc3eadf468 admin admin] The token cache is being invalidate because project 6d8c3274586141ba84cf9442fb5825d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:04:18.841982 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-00883009-cca8-47ef-ba7a-40fc3eadf468 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:18.842964 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-00883009-cca8-47ef-ba7a-40fc3eadf468 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:18.844567 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1414/2816] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 08:04:18 2022] DELETE /identity/v3/projects/6d8c3274586141ba84cf9442fb5825d6 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 08:04:18.850471 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd127b7-c6bb-4a3f-aea9-3f23f4a39a43 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:18.851073 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd127b7-c6bb-4a3f-aea9-3f23f4a39a43 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:18.851185 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd127b7-c6bb-4a3f-aea9-3f23f4a39a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:18.872747 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-cfd127b7-c6bb-4a3f-aea9-3f23f4a39a43 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:04:18.874031 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-cfd127b7-c6bb-4a3f-aea9-3f23f4a39a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:04:18.933930 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1403/2817] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:04:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:04:18.941603 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f22d1d-054b-4a7d-8fa6-985d3315db88 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:18.941911 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f22d1d-054b-4a7d-8fa6-985d3315db88 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:18.942183 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f22d1d-054b-4a7d-8fa6-985d3315db88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:18.962526 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-16f22d1d-054b-4a7d-8fa6-985d3315db88 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:04:18.963756 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-16f22d1d-054b-4a7d-8fa6-985d3315db88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:04:18.971627 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1415/2818] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:04:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:04:18.975769 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd127b7-c6bb-4a3f-aea9-3f23f4a39a43 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:18.986160 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd127b7-c6bb-4a3f-aea9-3f23f4a39a43 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:18.990646 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a6ed4-7f56-4b6e-b7e0-ac7e02bd066b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:18.991283 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a6ed4-7f56-4b6e-b7e0-ac7e02bd066b admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:18.991559 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a6ed4-7f56-4b6e-b7e0-ac7e02bd066b admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:18.991828 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a6ed4-7f56-4b6e-b7e0-ac7e02bd066b admin admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:18.992468 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a6ed4-7f56-4b6e-b7e0-ac7e02bd066b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:04:18.993441 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a6ed4-7f56-4b6e-b7e0-ac7e02bd066b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:18.995092 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a6ed4-7f56-4b6e-b7e0-ac7e02bd066b admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:19.006371 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1404/2819] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 08:04:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:04:19.011207 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f22d1d-054b-4a7d-8fa6-985d3315db88 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:19.020577 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f22d1d-054b-4a7d-8fa6-985d3315db88 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:19.025543 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30797b4c-efe5-446b-93fd-b26bf88fbf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:19.026152 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30797b4c-efe5-446b-93fd-b26bf88fbf37 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:19.026438 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30797b4c-efe5-446b-93fd-b26bf88fbf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:19.026701 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30797b4c-efe5-446b-93fd-b26bf88fbf37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:19.027383 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30797b4c-efe5-446b-93fd-b26bf88fbf37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:19.029528 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30797b4c-efe5-446b-93fd-b26bf88fbf37 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:19.144728 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1416/2820] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 08:04:19 2022] POST /identity/v3/projects => generated 381 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:04:19.149598 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a6ed4-7f56-4b6e-b7e0-ac7e02bd066b admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:19.159957 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a6ed4-7f56-4b6e-b7e0-ac7e02bd066b admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:19.195243 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:04:19.221197 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d198ae3-11e5-4371-a240-968f24fdefa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:19.221811 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d198ae3-11e5-4371-a240-968f24fdefa6 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:19.222094 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d198ae3-11e5-4371-a240-968f24fdefa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:19.222375 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d198ae3-11e5-4371-a240-968f24fdefa6 admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:19.223224 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d198ae3-11e5-4371-a240-968f24fdefa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:19.225149 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d198ae3-11e5-4371-a240-968f24fdefa6 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:19.335950 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1405/2821] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 08:04:19 2022] POST /identity/v3/users => generated 291 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:04:19.341343 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30797b4c-efe5-446b-93fd-b26bf88fbf37 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:19.354151 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30797b4c-efe5-446b-93fd-b26bf88fbf37 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:19.359106 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c6a3e-a2fd-4d9f-9f57-df73fca704e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:19.359725 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c6a3e-a2fd-4d9f-9f57-df73fca704e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:19.360007 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c6a3e-a2fd-4d9f-9f57-df73fca704e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:19.360282 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c6a3e-a2fd-4d9f-9f57-df73fca704e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:19.360929 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c6a3e-a2fd-4d9f-9f57-df73fca704e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:19.362510 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c6a3e-a2fd-4d9f-9f57-df73fca704e6 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:19.373461 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1417/2822] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 08:04:19.377466 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d198ae3-11e5-4371-a240-968f24fdefa6 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:19.387653 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d198ae3-11e5-4371-a240-968f24fdefa6 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:19.392565 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ee095-e3ad-42fe-af95-66dfdfb45ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:19.393093 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ee095-e3ad-42fe-af95-66dfdfb45ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:19.393373 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ee095-e3ad-42fe-af95-66dfdfb45ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:19.393649 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ee095-e3ad-42fe-af95-66dfdfb45ee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:19.394290 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ee095-e3ad-42fe-af95-66dfdfb45ee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:19.396027 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ee095-e3ad-42fe-af95-66dfdfb45ee4 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:19.407232 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1406/2823] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 08:04:19.411391 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c6a3e-a2fd-4d9f-9f57-df73fca704e6 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:19.422287 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c6a3e-a2fd-4d9f-9f57-df73fca704e6 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:19.430869 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00179561-8aef-4eac-b617-1b51325485d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:19.431592 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00179561-8aef-4eac-b617-1b51325485d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:19.432137 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00179561-8aef-4eac-b617-1b51325485d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:19.432502 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00179561-8aef-4eac-b617-1b51325485d4 admin admin] PATH_INFO: `/v3/projects/43f3f9f66ad64e3e9396c23cbb076938/users/a18f3c35c15142719fce5e7c9c3bc13d/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:19.449438 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00179561-8aef-4eac-b617-1b51325485d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43f3f9f66ad64e3e9396c23cbb076938, user_id=a18f3c35c15142719fce5e7c9c3bc13d, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:19.452179 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00179561-8aef-4eac-b617-1b51325485d4 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:19.518232 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1418/2824] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 08:04:19 2022] PUT /identity/v3/projects/43f3f9f66ad64e3e9396c23cbb076938/users/a18f3c35c15142719fce5e7c9c3bc13d/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:04:19.529260 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef39a41-9692-48bf-ae71-68e8b8a94c83 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:19.529549 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef39a41-9692-48bf-ae71-68e8b8a94c83 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:19.529851 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef39a41-9692-48bf-ae71-68e8b8a94c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:19.558424 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-fef39a41-9692-48bf-ae71-68e8b8a94c83 None None] MFA Rules not processed for user `a18f3c35c15142719fce5e7c9c3bc13d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:04:19.559694 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-fef39a41-9692-48bf-ae71-68e8b8a94c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:04:19.624079 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1407/2825] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:04:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:04:19.628565 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00179561-8aef-4eac-b617-1b51325485d4 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:19.688958 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00179561-8aef-4eac-b617-1b51325485d4 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:19.693671 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cafa7c-7797-4f06-bfec-70fbbf8cd444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:19.694268 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cafa7c-7797-4f06-bfec-70fbbf8cd444 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:19.694544 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cafa7c-7797-4f06-bfec-70fbbf8cd444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:19.694813 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cafa7c-7797-4f06-bfec-70fbbf8cd444 admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:19.695493 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cafa7c-7797-4f06-bfec-70fbbf8cd444 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:19.698215 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cafa7c-7797-4f06-bfec-70fbbf8cd444 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:19.707907 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:04:19.812632 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1419/2826] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 08:04:19 2022] POST /identity/v3/projects => generated 379 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:04:19.816608 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef39a41-9692-48bf-ae71-68e8b8a94c83 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:19.828366 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef39a41-9692-48bf-ae71-68e8b8a94c83 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:19.889376 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379f0d4-af54-41a3-8097-22b427655656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:19.998429 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379f0d4-af54-41a3-8097-22b427655656 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:19.998429 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379f0d4-af54-41a3-8097-22b427655656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:19.998429 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379f0d4-af54-41a3-8097-22b427655656 admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:19.998429 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e379f0d4-af54-41a3-8097-22b427655656 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:19.998429 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e379f0d4-af54-41a3-8097-22b427655656 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:20.056531 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1408/2827] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 08:04:19 2022] POST /identity/v3/users => generated 296 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:04:20.060526 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cafa7c-7797-4f06-bfec-70fbbf8cd444 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:20.070861 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cafa7c-7797-4f06-bfec-70fbbf8cd444 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:20.076148 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec77ce-dd9d-4f3d-8db1-04ef0bb72258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:20.076739 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec77ce-dd9d-4f3d-8db1-04ef0bb72258 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:20.077015 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec77ce-dd9d-4f3d-8db1-04ef0bb72258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:20.077284 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec77ce-dd9d-4f3d-8db1-04ef0bb72258 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:20.077916 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec77ce-dd9d-4f3d-8db1-04ef0bb72258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:20.079515 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec77ce-dd9d-4f3d-8db1-04ef0bb72258 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:20.090250 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1420/2828] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:04:20.094386 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379f0d4-af54-41a3-8097-22b427655656 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:20.105505 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379f0d4-af54-41a3-8097-22b427655656 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:20.110771 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad154c-c9dd-4516-8fb9-6f894a211cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:20.111459 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad154c-c9dd-4516-8fb9-6f894a211cc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:20.111736 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad154c-c9dd-4516-8fb9-6f894a211cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:20.112007 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad154c-c9dd-4516-8fb9-6f894a211cc6 admin admin] PATH_INFO: `/v3/projects/25572a01760b49cd8c5aa3be53b824fe/users/4067d8d6a4134040ac668d96499bad1c/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:20.128398 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad154c-c9dd-4516-8fb9-6f894a211cc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25572a01760b49cd8c5aa3be53b824fe, user_id=4067d8d6a4134040ac668d96499bad1c, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:20.131046 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad154c-c9dd-4516-8fb9-6f894a211cc6 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:20.221149 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1409/2829] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 08:04:20 2022] PUT /identity/v3/projects/25572a01760b49cd8c5aa3be53b824fe/users/4067d8d6a4134040ac668d96499bad1c/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:04:20.230904 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec77ce-dd9d-4f3d-8db1-04ef0bb72258 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:20.241273 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec77ce-dd9d-4f3d-8db1-04ef0bb72258 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:20.297813 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8042e76e-0192-49ef-b3ad-1d16da085811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:20.298342 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042e76e-0192-49ef-b3ad-1d16da085811 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:20.298624 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042e76e-0192-49ef-b3ad-1d16da085811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:20.298897 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042e76e-0192-49ef-b3ad-1d16da085811 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:20.299570 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8042e76e-0192-49ef-b3ad-1d16da085811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:20.301202 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8042e76e-0192-49ef-b3ad-1d16da085811 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:20.311510 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1421/2830] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:04:20.315594 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad154c-c9dd-4516-8fb9-6f894a211cc6 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:20.326654 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad154c-c9dd-4516-8fb9-6f894a211cc6 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:20.331338 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8a251a-57c8-4659-8f66-bc6b16efcc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:20.332046 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a251a-57c8-4659-8f66-bc6b16efcc6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:20.332321 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a251a-57c8-4659-8f66-bc6b16efcc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:20.332595 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a251a-57c8-4659-8f66-bc6b16efcc6f admin admin] PATH_INFO: `/v3/projects/25572a01760b49cd8c5aa3be53b824fe/users/4067d8d6a4134040ac668d96499bad1c/roles/07ed857b2feb472f9fa9e7fe0b08582b` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:20.334494 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8a251a-57c8-4659-8f66-bc6b16efcc6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=25572a01760b49cd8c5aa3be53b824fe, user_id=4067d8d6a4134040ac668d96499bad1c, role_id=07ed857b2feb472f9fa9e7fe0b08582b)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:20.337471 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8a251a-57c8-4659-8f66-bc6b16efcc6f admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:20.348448 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:04:20.348448 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1410/2831] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 08:04:20 2022] PUT /identity/v3/projects/25572a01760b49cd8c5aa3be53b824fe/users/4067d8d6a4134040ac668d96499bad1c/roles/07ed857b2feb472f9fa9e7fe0b08582b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:04:20.415106 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196643b6-7d2b-4ede-bae0-9edec3fa144f None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:20.415439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196643b6-7d2b-4ede-bae0-9edec3fa144f None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:20.415675 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196643b6-7d2b-4ede-bae0-9edec3fa144f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:20.444178 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-196643b6-7d2b-4ede-bae0-9edec3fa144f None None] MFA Rules not processed for user `4067d8d6a4134040ac668d96499bad1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:04:20.445397 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-196643b6-7d2b-4ede-bae0-9edec3fa144f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:04:20.516170 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1422/2832] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:04:20 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:04:20.526971 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8a251a-57c8-4659-8f66-bc6b16efcc6f admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:20.528687 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-9b8a251a-57c8-4659-8f66-bc6b16efcc6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:04:20.584953 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8a251a-57c8-4659-8f66-bc6b16efcc6f admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:20.589065 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ff8d2-ac7f-4e78-b247-c3374883da8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:20.589512 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ff8d2-ac7f-4e78-b247-c3374883da8d service cinder] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:20.589793 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ff8d2-ac7f-4e78-b247-c3374883da8d service cinder] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:20.590065 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ff8d2-ac7f-4e78-b247-c3374883da8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:20.599073 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4ff8d2-ac7f-4e78-b247-c3374883da8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:20.600491 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4ff8d2-ac7f-4e78-b247-c3374883da8d service cinder] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:20.610576 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1411/2833] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:04:20 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:04:21.192253 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196643b6-7d2b-4ede-bae0-9edec3fa144f None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:21.254640 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196643b6-7d2b-4ede-bae0-9edec3fa144f None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:21.259204 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c38ff7-dd01-46ad-b39f-92c2fd6ab326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:21.259837 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c38ff7-dd01-46ad-b39f-92c2fd6ab326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:21.260100 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c38ff7-dd01-46ad-b39f-92c2fd6ab326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:21.260371 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c38ff7-dd01-46ad-b39f-92c2fd6ab326 admin admin] PATH_INFO: `/v3/users/a18f3c35c15142719fce5e7c9c3bc13d` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:21.261532 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c38ff7-dd01-46ad-b39f-92c2fd6ab326 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a18f3c35c15142719fce5e7c9c3bc13d)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:21.263544 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c38ff7-dd01-46ad-b39f-92c2fd6ab326 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:21.265038 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:04:21.459465 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-f3c38ff7-dd01-46ad-b39f-92c2fd6ab326 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a18f3c35c15142719fce5e7c9c3bc13d'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:21.467225 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-f3c38ff7-dd01-46ad-b39f-92c2fd6ab326 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a18f3c35c15142719fce5e7c9c3bc13d'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:21.587481 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-f3c38ff7-dd01-46ad-b39f-92c2fd6ab326 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a18f3c35c15142719fce5e7c9c3bc13d'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:21.588144 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-f3c38ff7-dd01-46ad-b39f-92c2fd6ab326 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a18f3c35c15142719fce5e7c9c3bc13d'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:21.601013 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-f3c38ff7-dd01-46ad-b39f-92c2fd6ab326 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a18f3c35c15142719fce5e7c9c3bc13d'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:21.607843 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1423/2834] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 08:04:21 2022] DELETE /identity/v3/users/a18f3c35c15142719fce5e7c9c3bc13d => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:04:21.612362 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf8d7b-b0ce-408a-8415-92b020d9c10a None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:21.612872 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf8d7b-b0ce-408a-8415-92b020d9c10a None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:21.612987 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf8d7b-b0ce-408a-8415-92b020d9c10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:21.632596 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-e8cf8d7b-b0ce-408a-8415-92b020d9c10a None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:04:21.634602 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-e8cf8d7b-b0ce-408a-8415-92b020d9c10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:04:21.692469 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1412/2835] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:04:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:04:21.703198 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c38ff7-dd01-46ad-b39f-92c2fd6ab326 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:21.704620 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-f3c38ff7-dd01-46ad-b39f-92c2fd6ab326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:04:21.766325 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c38ff7-dd01-46ad-b39f-92c2fd6ab326 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:21.770036 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08407e12-ae56-4491-bebf-af45c877f2ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:21.770647 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08407e12-ae56-4491-bebf-af45c877f2ab service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:21.770927 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08407e12-ae56-4491-bebf-af45c877f2ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:21.771232 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08407e12-ae56-4491-bebf-af45c877f2ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:21.780846 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08407e12-ae56-4491-bebf-af45c877f2ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:21.782286 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08407e12-ae56-4491-bebf-af45c877f2ab service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:21.792772 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1424/2836] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:04:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:04:22.257325 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf8d7b-b0ce-408a-8415-92b020d9c10a None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:22.258842 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-e8cf8d7b-b0ce-408a-8415-92b020d9c10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:04:22.272642 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf8d7b-b0ce-408a-8415-92b020d9c10a None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:22.278056 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411b1bb-757d-4709-baa5-01e3d85eafce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:22.279204 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411b1bb-757d-4709-baa5-01e3d85eafce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:22.279496 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411b1bb-757d-4709-baa5-01e3d85eafce admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:22.279770 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411b1bb-757d-4709-baa5-01e3d85eafce admin admin] PATH_INFO: `/v3/projects/43f3f9f66ad64e3e9396c23cbb076938` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:22.281144 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6411b1bb-757d-4709-baa5-01e3d85eafce admin admin] RBAC: Authorizing `identity:delete_project(project_id=43f3f9f66ad64e3e9396c23cbb076938)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:22.283239 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6411b1bb-757d-4709-baa5-01e3d85eafce admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:22.388109 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-6411b1bb-757d-4709-baa5-01e3d85eafce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43f3f9f66ad64e3e9396c23cbb076938', 'request_id': 'req-6411b1bb-757d-4709-baa5-01e3d85eafce'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:22.393621 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-6411b1bb-757d-4709-baa5-01e3d85eafce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43f3f9f66ad64e3e9396c23cbb076938', 'request_id': 'req-6411b1bb-757d-4709-baa5-01e3d85eafce'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:22.463134 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-6411b1bb-757d-4709-baa5-01e3d85eafce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43f3f9f66ad64e3e9396c23cbb076938', 'request_id': 'req-6411b1bb-757d-4709-baa5-01e3d85eafce'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:22.476332 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-6411b1bb-757d-4709-baa5-01e3d85eafce admin admin] The token cache is being invalidate because project 43f3f9f66ad64e3e9396c23cbb076938 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:04:22.476622 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-6411b1bb-757d-4709-baa5-01e3d85eafce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:22.477896 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-6411b1bb-757d-4709-baa5-01e3d85eafce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:22.479411 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1413/2837] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 08:04:22 2022] DELETE /identity/v3/projects/43f3f9f66ad64e3e9396c23cbb076938 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:04:22.483524 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08407e12-ae56-4491-bebf-af45c877f2ab service neutron] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:22.493403 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08407e12-ae56-4491-bebf-af45c877f2ab service neutron] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:22.549183 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93600e-3ba1-4353-b6bf-cb57414916fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:22.549723 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93600e-3ba1-4353-b6bf-cb57414916fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:22.550003 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93600e-3ba1-4353-b6bf-cb57414916fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:22.550278 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93600e-3ba1-4353-b6bf-cb57414916fe admin admin] PATH_INFO: `/v3/users/4067d8d6a4134040ac668d96499bad1c` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:22.551439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93600e-3ba1-4353-b6bf-cb57414916fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=4067d8d6a4134040ac668d96499bad1c)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:22.553342 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93600e-3ba1-4353-b6bf-cb57414916fe admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:22.576312 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:04:22.704247 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-2c93600e-3ba1-4353-b6bf-cb57414916fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4067d8d6a4134040ac668d96499bad1c'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:22.711310 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-2c93600e-3ba1-4353-b6bf-cb57414916fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4067d8d6a4134040ac668d96499bad1c'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:22.793881 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-2c93600e-3ba1-4353-b6bf-cb57414916fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4067d8d6a4134040ac668d96499bad1c'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:22.794537 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-2c93600e-3ba1-4353-b6bf-cb57414916fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4067d8d6a4134040ac668d96499bad1c'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:22.808800 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-2c93600e-3ba1-4353-b6bf-cb57414916fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4067d8d6a4134040ac668d96499bad1c'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:22.814590 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1425/2838] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 08:04:22 2022] DELETE /identity/v3/users/4067d8d6a4134040ac668d96499bad1c => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:04:23.334443 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411b1bb-757d-4709-baa5-01e3d85eafce admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:23.334908 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-6411b1bb-757d-4709-baa5-01e3d85eafce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:04:23.348529 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411b1bb-757d-4709-baa5-01e3d85eafce admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:23.370042 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:04:23.408002 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18052b-1784-4cf1-9e42-9b7dd0491dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:23.408637 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18052b-1784-4cf1-9e42-9b7dd0491dcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:23.408916 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18052b-1784-4cf1-9e42-9b7dd0491dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:23.409227 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18052b-1784-4cf1-9e42-9b7dd0491dcc admin admin] PATH_INFO: `/v3/projects/25572a01760b49cd8c5aa3be53b824fe` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:23.410421 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18052b-1784-4cf1-9e42-9b7dd0491dcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=25572a01760b49cd8c5aa3be53b824fe)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:23.412352 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18052b-1784-4cf1-9e42-9b7dd0491dcc admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:23.543653 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-5f18052b-1784-4cf1-9e42-9b7dd0491dcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25572a01760b49cd8c5aa3be53b824fe', 'request_id': 'req-5f18052b-1784-4cf1-9e42-9b7dd0491dcc'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:23.549155 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-5f18052b-1784-4cf1-9e42-9b7dd0491dcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25572a01760b49cd8c5aa3be53b824fe', 'request_id': 'req-5f18052b-1784-4cf1-9e42-9b7dd0491dcc'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:23.622175 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-5f18052b-1784-4cf1-9e42-9b7dd0491dcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25572a01760b49cd8c5aa3be53b824fe', 'request_id': 'req-5f18052b-1784-4cf1-9e42-9b7dd0491dcc'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:23.635408 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-5f18052b-1784-4cf1-9e42-9b7dd0491dcc admin admin] The token cache is being invalidate because project 25572a01760b49cd8c5aa3be53b824fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:04:23.635697 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-5f18052b-1784-4cf1-9e42-9b7dd0491dcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:23.636360 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-5f18052b-1784-4cf1-9e42-9b7dd0491dcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:23.637870 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1414/2839] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 08:04:23 2022] DELETE /identity/v3/projects/25572a01760b49cd8c5aa3be53b824fe => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:04:23.642686 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5e7d8-3347-410b-bf44-65aa5571965f None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:23.643265 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5e7d8-3347-410b-bf44-65aa5571965f None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:23.643385 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5e7d8-3347-410b-bf44-65aa5571965f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:23.663131 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-c4b5e7d8-3347-410b-bf44-65aa5571965f None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:04:23.664340 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-c4b5e7d8-3347-410b-bf44-65aa5571965f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:04:23.724788 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1426/2840] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:04:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:04:23.732611 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4769940-046b-4efa-8bcb-11770c751e77 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:23.732975 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4769940-046b-4efa-8bcb-11770c751e77 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:23.733256 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4769940-046b-4efa-8bcb-11770c751e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:23.757273 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-a4769940-046b-4efa-8bcb-11770c751e77 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:04:23.760196 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-a4769940-046b-4efa-8bcb-11770c751e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:04:23.771239 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1415/2841] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:04:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:04:23.776092 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5e7d8-3347-410b-bf44-65aa5571965f None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:23.785739 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5e7d8-3347-410b-bf44-65aa5571965f None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:23.793120 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223454b-d0d4-4077-abc1-408f7bc081b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:23.793120 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223454b-d0d4-4077-abc1-408f7bc081b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:23.793120 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223454b-d0d4-4077-abc1-408f7bc081b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:23.793120 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223454b-d0d4-4077-abc1-408f7bc081b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:23.793562 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223454b-d0d4-4077-abc1-408f7bc081b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:04:23.793562 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223454b-d0d4-4077-abc1-408f7bc081b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:23.794077 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223454b-d0d4-4077-abc1-408f7bc081b8 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:23.806266 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1427/2842] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 08:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:04:23.810769 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4769940-046b-4efa-8bcb-11770c751e77 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:23.819921 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4769940-046b-4efa-8bcb-11770c751e77 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:23.827221 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f97a7-72de-4b12-ab17-2f2626abe7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:23.827910 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f97a7-72de-4b12-ab17-2f2626abe7a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:23.828234 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f97a7-72de-4b12-ab17-2f2626abe7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:23.828544 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f97a7-72de-4b12-ab17-2f2626abe7a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:23.829695 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276f97a7-72de-4b12-ab17-2f2626abe7a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:23.832050 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276f97a7-72de-4b12-ab17-2f2626abe7a7 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:23.950959 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1416/2843] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 08:04:23 2022] POST /identity/v3/projects => generated 377 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:04:23.955302 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223454b-d0d4-4077-abc1-408f7bc081b8 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:23.966085 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223454b-d0d4-4077-abc1-408f7bc081b8 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:24.027954 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10abefc0-c1a7-4932-ac69-2cfeb76f2def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:24.028559 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abefc0-c1a7-4932-ac69-2cfeb76f2def admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:24.028837 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abefc0-c1a7-4932-ac69-2cfeb76f2def admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:24.029109 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abefc0-c1a7-4932-ac69-2cfeb76f2def admin admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:24.029723 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10abefc0-c1a7-4932-ac69-2cfeb76f2def admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:24.031656 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10abefc0-c1a7-4932-ac69-2cfeb76f2def admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:24.131314 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1428/2844] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 08:04:23 2022] POST /identity/v3/users => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:04:24.136223 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f97a7-72de-4b12-ab17-2f2626abe7a7 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:24.146884 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f97a7-72de-4b12-ab17-2f2626abe7a7 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:24.151560 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df408368-7f78-4023-a690-c0eed9720efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:24.152153 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df408368-7f78-4023-a690-c0eed9720efe admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:24.152432 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df408368-7f78-4023-a690-c0eed9720efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:24.152706 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df408368-7f78-4023-a690-c0eed9720efe admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:24.153340 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df408368-7f78-4023-a690-c0eed9720efe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:24.154929 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df408368-7f78-4023-a690-c0eed9720efe admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:24.165969 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1417/2845] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:04:24.169955 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10abefc0-c1a7-4932-ac69-2cfeb76f2def admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:24.180033 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10abefc0-c1a7-4932-ac69-2cfeb76f2def admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:24.185288 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8e584-7d36-4547-951b-2fdcb40556eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:24.188192 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8e584-7d36-4547-951b-2fdcb40556eb admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:24.188192 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8e584-7d36-4547-951b-2fdcb40556eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:24.188192 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8e584-7d36-4547-951b-2fdcb40556eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:24.188192 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b8e584-7d36-4547-951b-2fdcb40556eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:24.188819 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b8e584-7d36-4547-951b-2fdcb40556eb admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:24.199728 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1429/2846] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:04:24.204355 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df408368-7f78-4023-a690-c0eed9720efe admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:24.214447 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df408368-7f78-4023-a690-c0eed9720efe admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:24.219433 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01759a-ca51-4d25-aec1-6898203f67f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:24.220087 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01759a-ca51-4d25-aec1-6898203f67f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:24.220364 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01759a-ca51-4d25-aec1-6898203f67f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:24.220634 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01759a-ca51-4d25-aec1-6898203f67f1 admin admin] PATH_INFO: `/v3/projects/14be8421c25c471aaf3293492f6c89c0/users/4e50865b49a449b4b2210a016bc3a3b3/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:24.236043 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c01759a-ca51-4d25-aec1-6898203f67f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14be8421c25c471aaf3293492f6c89c0, user_id=4e50865b49a449b4b2210a016bc3a3b3, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:24.239405 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c01759a-ca51-4d25-aec1-6898203f67f1 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:24.314448 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1418/2847] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 08:04:24 2022] PUT /identity/v3/projects/14be8421c25c471aaf3293492f6c89c0/users/4e50865b49a449b4b2210a016bc3a3b3/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:04:24.324591 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80541e18-5811-41eb-93ac-7998d42f697e None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:24.325187 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80541e18-5811-41eb-93ac-7998d42f697e None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:24.325187 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80541e18-5811-41eb-93ac-7998d42f697e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:24.338803 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:04:24.354692 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-80541e18-5811-41eb-93ac-7998d42f697e None None] MFA Rules not processed for user `4e50865b49a449b4b2210a016bc3a3b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:04:24.355952 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-80541e18-5811-41eb-93ac-7998d42f697e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:04:24.422578 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1430/2848] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:04:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:04:24.438973 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01759a-ca51-4d25-aec1-6898203f67f1 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:24.438973 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-4c01759a-ca51-4d25-aec1-6898203f67f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:04:24.493668 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:04:24.521916 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01759a-ca51-4d25-aec1-6898203f67f1 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:24.526870 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e4637-8b75-46bc-a8b8-a3b6c2aaa029 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df7725203304d8fbe3a768656cabf23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:24.527538 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e4637-8b75-46bc-a8b8-a3b6c2aaa029 service glance] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:24.527815 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e4637-8b75-46bc-a8b8-a3b6c2aaa029 service glance] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:24.528084 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e4637-8b75-46bc-a8b8-a3b6c2aaa029 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:24.536774 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7e4637-8b75-46bc-a8b8-a3b6c2aaa029 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:24.538284 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7e4637-8b75-46bc-a8b8-a3b6c2aaa029 service glance] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:24.547967 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1419/2849] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:04:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:04:34.428377 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=29 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:04:34.643654 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=13 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:04:42.052019 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80541e18-5811-41eb-93ac-7998d42f697e None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:42.117348 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80541e18-5811-41eb-93ac-7998d42f697e None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:42.122687 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b5384-5e60-44b2-b891-90ff2b0c0eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:42.123351 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b5384-5e60-44b2-b891-90ff2b0c0eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:42.123629 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b5384-5e60-44b2-b891-90ff2b0c0eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:42.123898 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b5384-5e60-44b2-b891-90ff2b0c0eb8 admin admin] PATH_INFO: `/v3/users/4e50865b49a449b4b2210a016bc3a3b3` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:42.125020 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b5384-5e60-44b2-b891-90ff2b0c0eb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e50865b49a449b4b2210a016bc3a3b3)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:42.126938 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b5384-5e60-44b2-b891-90ff2b0c0eb8 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:42.293368 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-247b5384-5e60-44b2-b891-90ff2b0c0eb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e50865b49a449b4b2210a016bc3a3b3'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:42.300799 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-247b5384-5e60-44b2-b891-90ff2b0c0eb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e50865b49a449b4b2210a016bc3a3b3'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:42.386684 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-247b5384-5e60-44b2-b891-90ff2b0c0eb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e50865b49a449b4b2210a016bc3a3b3'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:42.387326 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-247b5384-5e60-44b2-b891-90ff2b0c0eb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e50865b49a449b4b2210a016bc3a3b3'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:42.408708 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-247b5384-5e60-44b2-b891-90ff2b0c0eb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e50865b49a449b4b2210a016bc3a3b3'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:42.414594 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1431/2850] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 08:04:42 2022] DELETE /identity/v3/users/4e50865b49a449b4b2210a016bc3a3b3 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:04:42.419993 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d4a54-a2b8-4845-88a5-0e5a3f47e13c None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:42.420592 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d4a54-a2b8-4845-88a5-0e5a3f47e13c None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:42.420592 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d4a54-a2b8-4845-88a5-0e5a3f47e13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:42.440082 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-9a7d4a54-a2b8-4845-88a5-0e5a3f47e13c None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:04:42.441312 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-9a7d4a54-a2b8-4845-88a5-0e5a3f47e13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:04:42.502880 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1420/2851] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:04:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:04:42.512608 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b5384-5e60-44b2-b891-90ff2b0c0eb8 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:42.514099 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-247b5384-5e60-44b2-b891-90ff2b0c0eb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:04:42.576062 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b5384-5e60-44b2-b891-90ff2b0c0eb8 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:42.579556 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff1844-5a8e-4fd0-84ee-83c759dec610 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:42.580164 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff1844-5a8e-4fd0-84ee-83c759dec610 service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:42.580446 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff1844-5a8e-4fd0-84ee-83c759dec610 service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:42.580724 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff1844-5a8e-4fd0-84ee-83c759dec610 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:42.590853 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff1844-5a8e-4fd0-84ee-83c759dec610 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:42.592331 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff1844-5a8e-4fd0-84ee-83c759dec610 service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:42.602511 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1432/2852] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:04:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:04:43.018550 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d4a54-a2b8-4845-88a5-0e5a3f47e13c None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:43.020002 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-9a7d4a54-a2b8-4845-88a5-0e5a3f47e13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:04:43.032857 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d4a54-a2b8-4845-88a5-0e5a3f47e13c None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:43.037561 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd22f6a-28af-47c7-a79d-2a06a947f566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:43.041823 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd22f6a-28af-47c7-a79d-2a06a947f566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:43.041823 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd22f6a-28af-47c7-a79d-2a06a947f566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:43.041823 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd22f6a-28af-47c7-a79d-2a06a947f566 admin admin] PATH_INFO: `/v3/projects/14be8421c25c471aaf3293492f6c89c0` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:43.041823 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd22f6a-28af-47c7-a79d-2a06a947f566 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14be8421c25c471aaf3293492f6c89c0)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:43.041823 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd22f6a-28af-47c7-a79d-2a06a947f566 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:43.132083 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-1fd22f6a-28af-47c7-a79d-2a06a947f566 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14be8421c25c471aaf3293492f6c89c0', 'request_id': 'req-1fd22f6a-28af-47c7-a79d-2a06a947f566'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:43.138167 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-1fd22f6a-28af-47c7-a79d-2a06a947f566 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14be8421c25c471aaf3293492f6c89c0', 'request_id': 'req-1fd22f6a-28af-47c7-a79d-2a06a947f566'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:43.209472 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-1fd22f6a-28af-47c7-a79d-2a06a947f566 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14be8421c25c471aaf3293492f6c89c0', 'request_id': 'req-1fd22f6a-28af-47c7-a79d-2a06a947f566'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:43.221726 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-1fd22f6a-28af-47c7-a79d-2a06a947f566 admin admin] The token cache is being invalidate because project 14be8421c25c471aaf3293492f6c89c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:04:43.222447 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-1fd22f6a-28af-47c7-a79d-2a06a947f566 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:43.222629 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-1fd22f6a-28af-47c7-a79d-2a06a947f566 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:43.224143 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1421/2853] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 08:04:43 2022] DELETE /identity/v3/projects/14be8421c25c471aaf3293492f6c89c0 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:04:43.229104 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789c701-64a3-4df7-b52d-2587281d8177 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:43.229601 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789c701-64a3-4df7-b52d-2587281d8177 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:43.229708 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789c701-64a3-4df7-b52d-2587281d8177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:43.250412 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-9789c701-64a3-4df7-b52d-2587281d8177 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:04:43.251645 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-9789c701-64a3-4df7-b52d-2587281d8177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:04:43.269697 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:04:43.314451 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1433/2854] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:04:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:04:43.322071 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0966168-b07b-4c99-9cdc-1def552f6f4f None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:43.323091 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0966168-b07b-4c99-9cdc-1def552f6f4f None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:43.323453 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0966168-b07b-4c99-9cdc-1def552f6f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:43.343193 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-d0966168-b07b-4c99-9cdc-1def552f6f4f None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:04:43.344583 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-d0966168-b07b-4c99-9cdc-1def552f6f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:04:43.352754 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1422/2855] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:04:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:04:43.357168 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9789c701-64a3-4df7-b52d-2587281d8177 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:43.367163 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9789c701-64a3-4df7-b52d-2587281d8177 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:43.379246 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db6584-407b-488f-b343-d0cf412d675b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:43.379884 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db6584-407b-488f-b343-d0cf412d675b admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:43.380165 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db6584-407b-488f-b343-d0cf412d675b admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:43.380440 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db6584-407b-488f-b343-d0cf412d675b admin admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:43.381135 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db6584-407b-488f-b343-d0cf412d675b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:04:43.381447 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db6584-407b-488f-b343-d0cf412d675b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:43.383132 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db6584-407b-488f-b343-d0cf412d675b admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:43.397237 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1434/2856] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 08:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:04:43.402127 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0966168-b07b-4c99-9cdc-1def552f6f4f None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:43.411707 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0966168-b07b-4c99-9cdc-1def552f6f4f None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:43.416496 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd29b7-6bd1-49eb-ba80-96759b0f5548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:43.417105 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd29b7-6bd1-49eb-ba80-96759b0f5548 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:43.417382 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd29b7-6bd1-49eb-ba80-96759b0f5548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:43.417655 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd29b7-6bd1-49eb-ba80-96759b0f5548 admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:43.418317 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd29b7-6bd1-49eb-ba80-96759b0f5548 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:43.420295 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd29b7-6bd1-49eb-ba80-96759b0f5548 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:43.521879 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1423/2857] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 08:04:43 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:04:43.526512 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db6584-407b-488f-b343-d0cf412d675b admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:43.537938 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db6584-407b-488f-b343-d0cf412d675b admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:43.607417 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747f76b-ea30-4862-bc9f-4631637ef032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:43.607938 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747f76b-ea30-4862-bc9f-4631637ef032 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:43.608214 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747f76b-ea30-4862-bc9f-4631637ef032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:43.608483 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747f76b-ea30-4862-bc9f-4631637ef032 admin admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:43.609179 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3747f76b-ea30-4862-bc9f-4631637ef032 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:43.611150 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3747f76b-ea30-4862-bc9f-4631637ef032 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:43.736679 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1435/2858] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 08:04:43 2022] POST /identity/v3/users => generated 292 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:04:43.738422 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd29b7-6bd1-49eb-ba80-96759b0f5548 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:43.752275 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd29b7-6bd1-49eb-ba80-96759b0f5548 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:43.757063 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823509a-bbee-415f-87b1-271b7c1006a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:43.757686 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823509a-bbee-415f-87b1-271b7c1006a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:43.757965 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823509a-bbee-415f-87b1-271b7c1006a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:43.758239 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823509a-bbee-415f-87b1-271b7c1006a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:43.758894 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823509a-bbee-415f-87b1-271b7c1006a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:43.761026 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823509a-bbee-415f-87b1-271b7c1006a9 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:43.776923 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1424/2859] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:04:43.778292 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747f76b-ea30-4862-bc9f-4631637ef032 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:43.789628 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747f76b-ea30-4862-bc9f-4631637ef032 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:43.796308 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad22d2-37a1-47eb-8e4c-b11a4e25f333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:43.796922 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad22d2-37a1-47eb-8e4c-b11a4e25f333 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:43.797202 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad22d2-37a1-47eb-8e4c-b11a4e25f333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:43.797474 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad22d2-37a1-47eb-8e4c-b11a4e25f333 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:43.798126 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fad22d2-37a1-47eb-8e4c-b11a4e25f333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:43.799767 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fad22d2-37a1-47eb-8e4c-b11a4e25f333 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:43.811563 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1436/2860] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:04:43.818378 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823509a-bbee-415f-87b1-271b7c1006a9 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:43.831905 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823509a-bbee-415f-87b1-271b7c1006a9 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:43.836483 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab7764-90ce-4570-becd-b1f401e7f958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:43.837428 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab7764-90ce-4570-becd-b1f401e7f958 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:43.837735 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab7764-90ce-4570-becd-b1f401e7f958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:43.838068 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab7764-90ce-4570-becd-b1f401e7f958 admin admin] PATH_INFO: `/v3/projects/8dd3a4480d6e4c61a226b7fecd89f313/users/f84ab2dfb4c24c1a8a0cddda1a34183b/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:43.855020 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab7764-90ce-4570-becd-b1f401e7f958 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dd3a4480d6e4c61a226b7fecd89f313, user_id=f84ab2dfb4c24c1a8a0cddda1a34183b, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:43.857726 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab7764-90ce-4570-becd-b1f401e7f958 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:43.925437 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1425/2861] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 08:04:43 2022] PUT /identity/v3/projects/8dd3a4480d6e4c61a226b7fecd89f313/users/f84ab2dfb4c24c1a8a0cddda1a34183b/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:04:43.936579 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20003b47-03b4-4b74-b7f6-2798b305f8f3 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:43.936842 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20003b47-03b4-4b74-b7f6-2798b305f8f3 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:43.937117 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20003b47-03b4-4b74-b7f6-2798b305f8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:43.967116 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-20003b47-03b4-4b74-b7f6-2798b305f8f3 None None] MFA Rules not processed for user `f84ab2dfb4c24c1a8a0cddda1a34183b`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:04:43.968355 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-20003b47-03b4-4b74-b7f6-2798b305f8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:04:44.045437 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1437/2862] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:04:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:04:44.056907 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab7764-90ce-4570-becd-b1f401e7f958 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:44.058801 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-5fab7764-90ce-4570-becd-b1f401e7f958 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:04:44.081133 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:04:44.116995 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab7764-90ce-4570-becd-b1f401e7f958 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:44.121625 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739586b-7a86-4eaf-9fbc-d53e51350a80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:44.122234 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739586b-7a86-4eaf-9fbc-d53e51350a80 service cinder] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:44.122514 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739586b-7a86-4eaf-9fbc-d53e51350a80 service cinder] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:44.122784 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739586b-7a86-4eaf-9fbc-d53e51350a80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:44.131109 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8739586b-7a86-4eaf-9fbc-d53e51350a80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:44.132528 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8739586b-7a86-4eaf-9fbc-d53e51350a80 service cinder] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:44.142088 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1426/2863] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:04:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 08:04:47.228455 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20003b47-03b4-4b74-b7f6-2798b305f8f3 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:47.248773 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:04:47.293343 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20003b47-03b4-4b74-b7f6-2798b305f8f3 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:47.298343 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d73cf-4667-4d3d-8cb8-be99378d39d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:47.299819 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d73cf-4667-4d3d-8cb8-be99378d39d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:47.299819 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d73cf-4667-4d3d-8cb8-be99378d39d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:47.299819 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d73cf-4667-4d3d-8cb8-be99378d39d8 admin admin] PATH_INFO: `/v3/users/f84ab2dfb4c24c1a8a0cddda1a34183b` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:47.300743 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d73cf-4667-4d3d-8cb8-be99378d39d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f84ab2dfb4c24c1a8a0cddda1a34183b)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:47.302653 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d73cf-4667-4d3d-8cb8-be99378d39d8 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:47.591990 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-115d73cf-4667-4d3d-8cb8-be99378d39d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f84ab2dfb4c24c1a8a0cddda1a34183b'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:47.599007 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-115d73cf-4667-4d3d-8cb8-be99378d39d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f84ab2dfb4c24c1a8a0cddda1a34183b'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:47.713615 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-115d73cf-4667-4d3d-8cb8-be99378d39d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f84ab2dfb4c24c1a8a0cddda1a34183b'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:47.714275 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-115d73cf-4667-4d3d-8cb8-be99378d39d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f84ab2dfb4c24c1a8a0cddda1a34183b'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:47.730130 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-115d73cf-4667-4d3d-8cb8-be99378d39d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f84ab2dfb4c24c1a8a0cddda1a34183b'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:47.736413 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1438/2864] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 08:04:47 2022] DELETE /identity/v3/users/f84ab2dfb4c24c1a8a0cddda1a34183b => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:04:47.740968 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ad767-294c-4b8c-9845-adc2c5b65a5b None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:47.741476 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ad767-294c-4b8c-9845-adc2c5b65a5b None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:47.741586 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ad767-294c-4b8c-9845-adc2c5b65a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:47.760958 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-212ad767-294c-4b8c-9845-adc2c5b65a5b None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:04:47.762167 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-212ad767-294c-4b8c-9845-adc2c5b65a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:04:47.822711 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1427/2865] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:04:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:04:47.832686 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d73cf-4667-4d3d-8cb8-be99378d39d8 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:47.834330 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-115d73cf-4667-4d3d-8cb8-be99378d39d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:04:47.892986 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d73cf-4667-4d3d-8cb8-be99378d39d8 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:47.898349 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1db56d-3c2b-49a4-a0c5-dd0c24738797 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:47.898972 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1db56d-3c2b-49a4-a0c5-dd0c24738797 service neutron] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:47.899281 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1db56d-3c2b-49a4-a0c5-dd0c24738797 service neutron] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:47.899558 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1db56d-3c2b-49a4-a0c5-dd0c24738797 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:47.910067 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1db56d-3c2b-49a4-a0c5-dd0c24738797 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:47.911715 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1db56d-3c2b-49a4-a0c5-dd0c24738797 service neutron] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:47.922302 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1439/2866] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:04:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:04:48.355861 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ad767-294c-4b8c-9845-adc2c5b65a5b None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:48.357290 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-212ad767-294c-4b8c-9845-adc2c5b65a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:04:48.370220 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ad767-294c-4b8c-9845-adc2c5b65a5b None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:48.379918 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c7743-cbb4-4635-9ee6-ab7d8542e34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:48.380710 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c7743-cbb4-4635-9ee6-ab7d8542e34f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:48.380996 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c7743-cbb4-4635-9ee6-ab7d8542e34f admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:48.381273 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c7743-cbb4-4635-9ee6-ab7d8542e34f admin admin] PATH_INFO: `/v3/projects/8dd3a4480d6e4c61a226b7fecd89f313` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:48.382497 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c7743-cbb4-4635-9ee6-ab7d8542e34f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dd3a4480d6e4c61a226b7fecd89f313)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:48.388571 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c7743-cbb4-4635-9ee6-ab7d8542e34f admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:48.519616 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-1f4c7743-cbb4-4635-9ee6-ab7d8542e34f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dd3a4480d6e4c61a226b7fecd89f313', 'request_id': 'req-1f4c7743-cbb4-4635-9ee6-ab7d8542e34f'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:48.525238 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-1f4c7743-cbb4-4635-9ee6-ab7d8542e34f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dd3a4480d6e4c61a226b7fecd89f313', 'request_id': 'req-1f4c7743-cbb4-4635-9ee6-ab7d8542e34f'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:48.599351 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-1f4c7743-cbb4-4635-9ee6-ab7d8542e34f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dd3a4480d6e4c61a226b7fecd89f313', 'request_id': 'req-1f4c7743-cbb4-4635-9ee6-ab7d8542e34f'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:48.611238 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-1f4c7743-cbb4-4635-9ee6-ab7d8542e34f admin admin] The token cache is being invalidate because project 8dd3a4480d6e4c61a226b7fecd89f313 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:04:48.617245 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-1f4c7743-cbb4-4635-9ee6-ab7d8542e34f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:48.617245 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-1f4c7743-cbb4-4635-9ee6-ab7d8542e34f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:04:48.617245 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1428/2867] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 08:04:48 2022] DELETE /identity/v3/projects/8dd3a4480d6e4c61a226b7fecd89f313 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:04:48.619403 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614e776-c1be-4407-b032-bf64852a2842 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:48.619904 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614e776-c1be-4407-b032-bf64852a2842 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:48.620018 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614e776-c1be-4407-b032-bf64852a2842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:48.641202 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-4614e776-c1be-4407-b032-bf64852a2842 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:04:48.642561 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-4614e776-c1be-4407-b032-bf64852a2842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:04:48.675101 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:04:48.701618 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1440/2868] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:04:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:04:48.710707 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d122a-7833-494c-b95a-b0b236dd9c41 None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:48.711024 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d122a-7833-494c-b95a-b0b236dd9c41 None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:48.711313 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d122a-7833-494c-b95a-b0b236dd9c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:48.741171 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-5c5d122a-7833-494c-b95a-b0b236dd9c41 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:04:48.742321 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-5c5d122a-7833-494c-b95a-b0b236dd9c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:04:48.751924 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1429/2869] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:04:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:04:48.756460 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614e776-c1be-4407-b032-bf64852a2842 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:48.767938 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614e776-c1be-4407-b032-bf64852a2842 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:48.775199 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906e557-b739-423e-875b-8b4ab4287f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:48.775825 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906e557-b739-423e-875b-8b4ab4287f31 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:48.776296 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906e557-b739-423e-875b-8b4ab4287f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:48.776567 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906e557-b739-423e-875b-8b4ab4287f31 admin admin] PATH_INFO: `/v3/domains` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:48.777221 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906e557-b739-423e-875b-8b4ab4287f31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:04:48.777522 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906e557-b739-423e-875b-8b4ab4287f31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:48.779155 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906e557-b739-423e-875b-8b4ab4287f31 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:48.792334 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1441/2870] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 08:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:04:48.796986 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d122a-7833-494c-b95a-b0b236dd9c41 None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:48.812630 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d122a-7833-494c-b95a-b0b236dd9c41 None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:48.817500 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc4834-1455-4f59-b142-e104c0abc7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:48.818113 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc4834-1455-4f59-b142-e104c0abc7ee admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:48.818395 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc4834-1455-4f59-b142-e104c0abc7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:48.818670 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc4834-1455-4f59-b142-e104c0abc7ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:48.819359 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc4834-1455-4f59-b142-e104c0abc7ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:48.821255 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc4834-1455-4f59-b142-e104c0abc7ee admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:48.904512 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1430/2871] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 08:04:48 2022] POST /identity/v3/projects => generated 369 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:04:48.908528 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906e557-b739-423e-875b-8b4ab4287f31 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:48.919242 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906e557-b739-423e-875b-8b4ab4287f31 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:48.977628 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde5f6a-d23a-4f59-893d-106443cd62d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:48.978761 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde5f6a-d23a-4f59-893d-106443cd62d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:48.979076 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde5f6a-d23a-4f59-893d-106443cd62d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:48.979348 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde5f6a-d23a-4f59-893d-106443cd62d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:48.980036 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde5f6a-d23a-4f59-893d-106443cd62d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:48.981912 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde5f6a-d23a-4f59-893d-106443cd62d0 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:49.068086 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1442/2872] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 08:04:48 2022] POST /identity/v3/users => generated 285 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:04:49.072870 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc4834-1455-4f59-b142-e104c0abc7ee admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:49.084506 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc4834-1455-4f59-b142-e104c0abc7ee admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:49.089780 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a9f40-d0ab-424c-9d57-ee94f25e6b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:49.090449 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a9f40-d0ab-424c-9d57-ee94f25e6b84 admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:49.090727 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a9f40-d0ab-424c-9d57-ee94f25e6b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:49.091014 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a9f40-d0ab-424c-9d57-ee94f25e6b84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:49.091859 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a9f40-d0ab-424c-9d57-ee94f25e6b84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:49.093472 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a9f40-d0ab-424c-9d57-ee94f25e6b84 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:49.105824 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1431/2873] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:04:49.109972 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde5f6a-d23a-4f59-893d-106443cd62d0 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:49.121154 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde5f6a-d23a-4f59-893d-106443cd62d0 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:49.127016 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820858db-9bb1-4977-9db3-a6f4746379f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:49.127644 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820858db-9bb1-4977-9db3-a6f4746379f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:49.127911 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820858db-9bb1-4977-9db3-a6f4746379f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:49.128182 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820858db-9bb1-4977-9db3-a6f4746379f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:49.128831 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820858db-9bb1-4977-9db3-a6f4746379f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:49.131296 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820858db-9bb1-4977-9db3-a6f4746379f4 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:49.142583 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1443/2874] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:04:49.146743 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a9f40-d0ab-424c-9d57-ee94f25e6b84 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:49.158131 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a9f40-d0ab-424c-9d57-ee94f25e6b84 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:49.162838 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f463e7f-5abc-43de-9b38-bdd9dfb74fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:49.163525 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f463e7f-5abc-43de-9b38-bdd9dfb74fc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:49.163802 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f463e7f-5abc-43de-9b38-bdd9dfb74fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:49.164072 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f463e7f-5abc-43de-9b38-bdd9dfb74fc1 admin admin] PATH_INFO: `/v3/projects/34b01e3376444e5fab023eacf234a891/users/7fcd3d193efe43b3b8ba8140e47a5f1a/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:49.167062 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:04:49.180141 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f463e7f-5abc-43de-9b38-bdd9dfb74fc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34b01e3376444e5fab023eacf234a891, user_id=7fcd3d193efe43b3b8ba8140e47a5f1a, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:49.182909 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f463e7f-5abc-43de-9b38-bdd9dfb74fc1 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:49.274025 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1432/2875] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 08:04:49 2022] PUT /identity/v3/projects/34b01e3376444e5fab023eacf234a891/users/7fcd3d193efe43b3b8ba8140e47a5f1a/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:04:49.284973 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2cd9d9-0e0c-4cf2-b28b-866e58235986 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:49.285259 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2cd9d9-0e0c-4cf2-b28b-866e58235986 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:49.285530 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2cd9d9-0e0c-4cf2-b28b-866e58235986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:49.315586 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-cc2cd9d9-0e0c-4cf2-b28b-866e58235986 None None] MFA Rules not processed for user `7fcd3d193efe43b3b8ba8140e47a5f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:04:49.317031 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-cc2cd9d9-0e0c-4cf2-b28b-866e58235986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:04:49.385223 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1444/2876] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:04:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:04:49.398387 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f463e7f-5abc-43de-9b38-bdd9dfb74fc1 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:04:49.400966 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-6f463e7f-5abc-43de-9b38-bdd9dfb74fc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:04:49.475436 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f463e7f-5abc-43de-9b38-bdd9dfb74fc1 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:04:49.479717 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d666dfc-041e-4ff9-9b16-966fc2bd5d0d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df7725203304d8fbe3a768656cabf23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:04:49.480343 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d666dfc-041e-4ff9-9b16-966fc2bd5d0d service glance] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:04:49.480636 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d666dfc-041e-4ff9-9b16-966fc2bd5d0d service glance] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:04:49.481012 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d666dfc-041e-4ff9-9b16-966fc2bd5d0d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:04:49.489648 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d666dfc-041e-4ff9-9b16-966fc2bd5d0d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:04:49.491096 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d666dfc-041e-4ff9-9b16-966fc2bd5d0d service glance] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:04:49.500899 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1433/2877] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:04:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:04:59.381829 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:04:59.497105 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=33,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:05:13.157107 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2cd9d9-0e0c-4cf2-b28b-866e58235986 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:05:13.158632 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-cc2cd9d9-0e0c-4cf2-b28b-866e58235986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:05:13.232991 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2cd9d9-0e0c-4cf2-b28b-866e58235986 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:05:13.237993 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34b0ca-301c-473e-bf5f-3f520196aa31 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c2bc293f1b4daca83e8d6dff66a316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:05:13.238603 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34b0ca-301c-473e-bf5f-3f520196aa31 service placement] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:05:13.238888 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34b0ca-301c-473e-bf5f-3f520196aa31 service placement] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:05:13.239192 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34b0ca-301c-473e-bf5f-3f520196aa31 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:05:13.240926 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-bb34b0ca-301c-473e-bf5f-3f520196aa31 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:05:13.253480 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34b0ca-301c-473e-bf5f-3f520196aa31 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:05:13.255091 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34b0ca-301c-473e-bf5f-3f520196aa31 service placement] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:05:13.265791 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1445/2878] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:05:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:05:19.468525 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d666dfc-041e-4ff9-9b16-966fc2bd5d0d service glance] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:05:19.536992 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d666dfc-041e-4ff9-9b16-966fc2bd5d0d service glance] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:05:19.542683 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb9907-cebf-4f0e-b4d0-c381be3c96a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:05:19.543360 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb9907-cebf-4f0e-b4d0-c381be3c96a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:05:19.543645 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb9907-cebf-4f0e-b4d0-c381be3c96a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:05:19.543925 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb9907-cebf-4f0e-b4d0-c381be3c96a7 admin admin] PATH_INFO: `/v3/users/7fcd3d193efe43b3b8ba8140e47a5f1a` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:05:19.545126 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb9907-cebf-4f0e-b4d0-c381be3c96a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fcd3d193efe43b3b8ba8140e47a5f1a)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:05:19.547073 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb9907-cebf-4f0e-b4d0-c381be3c96a7 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:05:19.853625 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-31cb9907-cebf-4f0e-b4d0-c381be3c96a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fcd3d193efe43b3b8ba8140e47a5f1a'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:05:19.854317 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-31cb9907-cebf-4f0e-b4d0-c381be3c96a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fcd3d193efe43b3b8ba8140e47a5f1a'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:05:19.976398 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-31cb9907-cebf-4f0e-b4d0-c381be3c96a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fcd3d193efe43b3b8ba8140e47a5f1a'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:05:19.977125 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-31cb9907-cebf-4f0e-b4d0-c381be3c96a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fcd3d193efe43b3b8ba8140e47a5f1a'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:05:19.985760 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-31cb9907-cebf-4f0e-b4d0-c381be3c96a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fcd3d193efe43b3b8ba8140e47a5f1a'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:05:20.003880 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1434/2879] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 08:05:19 2022] DELETE /identity/v3/users/7fcd3d193efe43b3b8ba8140e47a5f1a => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:05:20.008508 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae0b2e-b587-4f45-815c-8bb382af9a19 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:05:20.009324 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae0b2e-b587-4f45-815c-8bb382af9a19 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:05:20.009324 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae0b2e-b587-4f45-815c-8bb382af9a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:05:20.030285 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-daae0b2e-b587-4f45-815c-8bb382af9a19 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:05:20.031471 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-daae0b2e-b587-4f45-815c-8bb382af9a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:05:20.097359 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1446/2880] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:05:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:05:20.107895 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb9907-cebf-4f0e-b4d0-c381be3c96a7 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:05:20.109567 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-31cb9907-cebf-4f0e-b4d0-c381be3c96a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:05:20.172124 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb9907-cebf-4f0e-b4d0-c381be3c96a7 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:05:20.177921 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b9973e-89a6-4dfa-9406-2993b875a893 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:05:20.178849 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9973e-89a6-4dfa-9406-2993b875a893 service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:05:20.179300 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9973e-89a6-4dfa-9406-2993b875a893 service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:05:20.179764 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9973e-89a6-4dfa-9406-2993b875a893 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:05:20.195502 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b9973e-89a6-4dfa-9406-2993b875a893 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:05:20.196869 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b9973e-89a6-4dfa-9406-2993b875a893 service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:05:20.208206 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1435/2881] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:05:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 08:05:20.687691 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae0b2e-b587-4f45-815c-8bb382af9a19 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:05:20.689247 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-daae0b2e-b587-4f45-815c-8bb382af9a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:05:20.705315 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae0b2e-b587-4f45-815c-8bb382af9a19 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:05:20.708559 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd3c716-a9dc-4427-91c6-83606ea8b4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:05:20.709404 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3c716-a9dc-4427-91c6-83606ea8b4c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:05:20.709743 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3c716-a9dc-4427-91c6-83606ea8b4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:05:20.710076 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3c716-a9dc-4427-91c6-83606ea8b4c2 admin admin] PATH_INFO: `/v3/projects/34b01e3376444e5fab023eacf234a891` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:05:20.711501 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd3c716-a9dc-4427-91c6-83606ea8b4c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34b01e3376444e5fab023eacf234a891)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:05:20.715183 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd3c716-a9dc-4427-91c6-83606ea8b4c2 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:05:20.854458 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-9bd3c716-a9dc-4427-91c6-83606ea8b4c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34b01e3376444e5fab023eacf234a891', 'request_id': 'req-9bd3c716-a9dc-4427-91c6-83606ea8b4c2'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:05:20.860948 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-9bd3c716-a9dc-4427-91c6-83606ea8b4c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34b01e3376444e5fab023eacf234a891', 'request_id': 'req-9bd3c716-a9dc-4427-91c6-83606ea8b4c2'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:05:20.867792 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-9bd3c716-a9dc-4427-91c6-83606ea8b4c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34b01e3376444e5fab023eacf234a891', 'request_id': 'req-9bd3c716-a9dc-4427-91c6-83606ea8b4c2'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:05:20.965489 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-9bd3c716-a9dc-4427-91c6-83606ea8b4c2 admin admin] The token cache is being invalidate because project 34b01e3376444e5fab023eacf234a891 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:05:20.965776 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-9bd3c716-a9dc-4427-91c6-83606ea8b4c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:05:20.966382 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-9bd3c716-a9dc-4427-91c6-83606ea8b4c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:05:20.967971 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1447/2882] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 08:05:20 2022] DELETE /identity/v3/projects/34b01e3376444e5fab023eacf234a891 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:05:20.973166 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a99d95-df93-44ab-bebd-35cff71374fa None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:05:20.973740 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a99d95-df93-44ab-bebd-35cff71374fa None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:05:20.973740 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a99d95-df93-44ab-bebd-35cff71374fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:05:20.998139 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-33a99d95-df93-44ab-bebd-35cff71374fa None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:05:20.999426 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-33a99d95-df93-44ab-bebd-35cff71374fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:05:21.018270 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:05:21.078475 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1436/2883] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:05:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 08:05:21.086861 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997ed68-a761-4ff3-be30-f1092f76a9c3 None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:05:21.088567 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997ed68-a761-4ff3-be30-f1092f76a9c3 None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:05:21.088853 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997ed68-a761-4ff3-be30-f1092f76a9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:05:21.111653 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-5997ed68-a761-4ff3-be30-f1092f76a9c3 None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:05:21.118466 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-5997ed68-a761-4ff3-be30-f1092f76a9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:05:21.121951 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1448/2884] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:05:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:05:21.126130 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a99d95-df93-44ab-bebd-35cff71374fa None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:05:21.139742 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a99d95-df93-44ab-bebd-35cff71374fa None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:05:21.142615 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89b051-cd14-406f-bd05-8fd125f01d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:05:21.143250 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89b051-cd14-406f-bd05-8fd125f01d2c admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:05:21.143529 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89b051-cd14-406f-bd05-8fd125f01d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:05:21.143808 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89b051-cd14-406f-bd05-8fd125f01d2c admin admin] PATH_INFO: `/v3/domains` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:05:21.144445 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89b051-cd14-406f-bd05-8fd125f01d2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 08:05:21.144743 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89b051-cd14-406f-bd05-8fd125f01d2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:05:21.146328 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89b051-cd14-406f-bd05-8fd125f01d2c admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:05:21.159614 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1437/2885] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Aug 26 08:05:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 08:05:21.172112 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5997ed68-a761-4ff3-be30-f1092f76a9c3 None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:05:21.177644 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5997ed68-a761-4ff3-be30-f1092f76a9c3 None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:05:21.182455 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f692436a-9ecc-4688-87da-9ac254f65b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:05:21.183093 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692436a-9ecc-4688-87da-9ac254f65b55 admin admin] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:05:21.183370 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692436a-9ecc-4688-87da-9ac254f65b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:05:21.183641 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692436a-9ecc-4688-87da-9ac254f65b55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:05:21.184307 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f692436a-9ecc-4688-87da-9ac254f65b55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:05:21.186193 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f692436a-9ecc-4688-87da-9ac254f65b55 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:05:21.190686 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:05:21.344401 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1449/2886] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Aug 26 08:05:21 2022] POST /identity/v3/projects => generated 373 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 08:05:21.348372 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89b051-cd14-406f-bd05-8fd125f01d2c admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:05:21.359322 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89b051-cd14-406f-bd05-8fd125f01d2c admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:05:21.418390 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a7572-9146-4a7f-81d2-e9cf2d3bf366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:05:21.419013 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a7572-9146-4a7f-81d2-e9cf2d3bf366 admin admin] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:05:21.419313 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a7572-9146-4a7f-81d2-e9cf2d3bf366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:05:21.419582 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a7572-9146-4a7f-81d2-e9cf2d3bf366 admin admin] PATH_INFO: `/v3/users` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:05:21.420214 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a7572-9146-4a7f-81d2-e9cf2d3bf366 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:05:21.422147 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a7572-9146-4a7f-81d2-e9cf2d3bf366 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:05:21.530558 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1438/2887] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Aug 26 08:05:21 2022] POST /identity/v3/users => generated 287 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 08:05:21.534627 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f692436a-9ecc-4688-87da-9ac254f65b55 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:05:21.546415 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f692436a-9ecc-4688-87da-9ac254f65b55 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:05:21.551110 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47d62e-9aa4-482f-8326-de72b0ac9323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:05:21.551718 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47d62e-9aa4-482f-8326-de72b0ac9323 admin admin] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:05:21.551997 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47d62e-9aa4-482f-8326-de72b0ac9323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:05:21.552267 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47d62e-9aa4-482f-8326-de72b0ac9323 admin admin] PATH_INFO: `/v3/roles` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:05:21.552909 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b47d62e-9aa4-482f-8326-de72b0ac9323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:05:21.554520 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b47d62e-9aa4-482f-8326-de72b0ac9323 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:05:21.565396 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1450/2888] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:05:21.569389 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a7572-9146-4a7f-81d2-e9cf2d3bf366 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:05:21.580702 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a7572-9146-4a7f-81d2-e9cf2d3bf366 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:05:21.585652 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3697f-84ac-41c1-8ca5-b05a945c60ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:05:21.586250 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3697f-84ac-41c1-8ca5-b05a945c60ec admin admin] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:05:21.586526 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3697f-84ac-41c1-8ca5-b05a945c60ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:05:21.586796 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3697f-84ac-41c1-8ca5-b05a945c60ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:05:21.588083 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3697f-84ac-41c1-8ca5-b05a945c60ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:05:21.589677 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3697f-84ac-41c1-8ca5-b05a945c60ec admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:05:21.600329 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1439/2889] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Aug 26 08:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 08:05:21.608430 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47d62e-9aa4-482f-8326-de72b0ac9323 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:05:21.620364 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47d62e-9aa4-482f-8326-de72b0ac9323 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:05:21.625189 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ee3e6-58f8-4058-803c-67e629fdb897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:05:21.625867 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ee3e6-58f8-4058-803c-67e629fdb897 admin admin] REQUEST_METHOD: `PUT` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:05:21.626149 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ee3e6-58f8-4058-803c-67e629fdb897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:05:21.626426 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ee3e6-58f8-4058-803c-67e629fdb897 admin admin] PATH_INFO: `/v3/projects/3b987c6ca5d14edaa6f4228b286606ce/users/7dc6efadb8124752bff67b2ee3a12c78/roles/854d2a8e89d94d8685ff7d5dc70494b5` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:05:21.645232 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ee3e6-58f8-4058-803c-67e629fdb897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b987c6ca5d14edaa6f4228b286606ce, user_id=7dc6efadb8124752bff67b2ee3a12c78, role_id=854d2a8e89d94d8685ff7d5dc70494b5)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:05:21.647886 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ee3e6-58f8-4058-803c-67e629fdb897 admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:05:21.724937 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1451/2890] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Aug 26 08:05:21 2022] PUT /identity/v3/projects/3b987c6ca5d14edaa6f4228b286606ce/users/7dc6efadb8124752bff67b2ee3a12c78/roles/854d2a8e89d94d8685ff7d5dc70494b5 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:05:21.736036 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04812409-b50d-40dc-839a-1887cb50e3af None None] REQUEST_METHOD: `POST` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:05:21.736456 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04812409-b50d-40dc-839a-1887cb50e3af None None] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:05:21.736636 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04812409-b50d-40dc-839a-1887cb50e3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:05:21.768527 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.auth.core [None req-04812409-b50d-40dc-839a-1887cb50e3af None None] MFA Rules not processed for user `7dc6efadb8124752bff67b2ee3a12c78`. Rule list: `[]` (Enabled: `True`). {{(pid=81927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:05:21.769779 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-04812409-b50d-40dc-839a-1887cb50e3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:05:21.839215 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1440/2891] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:05:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:05:21.858226 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ee3e6-58f8-4058-803c-67e629fdb897 admin admin] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:05:21.858226 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-f76ee3e6-58f8-4058-803c-67e629fdb897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:05:21.911807 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ee3e6-58f8-4058-803c-67e629fdb897 admin admin] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:05:21.915439 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca8639-b675-460e-ae2e-645515b5c03a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f23fe4069f39499c9ed8e27566eddc77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:05:21.916697 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca8639-b675-460e-ae2e-645515b5c03a service cinder] REQUEST_METHOD: `GET` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:05:21.917175 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca8639-b675-460e-ae2e-645515b5c03a service cinder] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:05:21.917445 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca8639-b675-460e-ae2e-645515b5c03a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:05:21.925734 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca8639-b675-460e-ae2e-645515b5c03a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:05:21.927193 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca8639-b675-460e-ae2e-645515b5c03a service cinder] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:05:21.937148 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1452/2892] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:05:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:05:31.835497 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:05:31.933073 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=47,keystone:INSERT=2 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:05:33.802049 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04812409-b50d-40dc-839a-1887cb50e3af None None] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:05:33.872414 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04812409-b50d-40dc-839a-1887cb50e3af None None] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:05:33.878423 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a362e27-25f1-4c24-a2e3-b9fb1226abb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:05:33.879170 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a362e27-25f1-4c24-a2e3-b9fb1226abb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:05:33.879454 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a362e27-25f1-4c24-a2e3-b9fb1226abb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:05:33.879743 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a362e27-25f1-4c24-a2e3-b9fb1226abb1 admin admin] PATH_INFO: `/v3/users/7dc6efadb8124752bff67b2ee3a12c78` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:05:33.880907 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a362e27-25f1-4c24-a2e3-b9fb1226abb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dc6efadb8124752bff67b2ee3a12c78)` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:05:33.882862 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a362e27-25f1-4c24-a2e3-b9fb1226abb1 admin admin] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:05:34.224871 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-0a362e27-25f1-4c24-a2e3-b9fb1226abb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dc6efadb8124752bff67b2ee3a12c78'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:05:34.225538 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-0a362e27-25f1-4c24-a2e3-b9fb1226abb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dc6efadb8124752bff67b2ee3a12c78'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:05:34.329659 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-0a362e27-25f1-4c24-a2e3-b9fb1226abb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dc6efadb8124752bff67b2ee3a12c78'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:05:34.330296 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-0a362e27-25f1-4c24-a2e3-b9fb1226abb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dc6efadb8124752bff67b2ee3a12c78'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:05:34.339244 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.notifications [None req-0a362e27-25f1-4c24-a2e3-b9fb1226abb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dc6efadb8124752bff67b2ee3a12c78'} {{(pid=81927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:05:34.357681 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1441/2893] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Aug 26 08:05:33 2022] DELETE /identity/v3/users/7dc6efadb8124752bff67b2ee3a12c78 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:05:34.365466 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b696b4b-4ab1-4a32-820f-127763dea43c None None] REQUEST_METHOD: `POST` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:05:34.366708 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b696b4b-4ab1-4a32-820f-127763dea43c None None] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:05:34.366708 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b696b4b-4ab1-4a32-820f-127763dea43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:05:34.385520 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.auth.core [None req-6b696b4b-4ab1-4a32-820f-127763dea43c None None] MFA Rules not processed for user `373a698192574b4b8cacbfbcfee3991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 08:05:34.386730 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-6b696b4b-4ab1-4a32-820f-127763dea43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:05:34.448120 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1453/2894] 10.222.0.42 () {58 vars in 958 bytes} [Fri Aug 26 08:05:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 08:05:34.458437 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a362e27-25f1-4c24-a2e3-b9fb1226abb1 admin admin] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:05:34.460167 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-0a362e27-25f1-4c24-a2e3-b9fb1226abb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:05:34.521168 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a362e27-25f1-4c24-a2e3-b9fb1226abb1 admin admin] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:05:34.524927 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b137d-6f82-4164-b2ce-2404d6bc1844 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5ea9916c82647f3a645f1a4258f558b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:05:34.525536 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b137d-6f82-4164-b2ce-2404d6bc1844 service neutron] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:05:34.526603 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b137d-6f82-4164-b2ce-2404d6bc1844 service neutron] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:05:34.526884 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b137d-6f82-4164-b2ce-2404d6bc1844 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:05:34.536671 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b137d-6f82-4164-b2ce-2404d6bc1844 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:05:34.538104 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b137d-6f82-4164-b2ce-2404d6bc1844 service neutron] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:05:34.548836 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1442/2895] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:05:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:05:35.040529 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b696b4b-4ab1-4a32-820f-127763dea43c None None] Authenticating user token {{(pid=81926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:05:35.043013 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.fernet_utils [None req-6b696b4b-4ab1-4a32-820f-127763dea43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:05:35.056626 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b696b4b-4ab1-4a32-820f-127763dea43c None None] Validating token access rules against request {{(pid=81926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:05:35.062364 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c1e85-da10-48b2-bb1b-c540f7755ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '373a698192574b4b8cacbfbcfee3991d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05529a2e6f734315b4cede55fbcb5c2c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:05:35.063215 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c1e85-da10-48b2-bb1b-c540f7755ecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:05:35.063503 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c1e85-da10-48b2-bb1b-c540f7755ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:05:35.063790 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c1e85-da10-48b2-bb1b-c540f7755ecd admin admin] PATH_INFO: `/v3/projects/3b987c6ca5d14edaa6f4228b286606ce` {{(pid=81926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:05:35.065190 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c1e85-da10-48b2-bb1b-c540f7755ecd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b987c6ca5d14edaa6f4228b286606ce)` {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:05:35.067287 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c1e85-da10-48b2-bb1b-c540f7755ecd admin admin] RBAC: Authorization granted {{(pid=81926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:05:35.202377 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-307c1e85-da10-48b2-bb1b-c540f7755ecd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b987c6ca5d14edaa6f4228b286606ce', 'request_id': 'req-307c1e85-da10-48b2-bb1b-c540f7755ecd'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:05:35.208623 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-307c1e85-da10-48b2-bb1b-c540f7755ecd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b987c6ca5d14edaa6f4228b286606ce', 'request_id': 'req-307c1e85-da10-48b2-bb1b-c540f7755ecd'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:05:35.218627 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-307c1e85-da10-48b2-bb1b-c540f7755ecd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b987c6ca5d14edaa6f4228b286606ce', 'request_id': 'req-307c1e85-da10-48b2-bb1b-c540f7755ecd'} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:05:35.358502 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-307c1e85-da10-48b2-bb1b-c540f7755ecd admin admin] The token cache is being invalidate because project 3b987c6ca5d14edaa6f4228b286606ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 08:05:35.358840 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-307c1e85-da10-48b2-bb1b-c540f7755ecd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:05:35.359465 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG keystone.notifications [None req-307c1e85-da10-48b2-bb1b-c540f7755ecd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 08:05:35.360945 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: [pid: 81926|app: 0|req: 1454/2896] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Aug 26 08:05:35 2022] DELETE /identity/v3/projects/3b987c6ca5d14edaa6f4228b286606ce => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 08:05:44.543916 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:05:45.354931 dv-cinder-806605-7-iscsi devstack@keystone.service[81926]: DEBUG dbcounter [-] [81926] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 08:10:15.429036 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b137d-6f82-4164-b2ce-2404d6bc1844 service neutron] Authenticating user token {{(pid=81927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 08:10:15.430439 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-ab2b137d-6f82-4164-b2ce-2404d6bc1844 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:10:15.581473 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b137d-6f82-4164-b2ce-2404d6bc1844 service neutron] Validating token access rules against request {{(pid=81927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 08:10:15.662515 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d1f50-ad7f-491f-88a6-e981783e0ee8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c2bc293f1b4daca83e8d6dff66a316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'becbf57e91454d499dec313ff9eadfae', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 08:10:15.663184 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d1f50-ad7f-491f-88a6-e981783e0ee8 service placement] REQUEST_METHOD: `GET` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 08:10:15.663446 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d1f50-ad7f-491f-88a6-e981783e0ee8 service placement] SCRIPT_NAME: `/identity` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 08:10:15.663744 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d1f50-ad7f-491f-88a6-e981783e0ee8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 08:10:15.665461 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.fernet_utils [None req-635d1f50-ad7f-491f-88a6-e981783e0ee8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 08:10:15.677295 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d1f50-ad7f-491f-88a6-e981783e0ee8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 08:10:15.678863 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d1f50-ad7f-491f-88a6-e981783e0ee8 service placement] RBAC: Authorization granted {{(pid=81927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 08:10:15.688798 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: [pid: 81927|app: 0|req: 1443/2897] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Aug 26 08:10:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 08:10:25.684515 dv-cinder-806605-7-iscsi devstack@keystone.service[81927]: DEBUG dbcounter [-] [81927] Writing DB stats keystone:SELECT=89 {{(pid=81927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}